We tend to go after those we sinned against secondary as opposed to dealing with the primary person we've sin against: God. David realigns our thinking!
Psalms 51:4 Against you, you only, have I sinned and done what is evil in your sight, so that you may be justified in your words and blameless in your judgment.