> couldn't this be said of anyone really?

Not really? If someone tried to blackmail me by threatening to tell the world that I drink alcohol, watch porn, and have kinky sex I'd say... "you don't get out much, do you?" The pious don't have this leeway.