I think there is a subtle distinction between the "if you have nothing to hide, you have nothing to fear; ergo privacy invasion is good" meme, and what was said above ("privacy invasion is bad, but I am not concerned with invasion if my privacy because I have nothing to hide"). Which is not to say there's nothing to object to in the latter.