Of course the implication of that statement is that if you are worried about your privacy, you're probably engaged in or associated with something that would require the attention of the intelligence services (because there is no threat to people who are not.)

So that not only means that there's no reason not to maximize surveillance, but possibly one of the most important reasons to maximize surveillance is the existence of people who are worried about their privacy. Those people are probably dangerous.

edit: Typing this, I feel like I may have been possessed by Cass Sunstein. Bring on Skynet.