In the UK, the soviets were almost totally successful largely because the British establishment could not believe that someone who came from the right place and went to the right place could really be a communist spy. Even after, with or without hindsight, it was obvious Kim Philby was almost exonerated and re-entered MI6 to an extent purely because the people above him decided it was simultaneously too damaging and unlikely for a Cambridge man to be a communist.
I used to investigate computer crime. You know what would have made my job really easy? Unlimited access to all computers worldwide.
Luckily I had to learn alternative investigative methods because we value privacy more than we value catching criminals, which is a good thing. I'd rather a criminal go free once in a while than a complete loss of privacy.
Isn't that more-or-less what the NSA have already?
What I mean is, Edward Snowden revealed that the NSA already have most criminals' dirty laundry. The only thing keeping the law from rolling 'em up wholesale is the Overton window around parallel construction.
It is also a very electable sound bite. Everyone is against the "bad people". Re-election at any cost is the goal. We have government of the people and by the people but we stopped being for the people long long ago.