This is a basic question of what freedoms individuals have. If you make the laws so complicated and or secretive that no one can comply with them then the entire system fails. You have 3 letter agencies running around selectively enforcing overly complex/secret laws then the very foundation of what the law is meant to do breaks. Selective enforcement equals political influence equals the Rule of Men, not the Rule of Law.
Because the thread of this conversation is plausibility, and the OP article lacks a great deal of that, as pointed out by tptacek. Nobody here is arguing that this surveillance is correct, only that the sequence of events in the story makes no damn sense.
1. http://www.nsa.gov/public_info/press_room/2013/30_July_2013....
My my, what trouble those "internet memes" get us into.
When the clear potential for abuse has been thoroughly documented, getting nitpicky on actual abuse seems like a waste of time.
Of course, were I to get nitpicky, I'd say there is documented evidence of abuse (with NYTimes reporting going back years): http://www.techdirt.com/articles/20130731/16193324027/nsa-bo...
--
EDIT: I do believe there's a difference between the potential for abuse and actual abuse. But I further believe the potential for abuse from global surveillance is so significant that even the potential is a dire problem in its own right. I was a bit too flippant about that distinction above.
Incidentally, I love the mentality that says that the USG is using optical splitters to record all the traffic on the Internet, built a data center sufficient to archive it, built the database technology sufficient to enable the entire NSA and FBI realtime access to that data, compromised SSL CAs, but is too dumb not to tell strangers about their secret programs on random visits.
It's like in the movies, when the evil mastermind has the hero tied to a chair suspended over the laser shark tank, but monologues long enough for the hero to find a way to escape.
http://www.huffingtonpost.com/2013/05/07/tim-clemente-fbi_n_...
http://www.fbi.gov/news/testimony/going-dark-lawful-electron...
http://www.huffingtonpost.com/2013/03/28/fbi-surveillance_n_...
Edit: Note that this was well before the PRISM leaks.
The group of people that are doing this random visits are not imbued in the same culture of secrecy as the NSA. Furthermore, the larger a program, the more and more casual a group of people are going to be about protecting it. It's the fault of our social programming -- if nearly everyone I deal with on a daily basis is in on a secret, I am far more likely to share that secret. This is probably the reason that nobody talks about their own secret projects at the NSA.
Your line of reasoning was what I used to assume about the type of NSA style data collection: "Gathering and using data information about every American would be an immense task, requiring lots of people -- if such a program existed, we probably would have found out about it now."
It turns out -- we are finding out about it for precisely that reason.
This is how spying works in general--find one of the inevitably many people in a secret organization who will, in the right compromised situation (alcohol, a romantic affair, etc.), brag about their knowledge of state secrets.
Or look at Bradley Manning, who among other things exposed the fact that low level operatives have access to far more secret data than one would have imagined. His motivation (which led him to release all the data) differed from the organization's overall motivation in an extreme way.
Which makes me wonder, how do county police get access to a reporter's search history?
That's not a mentality, that's being aware the USG consists of millions of people, exactly the opposite of
It's like in the movies, when the evil mastermind has the hero tied to a chair
So yeah, this part of the story is entirely plausible to me.
Government is neither competent nor incompetent. It is a vast collection of organizations composed of humans that vary from grossly negligent paycheck collectors to shockingly effective strategic geniuses. Bureaucracy is the friction inherent in the system; different people clog and lubricate its workings to different aims, which range from the purest altruism to the most cynical abuse.
But 2 things, neither of which are solid, can't rule it out (for me): if all search engines are monitored, what does it matter if the sources and methods are revealed? The adversary won't have much use for that information, unless they stop using the Internet altogether. It's a dumb argument, sure, but I could see it used as justification.
Second: does FBI leadership think a program like this could have prevented Boston? If they think this program is a good idea, I would not put it past them to run it so openly. Security theater works best when everyone sees it.
Note that I'm not saying that Internet surveillance data doesn't get used this way. I'm saying that when it does, the USG sure as shit doesn't advertise the fact. They don't burn sources and methods for no good reason.
It's almost totally implausible.