News for hackers. Stuff that matters.
Re:The Guardian walks back claims of direct NSA access to se... by aryastark on Thursday June 13, 2013 @05:38PM (#5876766)
That may be true. However, the giant elephant in the room is the Utah data center.

This is a data center designed to, supposedly, store data on the scale of a yottabyte. I only say "a" yottabyte, because to assume even slightly greater than that is sheer lunacy.

That is freaking massive. If you took all terrorist cells and all terrorist activity for the history of terrorism and terrorist activity, you would not even touch a fraction of a percent utilization. We're talking rain drops in the ocean.

There is no way the NSA is merely watching the bad guys here. The data center is a few magnitudes too large for such a task.

I would assume right now they are merely recording all data, in hopes that one day they will have technology to quickly crack encryption. However, even without knowing what is said (the content), the metadata of connections gives plenty of information on what people are doing.

Re:The Guardian walks back claims of direct NSA access to se... by tptacek on Thursday June 13, 2013 @05:41PM (#5876791)
That Utah data center is literally the Internet's Area 51.
Re:The Guardian walks back claims of direct NSA access to se... by jongraehl on Thursday June 13, 2013 @09:49PM (#5877856)
"literally" :)

and yes, agreed - analogous on so many levels - a publicly admitted places where secret government things happen, which can be invoked to give an aura of reality to conspiracy theories true and false alike.

Re:The Guardian walks back claims of direct NSA access to se... by lawnchair_larry on Thursday June 13, 2013 @07:34PM (#5877363)
It's already been established that they redefine "collect" as a human actually viewing the data. The admit that they store roughly everything they can on everyone.
Re:The Guardian walks back claims of direct NSA access to se... by croikle on Thursday June 13, 2013 @10:55PM (#5878021)
The yottabyte stuff is basically BS. HN user Jabbles found a possible source for that, which just says '''The target GIG supports capacities exceeding exabytes (10^18 bytes) and possibly yottabytes (10^24 bytes) of data.'''[0]

Exabytes are eminently reasonable; yottabytes are not.

[0]: https://news.ycombinator.com/item?id=5854587

Re:The Guardian walks back claims of direct NSA access to se... by eco on Thursday June 13, 2013 @07:22PM (#5877308)
A yottabyte would take 3.333×10^11 3 terabyte hard disks. A 3.5 inch hard disk has a volume of 376.77344 cm³. The NSA buildings in Bluffdale take up around 1.5 million square feet. That means just the hard discs for a yottabyte would be just a bit less than a kilometer high (901 meters). That's about a 100 meters taller than Burj Khalifa. I think it's unlikely it's designed for anything near a yottabyte.
Re:The Guardian walks back claims of direct NSA access to se... by Amadou on Thursday June 13, 2013 @07:42PM (#5877392)
Clearly they do not yet have a yottabyte worth of data. It would be silly to build a warehousing site like that and have it be full-up with data the day it first opens for business.

I expect these sizing claims (which presumably come from some sort of government statements about the facility) are based on a timeline on the order of ten years or more. A YB in 2024 is going to take a lot less physical space than a YB in 2014.

Re:The Guardian walks back claims of direct NSA access to se... by eco on Thursday June 13, 2013 @07:49PM (#5877431)
You'd need a 2-3 order of magnitude increase in storage density to get anywhere near reasonable. I suspect that's not going to happen in 10 years but I don't know the current and projected rates of storage density increases.
Re:The Guardian walks back claims of direct NSA access to se... by Amadou on Thursday June 13, 2013 @09:49PM (#5877860)
Last I read, storage capacity per dollar has been increasing faster than Moore's Law over the last decade or so.

I tracked down what appears to be the origin of these yottabyte claims: http://www.nybooks.com/articles/archives/2009/nov/05/whos-in...

Based on that, it sounds like the yottabyte claims refer to raw, unprocessed data collected. Off the bat, I'm willing to believe in a 2 orders of magnitude decrease after data reduction techniques are applied to the raw data. My experience with data collected from telescopes was that we got about 100:1 reduction on the raw data versus what went into permanent storage.

The San Antonio site was news to me, though obviously no big secret since that book was published years ago.

Re:The Guardian walks back claims of direct NSA access to se... by tome on Thursday June 13, 2013 @06:35PM (#5877057)
Maybe they haven't filled it up yet. A quick search suggests the whole internet is on the scale of exabytes, so a yottabyte could store a million internets.
Re:The Guardian walks back claims of direct NSA access to se... by asperous on Thursday June 13, 2013 @08:58PM (#5877727)
Well even ignoring the PRISM part and Google and all that, look on the slide again: "Collection of communications on fiber cables and infrastructure as data flows past"

We already know about Room_641A[1]

[1]: http://en.wikipedia.org/wiki/Room_641A