Re:How a Theoretical Claim About the NSA Magically Transform...
by nl on Friday July 19, 2013 @11:33AM
(#6070808)
I've always thought this is interesting, if not directly related.
Apache Accumulo:
Like Google, the [NSA] needed a way of storing and retrieving massive amounts of data across an army of servers, but it also needed extra tools for protecting all that data from prying eyes. They added “cell level” software controls that could separate various classifications of data, ensuring that each user could only access the information they were authorized to access.
Apache Accumulo:
Like Google, the [NSA] needed a way of storing and retrieving massive amounts of data across an army of servers, but it also needed extra tools for protecting all that data from prying eyes. They added “cell level” software controls that could separate various classifications of data, ensuring that each user could only access the information they were authorized to access.
http://www.wired.com/wiredenterprise/2012/07/nsa-accumulo-go...
Then:
How will graph applications adapt to Big Data at petabyte scale?
Brain scale. . .: 2.84 PB adjacency list, 2.84 PB edge list
Largest supercomputer installations do not have enough memory to process the Brain Graph (3 PB)!
[Accumulo gives] linear performance from 1 trillion to 70 trillion edges [on the 1 Pb Graph 500 benchmark]
From "An NSA Big Graph Experiment": http://www.pdl.cmu.edu/SDI/2013/slides/big_graph_nsa_rd_2013...