Re:Pirate Library Mirror: Preserving 7TB of books (that are ...
by godelski on Monday July 04, 2022 @03:07PM
(#31980653)
> Like, all the knowledge ever.
Go to your local library. There is actually a lot more there than books. There are videos and audio records too. There are news paper clippings too.
Worse, data is being generated very fast. Let's look[0]
> [In 2012], CenturyLink projects that 1.8 zettabytes of data will be created. By 2015, the projection is 7.9 zettabytes.
> MAST is currently home to an estimated *200 terabytes of data*, which… is nearly the same amount of information contained in *the U.S. Library of Congress.*
But that said, a few petabytes is going to only cost in the 10s of thousands of dollars and max in the low 100s. So this is well within the budget of even every modestly sized city and definitely every university. It would be even easier if this was done with torrenting.
I think the real question is^: why are we not, as a species, creating this system? It seems very reasonable that we could back up all data. (There is also a dark side to this too! So let's not forget about that) At least, why aren't we creating a full access world library for all scholarly data, which is probably something that could be housed for a few grand. Should we do this on our own given the relatively low cost? Books + sci-hub + arxiv + *xiv?
Go to your local library. There is actually a lot more there than books. There are videos and audio records too. There are news paper clippings too.
Worse, data is being generated very fast. Let's look[0]
> [In 2012], CenturyLink projects that 1.8 zettabytes of data will be created. By 2015, the projection is 7.9 zettabytes.
> MAST is currently home to an estimated *200 terabytes of data*, which… is nearly the same amount of information contained in *the U.S. Library of Congress.*
But that said, a few petabytes is going to only cost in the 10s of thousands of dollars and max in the low 100s. So this is well within the budget of even every modestly sized city and definitely every university. It would be even easier if this was done with torrenting.
I think the real question is^: why are we not, as a species, creating this system? It seems very reasonable that we could back up all data. (There is also a dark side to this too! So let's not forget about that) At least, why aren't we creating a full access world library for all scholarly data, which is probably something that could be housed for a few grand. Should we do this on our own given the relatively low cost? Books + sci-hub + arxiv + *xiv?
[0] https://blogs.loc.gov/thesignal/2012/04/a-library-of-congres...
^ maybe it is already being done and I don't know, please inform me if it is. (Other than the NSA)