Re:Hyperdrive v10 – a peer-to-peer filesystem
by carterschonwald on Friday May 15, 2020 @09:37AM
(#23191984)
Wikipedia’s text history absolutely fits on a tiny hard drive and is easy to get a replica of.
[ Parent
| on HN ]
Re:Hyperdrive v10 – a peer-to-peer filesystem
by RussianCow on Friday May 15, 2020 @11:40AM
(#23193447)
Compressed with 7-Zip, sure, but uncompressed, the entire thing takes up 10TB. The Hyperdrive post doesn't mention compression at all, so the comparison should be without it.
> As of June 2015, the dump of all pages with complete edit history in XML format at enwiki dump progress on 20150602 is about 100 GB compressed using 7-Zip, and 10 TB uncompressed.
From: https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia#Si...
It's a bit of a nitpick either way because you're right, Wikipedia may not be the best example because 10TB is still relatively small.