Re:Ask HN: What content/knowledge is most important?
by julienmarie on Thursday October 06, 2022 @10:59PM
(#33116950)
That would be the Wikidata Wikicommons dataset. It's 375 TB (source: https://www.wikidata.org/wiki/Q565 ). Including also audio, etc...
Re:Ask HN: What content/knowledge is most important?
by silisili on Thursday October 06, 2022 @11:09PM
(#33117001)
Thanks. That makes me feel silly...I had no idea so much media existed on Wikipedia, nor that it had enough text to fill that many GB alone.
Re:Ask HN: What content/knowledge is most important?
by lossolo on Thursday October 06, 2022 @11:57PM
(#33117251)
English Wikipedia is only about 89GB with pictures included and 46GB without.
You can download here newest version:
https://download.kiwix.org/zim/wikipedia/
I've maxi version with images on my Pi and it works locally without internet access. I've also backup in a faraday cage.
Then you can explore it using https://www.kiwix.org/en/download/
Perhaps a stupid question - does that Wikipedia number include photos? If not, what kind of overhead does that add?