News for hackers. Stuff that matters.
Re:Ask HN: What content/knowledge is most important? by silisili on Thursday October 06, 2022 @10:49PM (#33116879)
Great list.

Perhaps a stupid question - does that Wikipedia number include photos? If not, what kind of overhead does that add?

Re:Ask HN: What content/knowledge is most important? by julienmarie on Thursday October 06, 2022 @10:59PM (#33116950)
That would be the Wikidata Wikicommons dataset. It's 375 TB (source: https://www.wikidata.org/wiki/Q565 ). Including also audio, etc...
Re:Ask HN: What content/knowledge is most important? by silisili on Thursday October 06, 2022 @11:09PM (#33117001)
Thanks. That makes me feel silly...I had no idea so much media existed on Wikipedia, nor that it had enough text to fill that many GB alone.
Re:Ask HN: What content/knowledge is most important? by lossolo on Thursday October 06, 2022 @11:57PM (#33117251)
English Wikipedia is only about 89GB with pictures included and 46GB without.

You can download here newest version:

https://download.kiwix.org/zim/wikipedia/

I've maxi version with images on my Pi and it works locally without internet access. I've also backup in a faraday cage.

Then you can explore it using https://www.kiwix.org/en/download/