News for hackers. Stuff that matters.
Re:Local LLMs versus Offline Wikipedia by GuB-42 on Saturday July 19, 2025 @06:58PM (#44620237)
Kiwix (what the author used) uses "zim" files, which are compressed. I don't know where the difference come from, but Kiwix is a website image, which may include some things the raw Wikipedia dump doesn't.

And 57 GB to 25 GB would be pretty bad compression. You can expect a compression ratio of at least 3 on natural English text.

There are no comments on this comment yet.