News for hackers. Stuff that matters.
Re:Researchers: It takes 1.5 MB of data to store language in... by GuB-42 on Thursday March 28, 2019 @09:02AM (#19511744)
I've seen somewhere that there is about 1 bit of entropy per letter of English text. The best packer (Hutter prize) compresses 100MB of wikipedia down to 15MB, including the packer itself, a ratio of 1:6.5, which isn't that far off.

Considering that, 40k words to 400kbits is not too surprising.

There are no comments on this comment yet.