Re:Researchers: It takes 1.5 MB of data to store language in...
by GuB-42 on Thursday March 28, 2019 @09:02AM
(#19511744)
I've seen somewhere that there is about 1 bit of entropy per letter of English text. The best packer (Hutter prize) compresses 100MB of wikipedia down to 15MB, including the packer itself, a ratio of 1:6.5, which isn't that far off.
Considering that, 40k words to 400kbits is not too surprising.
Considering that, 40k words to 400kbits is not too surprising.