News for hackers. Stuff that matters.
Re:A working entropy encoder with output below the Shannon l... by peter-ebert on Monday June 24, 2024 @05:07PM (#40780791)
Whenever you're compressing a file on your computer the frequencies are known beforehand. Agree this does not apply to noisy-channel coding, only the Shannon source coding theorem in lossless compression. Good point though I'm not sure if this would be considered an entropy encoder, as previous values do have some impact. Any more info I should look at for that?
Re:A working entropy encoder with output below the Shannon l... by gliptic on Monday June 24, 2024 @05:11PM (#40780846)
> Whenever you're compressing a file on your computer the frequencies are known beforehand.

Not at all. The best compressors learn to predict the frequencies as they go, they do not compute them up front and store them in the output.

Re:A working entropy encoder with output below the Shannon l... by foobarqux on Monday June 24, 2024 @05:52PM (#40781278)
You still have to store that info and that counts against the number of bytes you are using