News for hackers. Stuff that matters.
Re:AWS switch from gzip to zstd – about 30% reduction in com... by Dylan16807 on Saturday August 20, 2022 @03:19AM (#32529981)
It's not that crazy if you separate it into two parts.

A) Use arithmetic coding to encode symbols as fractions instead of using an integer number of bits for each symbol. https://en.wikipedia.org/wiki/Arithmetic_coding http://www.ws.binghamton.edu/fowler/fowler%20personal%20page...

B) Shuffle the bits around so that you can use faster math and lookup tables instead of directly operating on fractions.

There are no comments on this comment yet.