Re:Modern LZ Compression (2019)
by vardump on Wednesday August 18, 2021 @05:24AM
(#28219127)
For high entropy data (=somewhat random data), FSE is quite comparable to Huffman in compression speed.
For low entropy (lots of high probability symbols, like zeroes), Huffman is about 2-3x faster. But on the flipside, FSE achieves markedly higher compression ratio.
I think FSE is worth the speed tradeoff vs Huffman in most cases.
Re:Modern LZ Compression (2019)
by hexxagone on Wednesday August 18, 2021 @11:49AM
(#28222972)
"FSE achieves markedly higher compression ratio". I do not thin it is true, FSE/ANS achieves slightly better ratios in general.
Zstd uses both Huffman (for large alphabets) and FSE (for small alphabets).
For low entropy (lots of high probability symbols, like zeroes), Huffman is about 2-3x faster. But on the flipside, FSE achieves markedly higher compression ratio.
I think FSE is worth the speed tradeoff vs Huffman in most cases.