Re:Ask HN: LZ4 was not added as an optional compressor in HT...
by tandemstrong on Thursday May 07, 2015 @01:52AM
(#9503484)
This benchmark is a fairly bad reference.
It measures memory usage from the lz4 command line utility, without mentioning it. This is completely different from lz4 algorithm.
Effectively, it measures input / output buffers, which are external to lz4. Plus it uses highest settings for such buffers, also without mentioning it. Using -B4 setting, for example, would reduce I/O buffer memory by a 50X factor.
It measures memory usage from the lz4 command line utility, without mentioning it. This is completely different from lz4 algorithm.
Effectively, it measures input / output buffers, which are external to lz4. Plus it uses highest settings for such buffers, also without mentioning it. Using -B4 setting, for example, would reduce I/O buffer memory by a 50X factor.
lz4 itself uses only 16KB for compression.