Re:Real Time Data compression using LZ4
by pyxy on Wednesday June 06, 2012 @10:23AM
(#4073975)
From Compression Ratings website I've catched this:
http://compressionratings.com/sort.cgi?rating_sum.full+p3
[ Parent
| on HN ]
program comp-ratio comp-time decomp-time
pigz -1 40.3% 26.92s 20.31s
lz4 -c2t4 43.9% 52.72s 5.84s
info-zip -1 41.3% 122.31s 119.81s
More relevant would be a comparison with gzip -1, lzop, snappy and rolz.Also the test data is mixed. It is not very helpful to see where this algorithm shines.
Also note the memory usage shots up from 5m/2m for info-zip -1 to 46m/42m for the specific case of lz4 you picked.
EDIT: also bzip2 seems to be paticularly bad for this specific dataset, other algorithms in that category get better compression ratios. Added pigz to the comparison (info-zip with pthreads).