News for hackers. Stuff that matters.
Re:Smaller and faster data compression with Zstandard by morecoffee on Wednesday August 31, 2016 @11:47PM (#12402983)
A recent compression discussion I saw involved how do compressors fare on uncompressible input? For example, suppose you wanted to add compression to all your outbound network traffic. What would happen if there was mixed compressible traffic along with the uncomressible kind? A common case would be sending HTML along with JPEG.

Good compressors can't squeeze any more out of a JPEG, but they can back off fast and go faster. Snappy was designed to do this, and even implementations of gzip do it too. It greatly reduces the fear of CPU overhead to always on compression. I wonder how Zstd handles such cases?

*Ignoring security altogether

Re:Smaller and faster data compression with Zstandard by Cyan4973 on Thursday September 01, 2016 @09:21AM (#12405004)
Zstd pass faster over incompressible data. Expect something > 1 GB/s
Re:Smaller and faster data compression with Zstandard by nimrody on Thursday September 01, 2016 @06:42AM (#12404236)
Dropbox say they can losslessly compress JPEG files (~20% saving):

https://blogs.dropbox.com/tech/2016/07/lepton-image-compress...

Re:Smaller and faster data compression with Zstandard by gcp on Thursday September 01, 2016 @07:46AM (#12404481)
Known techniques. JPEG uses Huffman coding for entropy coding, you can replace that with arithmetic coding. This requires knowing the format details, though.