News for hackers. Stuff that matters.
Re:Improving compression at scale with Zstandard by jclay on Wednesday December 19, 2018 @04:53PM (#18720096)
Great, thanks! Last question.

On the blog you mention you are underway porting the internal code to replace Zlib with Zstd. Is there a reason you decided not to use the wrapper as a first pass to migrate all uses of Zlib to Zstd across the entire codebase?

Re:Improving compression at scale with Zstandard by terrelln on Wednesday December 19, 2018 @05:14PM (#18720290)
There are a few reasons we haven't used the wrapper.

* The larger services require tuning to get the best performance out of zstd, and we use some advanced options.

* We have a "Managed Compression" library which does zstd dictionary compression, which doesn't work with the wrapper.

* We have our own automatic decompression framework that handles many algorithms [0].

* A lot of use cases switched over from other algorithms than zlib.

* A lot of use cases switched over to zstd organically, without our involvement, since it was such a clear win.

[0] https://github.com/facebook/folly/blob/master/folly/compress...