News for hackers. Stuff that matters.
Re:Building better compression together with DivANS by BlackLotus89 on Sunday June 24, 2018 @04:33PM (#17388262)
So up until now Dropbox used zlib compression? I would have thought that they would use zstd or brotli for a good speed/ratio-ratio or lz4 for speed.

DivANS looks interesting/promising like a nice little kit for compression. Doesn't seem like it's good for archiving since it doesn't seem to have support for seek (or so it seems, would like to be proven wrong), but very interesting nonetheless.

Re:Building better compression together with DivANS by eesmith on Sunday June 24, 2018 @05:01PM (#17388363)
I don't know how to reconcile this post with previous posts of their's where they talk about using brotli. https://blogs.dropbox.com/tech/tag/brotli/
Re:Building better compression together with DivANS by sanxiyn on Monday June 25, 2018 @02:12AM (#17390243)
Those posts are about static files (such as JavaScript) on dropbox.com websites, not about files stored in Dropbox.
Re:Building better compression together with DivANS by eesmith on Monday June 25, 2018 @02:25AM (#17390303)
Thanks!
Re:Building better compression together with DivANS by daniel_rh on Sunday June 24, 2018 @09:19PM (#17389329)
DivANS author here: the compression benchmarks all measure seekability to the nearest 4MB chunk, but the current lib itself doesn't support seekability out of the box, yet. However, it would be trivial to reset the encoder at each 4mb chunk and could even be done without additional library support by just reinitializing the compressor (or decompressor) each 4mb
Re:Building better compression together with DivANS by phrh8 on Sunday June 24, 2018 @07:10PM (#17388873)
What future work can we see here? Is this sort of approach really pushing the state of the art or is it just an attempt squeeze another few percent out of brotli at the expense of more CPU.

My understanding is the main novel idea here is splitting compression into independent subproblems. Is there potential for this idea to become the basis for all new modern (lossless) codecs (e.g. redesigns of FLAC or PNG)?