Building better compression together with DivANS

Re:Building better compression together with DivANS by BlackLotus89 on Sunday June 24, 2018 @04:33PM (#17388262)

So up until now Dropbox used zlib compression? I would have thought that they would use zstd or brotli for a good speed/ratio-ratio or lz4 for speed.

DivANS looks interesting/promising like a nice little kit for compression. Doesn't seem like it's good for archiving since it doesn't seem to have support for seek (or so it seems, would like to be proven wrong), but very interesting nonetheless.

[ Parent | on HN ]

Re:Building better compression together with DivANS by eesmith on Sunday June 24, 2018 @05:01PM (#17388363)

I don't know how to reconcile this post with previous posts of their's where they talk about using brotli. https://blogs.dropbox.com/tech/tag/brotli/

[ Parent | on HN ]

Re:Building better compression together with DivANS by sanxiyn on Monday June 25, 2018 @02:12AM (#17390243)

Those posts are about static files (such as JavaScript) on dropbox.com websites, not about files stored in Dropbox.

[ Parent | on HN ]

Re:Building better compression together with DivANS by eesmith on Monday June 25, 2018 @02:25AM (#17390303)

Thanks!

[ Parent | on HN ]

Re:Building better compression together with DivANS by daniel_rh on Sunday June 24, 2018 @09:19PM (#17389329)

DivANS author here: the compression benchmarks all measure seekability to the nearest 4MB chunk, but the current lib itself doesn't support seekability out of the box, yet. However, it would be trivial to reset the encoder at each 4mb chunk and could even be done without additional library support by just reinitializing the compressor (or decompressor) each 4mb

[ Parent | on HN ]