Re:Lepton image compression: saving 22% losslessly from imag...
by deegles on Thursday July 14, 2016 @12:07PM
(#12094988)
Does Dropbox do block or file-level deduping?
[ Parent
| on HN ]
Re:Lepton image compression: saving 22% losslessly from imag...
by bmalehorn on Thursday July 14, 2016 @12:41PM
(#12095328)
Block, it deduplicates based on 4MB blocks.
Re:Lepton image compression: saving 22% losslessly from imag...
by the_duke on Thursday July 14, 2016 @12:46PM
(#12095367)
I wonder if they use a rolling checksum too, to avoid duplicating a complete file if only a view bytes shifted (for example adding a line of text in the beginning of a file)
The backup tool bup (https://github.com/bup/bup) does this.
Re:Lepton image compression: saving 22% losslessly from imag...
by aidenn0 on Thursday July 14, 2016 @01:11PM
(#12095575)
They almost certainly do not, mostly because of how slow doing so is.
Re:Lepton image compression: saving 22% losslessly from imag...
by sliverstorm on Thursday July 14, 2016 @02:24PM
(#12096163)
It probably wouldn't hit the most important cases either, dedup is typically most powerful & valuable on large media files, software packages, disk ISO's, and the like which do not frequently have arbitrary text inserted at the start of the file!