Re:Zstandard – Fast and efficient compression algorithm
by bhouston on Sunday January 25, 2015 @04:42AM
(#8942507)
What one needs is a preset dictionary. Have a hash of it during compression and then require a preset dic on decompress that has the same hash. Should be a straightforward extension but it is a format change. I think preset dic would be useful in a lot of contexts.
[ Parent
| on HN ]
Re:Zstandard – Fast and efficient compression algorithm
by MichaelGG on Sunday January 25, 2015 @04:48AM
(#8942519)
But the preset dic functionality I've seen, in say, LZ4, really is just the saved state of a normal compression run. So once you start compressing, the dictionary eventually evaporates as more data does in and backreferences can no longer point back that far into the dictionary. That's fine if all your content compresses well, but if the dictionary is a far superior state...