Re:Xz format inadequate for long-term archiving
by Klasiaster on Saturday October 22, 2016 @11:37AM
(#12769092)
ZPAQ is a defined standard format which embedds the decompression algorithm for each block as bytecode into the archive. One can define a transformation (eg. LZ77 or color transformations of a picture) and compress this data through context mixing and arithmetic coding.
It uses checksums but I can't judge rightnow whether there is some issue implied concerning bitflips.
Re:Xz format inadequate for long-term archiving
by userbinator on Saturday October 22, 2016 @03:00PM
(#12770056)
ZPAQ is a defined standard format which embedds the decompression algorithm for each block as bytecode into the archive.
Is that a Turing-complete bytecode? If so, I envision some interesting applications with regard to procedurally-generated content...
Re:Xz format inadequate for long-term archiving
by Klasiaster on Sunday October 23, 2016 @07:37AM
(#12773087)
Yes, there are two examples for pi here: http://mattmahoney.net/dc/zpaqutil.html and one where the input does not exactly have to be pi, but can contain it: https://github.com/pothos/zpaqlpy/blob/master/test/mixedpi2....
But of course for real world use cases one would choose a general compression algorithm or write a specific one for a certain type of data you want to handle (because it will perform better than a general algorithm).
[0] http://ck.kolivas.org/apps/lrzip/README.benchmarks