Re:Autoencoding Blade Runner: reconstructing films with arti...
by vintermann on Wednesday May 25, 2016 @01:58AM
(#11767922)
You could, but I don't think this would be competitive on compression ratio at all, even allowing for an order of magnitude more time.
Re:Autoencoding Blade Runner: reconstructing films with arti...
by sp332 on Wednesday May 25, 2016 @10:13AM
(#11769877)
The technique is very effective, after all a variant of paq holds a compression record. http://prize.hutter1.net/ You can try paq yourself in PeaZip. http://filehippo.com/download_peazip_64/
Re:Autoencoding Blade Runner: reconstructing films with arti...
by argonaut on Wednesday May 25, 2016 @05:32PM
(#11773299)
PAQ does not use autoencoders, that's the difference. Neural network models for compression are extremely slow and can use a crapton of memory (one top benchmark result uses 32GB of RAM): https://www.quora.com/What-is-the-potential-of-neural-networ...
Re:Autoencoding Blade Runner: reconstructing films with arti...
by vintermann on Thursday May 26, 2016 @02:50AM
(#11776099)
Last I checked, PAQ only uses a shallow (two layer) neural network as a last step to weight the predictions from the multiple handmade next-bit prediction models it contains.
In practice, even the hyper-efficient compression algorithms used in something like zpaq tend to use only very small shallow predictive neural networks because no one wants to wait days for their data to be compressed or ship around big neural nets as part of their archives, so it's more of an information-theoretic curiosity. Few enough people will even use 'xz'.