Re:NNCP: Lossless Data Compression with Neural Networks
by stan_rogers on Saturday April 06, 2019 @11:14AM
(#19591128)
The comment you are replying to was trying to explain the "10X programmer" idea. Nowhere was it claimed that the algorithm would have a 10X performance improvement.
Re:NNCP: Lossless Data Compression with Neural Networks
by javierluraschi on Saturday April 06, 2019 @12:19PM
(#19591487)
No, I meant this comment: "His relatively simple LSTM-based neural net compressor is 10x faster than one of the more complex state of the art algorithms"
From the conclusion:
“We presented a practical implementation of an LSTM based lossless compressor. Although it is slow, its description is simple and the memory consumption is reasonable compared to compressors giving a similar compression ratio. It would greatly benefit from a dedicated hardware implementation.”
I only skimmed through the paper, but looks to me like this might be a 10X improvement over other LSTM compression methods, not state-of-the-art compression.
That said, I’m far from being an expert in compression and was hoping from someone in HN to explain how relevant this is in their discipline.