News for hackers. Stuff that matters.
Re:Overfitted a 900KB Transformer to Compress a 100MB CSV in... by fennecbutt on Saturday June 27, 2026 @06:21AM (#48696930)
Given it's an overfitted transformer isn't is still terribly inaccurate/is liable to add random bytes here and there?
Re:Overfitted a 900KB Transformer to Compress a 100MB CSV in... by spidy__ on Saturday June 27, 2026 @07:01AM (#48697162)
If I were only using a transformer that would have been true, but we use arithmetic coding alongside our transformer to fix those mistakes (layman terms). You can read about arithmetic coding, its a pretty cool topic.