Re:Overfitted a 900KB Transformer to Compress a 100MB CSV in...
by fennecbutt on Saturday June 27, 2026 @06:21AM
(#48696930)
Given it's an overfitted transformer isn't is still terribly inaccurate/is liable to add random bytes here and there?
[ Parent
| on HN ]
Re:Overfitted a 900KB Transformer to Compress a 100MB CSV in...
by spidy__ on Saturday June 27, 2026 @07:01AM
(#48697162)
If I were only using a transformer that would have been true, but we use arithmetic coding alongside our transformer to fix those mistakes (layman terms). You can read about arithmetic coding, its a pretty cool topic.