News for hackers. Stuff that matters.
Re:Drink Me: (Ab)Using a LLM to Compress Text by immibis on Saturday May 04, 2024 @10:30PM (#40261848)
And here's the opposite - using gzip as a (merely adequate) "large" language model: https://aclanthology.org/2023.findings-acl.426.pdf

By the way, if you want to see how well gzip actually models language, take any gzipped file, flip a few bits, and unzip it. If it gives you a checksum error, ignore that. You might have to unzip in a streaming way so that it can't tell the checksum is wrong until it's already printed the wrong data that you want to see.

There are no comments on this comment yet.