News for hackers. Stuff that matters.
Re:Ts_zip: Text Compression Using Large Language Models by londons_explore on Wednesday August 16, 2023 @06:02PM (#37154480)
Even if you trained an LLM with a simplified tokenizer that simply had 256 tokens for each of 256 possible ascii characters, you would see the same result.

There are no comments on this comment yet.