AI language models can exceed PNG and FLAC in lossless compression, says study

Re:AI language models can exceed PNG and FLAC in lossless co... by qayxc on Thursday September 28, 2023 @05:08PM (#37695873)

What's the difference between 0x2e and .? You can easily transform between representations of data, be that text or binary in any encoding you'd like. The model input token vector (or LUT index) is still the same. I don't see a difference there.

[ Parent | on HN ]

Re:AI language models can exceed PNG and FLAC in lossless co... by gpt5 on Thursday September 28, 2023 @06:47PM (#37696952)

You are missing the point. LLM are not trained on image data, but on human text data. This is not the same as encoding the image as ASCII characters.

[ Parent | on HN ]