Re:AI language models can exceed PNG and FLAC in lossless co...
by burnte on Thursday September 28, 2023 @03:20PM
(#37694368)
Give me a lookup table of 50 petabytes, let me seed that LUT with billions of files, and I, too, can write an amazingly efficient compression algorithm.
[ Parent
| on HN ]
Re:AI language models can exceed PNG and FLAC in lossless co...
by m3kw9 on Thursday September 28, 2023 @03:34PM
(#37694607)
But it isn’t generalized like this is supposed to be
Re:AI language models can exceed PNG and FLAC in lossless co...
by gpt5 on Thursday September 28, 2023 @03:21PM
(#37694393)
Sure. But you can only use text files in your seed.
Re:AI language models can exceed PNG and FLAC in lossless co...
by qayxc on Thursday September 28, 2023 @05:08PM
(#37695873)
What's the difference between 0x2e and .?
You can easily transform between representations of data, be that text or binary in any encoding you'd like.
The model input token vector (or LUT index) is still the same. I don't see a difference there.
Re:AI language models can exceed PNG and FLAC in lossless co...
by gpt5 on Thursday September 28, 2023 @06:47PM
(#37696952)
You are missing the point. LLM are not trained on image data, but on human text data. This is not the same as encoding the image as ASCII characters.
Re:AI language models can exceed PNG and FLAC in lossless co...
by janalsncm on Thursday September 28, 2023 @04:29PM
(#37695369)
I don’t see why video chat apps shouldn’t do something like this. Maybe the encoding/decoding is too slow.
Re:AI language models can exceed PNG and FLAC in lossless co...
by sfink on Thursday September 28, 2023 @04:48PM
(#37695630)
Accessing a giant lookup table is about the most cache-unfriendly thing you could do. This is not a good approach when latency matters.
Smaller LUTs are fun to think of, especially if you eliminate the lossless angle. I'm really not that interesting to watch during a videoconference. When I'm not talking, it would probably be better for viewers to make up a stream of me sitting still with a dumb look on my face. It should be loosely matched to my actual position/pose, so that when I start talking or my dog attacks me or the bomb explodes and wipes out my room, the transition back to actual data is relatively seamless.
(And if you set the threshold high enough, maybe I don't need to be in the room at all...)
Re:AI language models can exceed PNG and FLAC in lossless co...
by FactualOrion on Thursday September 28, 2023 @08:07PM
(#37697670)
This is a technology described in the book "A Fire Upon the Deep" by Vernor Vinge. It's discussed fairly close to the end.