Re:Any insider takes on Yann LeCun's push against current ar...
by sturza on Saturday March 15, 2025 @04:32PM
(#43374970)
A picture is also an abstraction. If you take a picture of a tree, you have more details than the word "tree". What i think the parent is saying, is that all the information in a picture of a tree can be encoded in language, for example a description of a tree, using words. Both are abstractions but if you describe the tree well enough with text(and comprehend the description) it might have the same "value" as a picture(not for a human, but for a machine). Also, the size of the text describing the tree might be smaller than the picture.
Re:Any insider takes on Yann LeCun's push against current ar...
by kryogen1c on Saturday March 15, 2025 @07:32PM
(#43375873)
> all the information in a picture of a tree can be encoded in language
What words would you write that would as uniquely identify this tree from any other tree in the world, like a picture would?
Now repeat for everything in the picture, like the time of day, weather, dirt on the ground, etc.
Re:Any insider takes on Yann LeCun's push against current ar...
by og_kalu on Sunday March 16, 2025 @09:39AM
(#43379020)
I think his point is that LLMs are pre-trained transformers. And pre-trained transformers are general sequence predictors. Those sequences started out as text or language only but by no means is the architecture constrained to text or language alone. You can train a transformer that embeds and predicts sound and images as well as text.
Im just a layman here, but i don't think this is true. Language is an abstraction, an interpreative mechanism of reality. A reproduction of reality, like a picture, by definition holds more information than it's abstraction does.