Re:Any insider takes on Yann LeCun's push against current ar...
by mountainriver on Friday March 14, 2025 @10:19PM
(#43369350)
The images are converted to an embedding space the size of token embedding space. And the model is trained on that new embedding space. A joint representation of text and images is formed.
Itβs not as though the image is converted to text tokens.
Itβs not as though the image is converted to text tokens.