Re:Andrej Karpathy on X: "I quite like the new DeepSeek-OCR ...
by Workaccount2 on Thursday October 23, 2025 @12:41PM
(#45683964)
Isn't this effectively what the latent space is? A bunch of related vectors that all bundle together?
[ Parent
| on HN ]
Re:Andrej Karpathy on X: "I quite like the new DeepSeek-OCR ...
by taneq on Thursday October 23, 2025 @08:48PM
(#45689429)
“Percel” is still a way cooler and arguably more descriptive term than “token” though.
Re:Andrej Karpathy on X: "I quite like the new DeepSeek-OCR ...
by js8 on Friday October 24, 2025 @12:30AM
(#45690780)
No, latent space doesn't have to be made of percels, just like not every 2D array of 3-element vectors is an image made of pixels. Percels are tied to your sensors, components of what you perceive, in totality.
Of course there is an interesting paradox - each layer of the NN doesn't know whether it's connected to the sensors directly, or what kind of abstractions it works with in the latent space. So the boundary between the mind and the sensor is blurred and to some extent a subjective choice.