Re:Words Are a Byproduct of Consciousness. For LLMs, It's Ba...
by tyzoid on Tuesday June 30, 2026 @01:20PM
(#48735993)
I have to disagree with the fundamental premise here. LLMs do indeed have an internal "concept" mapping - the embedding layer. There's some fun demos on youtube[1] where you can manipulate embedding vectors (such as king - man + woman = queen), and these manipulations are done entirely in the embedding/concept space.
[1] https://youtu.be/gQddtTdmG_8 (around 14:00)