Re:An OpenAI model has disproved a central conjecture in dis...
by baq on Wednesday May 20, 2026 @04:48PM
(#48213915)
LLMs ingest and output tokens, but they don’t compute with them. They have internal representations of concepts, so they have some capability to work with things which they didn’t see but can map onto what they know. The surprise and the whole revolution we’re going through is that it works so well.
[ Parent
| on HN ]
Re:An OpenAI model has disproved a central conjecture in dis...
by wren6991 on Wednesday May 20, 2026 @05:18PM
(#48214281)
> they don’t compute with them
Isn't this exactly what chain-of-thought does? It's doing computation by emitting tokens forward into its context, so it can represent states wider than its residuals and so it can evaluate functions not expressed by one forward pass through the weights. It just happens to look like a person thinking out loud because those were the most useful patterns from the training data.