Re:Douglas Hofstadter: Analogy as the Core of Cognition [video]
by mentalgear on Thursday September 10, 2026 @04:15PM
(#49649613)
Maybe you haven't noticed that the "Bitter Lesson" had itself a "Bitter Lesson" - that scaling pure data and compute did not lead to AGI: diminishing training returns, GPT-5 disappointment, even openAI stating it was the last 'pure scale' model.
The path forward all big llm providers ("ai" labs) have gone is neuro-symbolic (even though they publicly would never labeled it as such to not admit critics like Gary Marcus were right - even though all their actions actually point in that direction).
Re:Douglas Hofstadter: Analogy as the Core of Cognition [video]
by hbogert on Thursday September 10, 2026 @04:26PM
(#49649713)
Neuro symbolic, rly? Can you please elaborate what it is that made you conclude that?
Re:Douglas Hofstadter: Analogy as the Core of Cognition [video]
by jephs on Thursday September 10, 2026 @04:40PM
(#49649881)
I think me just means neural network models RLed to Chain of Thought reasoning? The thinking tokens are the symbolic bit.
Smolensky's latest paper posted here the other day has some thoughts on how modern neural networks might beconsidered neurosymbolic, or rather "gradient symbolic processing," from another perspective entirely.
I wouldn't say the bitter lesson has given out! If you haven't noticed, these things keep getting bigger and bigger.
Re:Douglas Hofstadter: Analogy as the Core of Cognition [video]
by augment_me on Thursday September 10, 2026 @09:22PM
(#49652392)
Quite a leap to call a random embedding a neurosymbolic representation
If he had accepted the "Bitter Lesson", I think he would have been at the forefront of LLMs.