Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf]
by The_rationalist on Monday March 29, 2021 @10:57PM
(#26630860)
neural network are extremely inefficient at learning symbolic reasoning by design and I doubt a radically new kind of neural network will be discovered, we have pretty much made an exhaustive analysis.
A neural network that just "feels" that Fermat's Last Theorem is true, is much less intelligent than one that can produce the proof of it and present that to us, so we can trust that what it's saying is true.
If you can't do symbolic manipulation, you are not really intelligent, artificial or otherwise, I would say.