I think you’re conflating reasoning with inference. And in any case, GP wasn’t using reasoning, but rather resourcefulness/invention. I’m not sure an LLM can pull that off beyond coming up with vague, derivative fiction.
Re:Chatbots Don’t Know What Stuff Isn’t
by throwawaymaths on Saturday May 13, 2023 @11:34AM
(#35929364)
Gp said "state of being" so I don't think the either of us can know for sure what was meant by that.
It seems to me that the ability to reason ( though primitive it may still be) is an emergent property of sufficiently large differentiable hash/lookup tables (and if you think about the mechanism of reasoning, that seems... Reasonable).
According to "folks in the know", the scaling limits of GPT architecture seem to be nigh, but if it were a bit higher I wouldn't be surprised if LLMs would have made it.