Re:GPT-4 Can't Reason
by throwawaymaths on Tuesday August 08, 2023 @06:24PM
(#37056284)
I think you're missing the point. Of course prolog can reason better than humans, that's what it was designed to do (deterministically).
The point is not to solve reasoning. The question is, can LLMs reason?
LLMs were not designed to reason, reasoning in an LLM is emergent. That should be interesting.
It should also be exciting because the domain over which LLMs can reason is much more unbounded than the domain over which prolog can reason (tokens and relationships you've already supplied it)
Also, note that those statements are not hygienic, and that it assumes a certain logical interpretation of the sentences that isn't universal. We can also ask annoying questions like: is 'all' intensional or extensional? If I invented a new thing called swerb, and swerb is a forp now. Is it retroactively a tworby because the definition of being a forp means it is a tworby, or is it just that at the point in time of the original assertion all forps were tworbys (so the swerb wouldn't be)? There are no good ways to resolve this without back and forth and contextual guessing, or using formal languages.
Since there is no One True Logic, the common kernel of reasoning might as well be computation itself.