Re:LLMs can't self-correct in reasoning tasks, DeepMind stud...
by jiggawatts on Monday October 09, 2023 @05:36PM
(#37825834)
Current LLMs use an optimisation of processing data one word at a time. This makes them bad at solving puzzles involving individual letters or digits.
This is a well known, well understood limitation that can be overcome (Facebook punished a hierarchical model that can parse individual characters), but this technique isn’t used by ChatGPT.
Whenever I see a criticism like this, it says more to me about the hubris of humans and the falsify of their assumed superior intelligence.
You’re criticising the intelligence of a thing you don’t understand yourself!
You didn’t “read the manual”. You didn’t go find out why the AI is failing. You just spouted an angry comment and gave up without gaining any understanding.
This is a well known, well understood limitation that can be overcome (Facebook punished a hierarchical model that can parse individual characters), but this technique isn’t used by ChatGPT.
Whenever I see a criticism like this, it says more to me about the hubris of humans and the falsify of their assumed superior intelligence.
You’re criticising the intelligence of a thing you don’t understand yourself!
You didn’t “read the manual”. You didn’t go find out why the AI is failing. You just spouted an angry comment and gave up without gaining any understanding.
PS: the “stupid AI” understands all of this. Just ask it to explain it to you: https://chat.openai.com/share/7bc1c1cb-d888-4ccb-904a-79e9ae...