Re:LLMs cannot find reasoning errors, but can correct them
by kromem on Monday November 20, 2023 @06:40PM
(#38356627)
Exactly.
Re:LLMs cannot find reasoning errors, but can correct them
by 4death4 on Tuesday November 21, 2023 @12:26AM
(#38359722)
Isn’t the entire promise of LLMs that they’re supposed to generalize, though?
Re:LLMs cannot find reasoning errors, but can correct them
by jibal on Tuesday November 21, 2023 @03:24PM
(#38369531)
No. Or if so that's a false promise, because LLMs are incapable of generalizing.
Re:LLMs cannot find reasoning errors, but can correct them
by kromem on Tuesday November 21, 2023 @11:40PM
(#38374792)
How do you mean?
Re:LLMs cannot find reasoning errors, but can correct them
by galaxyLogic on Monday November 20, 2023 @10:45PM
(#38358867)
Good point. That is why LLMs are incapable of humility. And that may be their downfall.
That's the point: The internet IS full of pedants correcting others' statements. (Hopefully those pedants are right enough of the time for this to be helpful training data, heh.)
I think GP (kromem) was pointing out that those corrections are more likely to be phrased as "You're wrong, here's why..." than as "I'm sorry, I was mistaken" because humans are full of sass for other humans and not as full of first-person admitted errors.