Re:LLMs can't self-correct in reasoning tasks, DeepMind stud...
by kahnclusions on Monday October 09, 2023 @05:02PM
(#37825447)
That doesn’t mean it does any “reasoning”. It generates a response text that looks like a response to the input text. The whole point is that it generates responses that aren’t in the training set. But the fact that the response is actually a correct one is just coincidence.
[ Parent
| on HN ]
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud...
by a_wild_dandan on Monday October 09, 2023 @05:40PM
(#37825857)
So when a model succeeds on a reasoning task it's not positive evidence, but when it fails it's negative evidence? The good ol' confirmation bias feedback loop!