LLMs can't self-correct in reasoning tasks, DeepMind study finds

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by auggierose on Tuesday October 10, 2023 @04:11AM (#37829630)

I am building something complex that depends on reasoning. But I would not expect LLMs to be able to reason properly, I mean, most humans cannot. Instead, I am using the LLM for its intuition (which is a kind of understanding), and handle the reasoning with proper logic. Any other way of doing this is quite foolish, and just shows that most people have no clue about logic. In a way, people are not exposing the limits of LLMs, they are exposing their own limits of thinking too simple.

[ Parent | on HN ]

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by intended on Tuesday October 10, 2023 @10:33AM (#37832637)

Then I eagerly hope for your success.

Im curious - How are you evaluating outputs?

[ Parent | on HN ]

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by auggierose on Tuesday October 10, 2023 @12:06PM (#37833959)

Thank you.

There are basically two ways: a) You let the user check the output. If the user says, yay, this meets my needs, great. b) There might be an objective way to check if the output meets a certain objective. For example, you can let the LLM generate the output together with a proof that the output is correct. You can then check the proof separately.

And of course, you can mix and nest a) and b).

[ Parent | on HN ]

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by intended on Tuesday October 10, 2023 @02:54PM (#37835976)

I meant on the lines of the software stack you were using. Langsmith and Promptflow are what I was considering, however there is precious little discussion yet. There are some great videos for prompt flow though, which is at least one saving grace.

Sadly the Human Review option is simply never going to scale - Human review becomes the bottleneck. LLM output is non-deterministic at even temp 0, so scalable solutions are always critical.

[ Parent | on HN ]

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by auggierose on Tuesday October 10, 2023 @06:25PM (#37838509)

I am just using the OpenAI API directly, and build my own libraries on top of that.

Human review can work great depending on how you embed it into your workflow, and how qualified the user is to make a judgement. But yes, the goal is to reduce human review to the specification level.

[ Parent | on HN ]