News for hackers. Stuff that matters.

A comment on LLMs can't self-correct in reasoning tasks, DeepMind study finds. Parent comment

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by spdustin on Tuesday October 10, 2023 @08:43AM (#37831324)
I was pleased to see GPT-4, combined with my custom ChatGPT instructions, had no problem with this: https://chat.openai.com/share/726d5c7b-761f-462e-8a6a-61904a...
[ Parent | on HN ]
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by godelski on Wednesday October 11, 2023 @12:57PM (#37847028)
You should refer to this comment I made[0], as your prompt is spoiling the problem. It is far too specific. Hacking the answer in is not a means of getting correct answers. It won't scale and won't generalize.

[0] https://news.ycombinator.com/item?id=37825566

[ Parent | on HN ]