News for hackers. Stuff that matters.
Re:Orca: Progressive Learning from Complex Explanation Trace... by regularfry on Tuesday June 13, 2023 @09:32AM (#36309982)
What reason do we have to think that the "explain like I'm five" output actually represents the reasoning process of the upstream LLM, and not something completely retconned? It often would be in humans, after all.
Re:Orca: Progressive Learning from Complex Explanation Trace... by sp332 on Tuesday June 13, 2023 @10:25AM (#36310665)
It could be retconned, but it at least gives the model the chance to use the space to work out a solution in smaller, easier parts.

If you ask for an answer first and then ask for an explanation after, you will most likely get self-justifying BS for an answer. You have to ask for the explanation first.

Re:Orca: Progressive Learning from Complex Explanation Trace... by regularfry on Tuesday June 13, 2023 @11:11AM (#36311413)
Yeah, I can easily buy that it makes it easier to learn a process. Just maybe not the one that the upstream LLM actually used.
Re:Orca: Progressive Learning from Complex Explanation Trace... by rst on Tuesday June 13, 2023 @12:12PM (#36312373)
All the LLM is doing is generating text. Forcing it to describe a step-by-step reasoning process is the only way to get it to work through one. And the whole point of using this as a prompting strategy is that it often gets you something different and better than what you might call the "first guess" it gives you if you don't ask for intermediate results.