Orca 2: Teaching Small Language Models How to Reason

Re:Orca 2: Teaching Small Language Models How to Reason by sharemywin on Tuesday November 21, 2023 @03:33PM (#38369657)

I asked GPT 4 and it had some counter points:

Reasoning blends learned skills and natural cognition. It integrates new information, not just past memories. Reasoning is adaptable, not rigidly algorithmic. Emotions and context also shape reasoning.

which seemed to make sense.

[ Parent | on HN ]

Re:Orca 2: Teaching Small Language Models How to Reason by avion23 on Tuesday November 21, 2023 @04:40PM (#38370646)

I hope this will be found in history books and some students will point the irony that people are relying on gpt4's arguments about reasoning in a thread where it's proclaimed that said model can't reason

[ Parent | on HN ]

Re:Orca 2: Teaching Small Language Models How to Reason by nuancebydefault on Wednesday November 22, 2023 @04:34PM (#38385463)

In fact it is not absurd or weird. The model does not need to be capable of x/reasoning to produce knowledge about x/reasoning. A book with a chapter on x/reasoning doesn't reason either.

[ Parent | on HN ]