Re:Understanding Reasoning LLMs
by lysecret on Friday February 07, 2025 @09:21AM
(#42972826)
I think the next big problem we will run into with these line of reasoning models is "over-thinking" you can already start to see it. Thinking harder is not the universal pareto improvement everyone seems to think it is. (I understand the irony of using think 4 times here haha)
[ Parent
| on HN ]
Reasoning is about serially applying a set of premises over and over to come to conclusions. But some of our biggest problems require thinking outside the box, sometimes way outside it, and a few times ingeniously making up a whole new set of premises, seemingly ex nihilo (or via divine inspiration). We are still in very early stages of making thinking machines.
This is a natural next area of research. Nailing "adaptive compute" implies figuring out which problems to use more compute on, but I imagine this will get better as the RL does.
Re:Understanding Reasoning LLMs
by resource_waste on Friday February 07, 2025 @10:28AM
(#42973750)
100%
I do philosophy and it will take an exaggeration I give it, and call it fact.
The non reasoning models will call me out. lol