News for hackers. Stuff that matters.
Re:Understanding Reasoning LLMs by lysecret on Friday February 07, 2025 @09:21AM (#42972826)
I think the next big problem we will run into with these line of reasoning models is "over-thinking" you can already start to see it. Thinking harder is not the universal pareto improvement everyone seems to think it is. (I understand the irony of using think 4 times here haha)
Re:Understanding Reasoning LLMs by seydor on Friday February 07, 2025 @10:07AM (#42973456)
Reasoning is about serially applying a set of premises over and over to come to conclusions. But some of our biggest problems require thinking outside the box, sometimes way outside it, and a few times ingeniously making up a whole new set of premises, seemingly ex nihilo (or via divine inspiration). We are still in very early stages of making thinking machines.
Re:Understanding Reasoning LLMs by tpswa on Friday February 07, 2025 @10:10AM (#42973495)
This is a natural next area of research. Nailing "adaptive compute" implies figuring out which problems to use more compute on, but I imagine this will get better as the RL does.
Re:Understanding Reasoning LLMs by resource_waste on Friday February 07, 2025 @10:28AM (#42973750)
100%

I do philosophy and it will take an exaggeration I give it, and call it fact.

The non reasoning models will call me out. lol