News for hackers. Stuff that matters.

A comment on LIMO: Less Is More for Reasoning. Parent comment

Re:LIMO: Less Is More for Reasoning by GTP on Monday February 10, 2025 @08:38AM (#43000124)
>The last few years of LLM progress have shown we can predict human "reasoning" responses to inputs by modeling likely human responses as if LLM generated. Put another way, most responses are not particularly reasoned, but chain of tokgen*.

Sorry, but I don't get the point of your comment as a whole, and of this part in particular. Yes, most human day-to-day conversations are quite predictable, but some people are still capable of generating original thoughts from time to time. And still, how is it related to the comment you are replying to?

[ Parent | on HN ]
Re:LIMO: Less Is More for Reasoning by Terretta on Tuesday February 11, 2025 @10:52AM (#43014273)
> how is it related to the comment you are replying to

Sorry, with quoting, and stating differently:

a whole lot of intelligence was used to craft a maximally informative and distilled set of fine-tuning data

A whole lot of intelligence is used to craft maximally informative and distilled set learning into textbooks, to fine-tune reasoning outcomes from our LLM-ish brains.

Or, put the other way around, what works for us can often inform what works for LLMs.

[ Parent | on HN ]