News for hackers. Stuff that matters.
Re:PhD Knowledge Not Required: A Reasoning Challenge for Lar... by enum on Monday February 10, 2025 @08:44AM (#43000194)
It’s not that the benchmark is hard, but that the reasoning models do so much better than the non-reasoning models. That suggests it is testing a capability that reasoning models have that non-reasoning models do not.

Getting to 100% may require tokenization innovation, sure.

There are no comments on this comment yet.