News for hackers. Stuff that matters.
Re:ReasoningGym: Reasoning Environments for RL with Verifiab... by olliestanley on Monday June 02, 2025 @03:59PM (#44162419)
Difficult one. GSM8K and MATH evals (both reported in Reasoning Gym paper) are common in smaller model RL papers for a reason, which is that smaller models can get decent scores on them, unlike fresher & harder benchmarks.

Part of the aim of RG is to be used as a difficulty-adjustable & non-repeating eval though so if people think it's a good benchmark, perhaps it will allow this status quo to shift!

There are no comments on this comment yet.