Re:General Reasoning: Free, open resource for building large...
by rosstaylor90 on Sunday February 23, 2025 @01:59PM
(#43152022)
Many math questions are easy to verify, and it's a classic benchmark for reasoning -> so it's a good hill to climb.
I agree with your meta-point that better benchmarks testing more types of task would be good!
It makes sense for ASI research I suppose, but why are we trying to teach small models to do stuff almost no humans even try to do?
What happens if you train them with RAG context in the prompts and calculator calls in the CoT?