News for hackers. Stuff that matters.
Re:AI benchmarks are a bad joke – and LLM makers are the one... by jimmySixDOF on Sunday November 09, 2025 @06:05AM (#45864700)
Terminal Bench 2.0 just dropped and a big success factor they stress is the hand crafted phd level rollout tests they picked aprox 80 out of 120 with the incentive that anyone who contributed 3 would get listed as a paper author this resulted in high quality participation equivalent to foundation labs proprietary agentic RL data but it's FOSS.

There are no comments on this comment yet.