Re:When AI Benchmarks Plateau: A Systematic Study of Benchma...
by gertlabs on Wednesday August 05, 2026 @11:35PM
(#49192132)
SlimeBallBench? Looks cool, love the implementation! You would most likely need a LOT of environments like these if your goal was selling them to labs
[ Parent
| on HN ]
Re:When AI Benchmarks Plateau: A Systematic Study of Benchma...
by erikwiffin on Thursday August 06, 2026 @01:30PM
(#49199737)
SlimeBallBench was not me, but it is cool! and at least partially what inspired me to build my own.
Mine is less fun, but hopefully more useful https://erikwiffin.github.io/memory-reasoning-eval/
Selling to labs is more than I'm looking for. I'm aiming for a couple hundred dollars so I don't have to finance a Fable vs Sol run out of my own pocket. It would be cool to have my benchmark be one of the ones referenced in a model card!