News for hackers. Stuff that matters.
Re:AI benchmarks are a bad joke – and LLM makers are the one... by liqilin1567 on Sunday November 09, 2025 @12:18AM (#45863119)
> Brittle performance – A model might do well on short, primary school-style maths questions, but if you change the numbers or wording slightly, it suddenly fails. This shows it may be memorising patterns rather than truly understanding the problem

This finding really shocked me

There are no comments on this comment yet.