News for hackers. Stuff that matters.
Re:Qwen4-Max by the_duke on Sunday November 15, 2026 @10:43PM (#50513760)
To be fair, a lot of the popular benchmarks have become pretty meaningless.

Models often get great scores despite being a lot worse than the frontier in practice.

Re:Qwen4-Max by anon373839 on Monday November 16, 2026 @12:09AM (#50514288)
This is true, but if you look at the change in weighting to specific benchmarks from one version of AA to the next, it looks really arbitrary.
Re:Qwen4-Max by stymaar on Monday November 16, 2026 @02:35AM (#50515043)
A benchmark is only relevant if it was released after the model it evaluates.