News for hackers. Stuff that matters.

A comment on When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation. Parent comment

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by Certhas on Tuesday August 04, 2026 @02:02PM (#49172494)
In research we are still seeing massive jumps. Subjects that LLMs were completely useless for half a year ago are now definitely in scope.

And there are benchmarks that cleanly separate the SOTA models:

https://epoch.ai/MirrorCode

Saturation of benchmarks is a property of benchmarks just as much as of the models.

[ Parent | on HN ]

There are no comments on this comment yet.