News for hackers. Stuff that matters.
Re:How We Broke Top AI Agent Benchmarks: And What Comes Next by miki123211 on Sunday April 12, 2026 @09:56AM (#47739709)
> AI companies want adcopy, not legitimate benchmarks.

Labs need accurate benchmark measurements, at least internally, to figure out what model improvements actually matter.

Having models exploit benchmarks serves no purpose. If they wanted to make their models look better than they are, they could just make the data up.

There are no comments on this comment yet.