News for hackers. Stuff that matters.

A comment on Why SWE-bench Verified no longer measures frontier coding capabilities. Parent comment

Re:Why SWE-bench Verified no longer measures frontier coding... by jvuygbbkuurx on Sunday April 26, 2026 @11:36AM (#47911151)
I think the solution is a bunch of private trusted benchmarks, and averaging their announced results.
[ Parent | on HN ]
Re:Why SWE-bench Verified no longer measures frontier coding... by zephen on Sunday April 26, 2026 @02:33PM (#47912634)
> averaging their announced results.

Obligatory XKCD: https://xkcd.com/937/

[ Parent | on HN ]