News for hackers. Stuff that matters.
Re:Why SWE-bench Verified no longer measures frontier coding... by fulafel on Monday April 27, 2026 @01:00AM (#47917856)
there's more details under the Too narrow and too wide tests heading.

It would be interesting to see a deeper investigation, into how the models are dealing with this and whether the successful ones seemed to be trained on the benchmark.

There are no comments on this comment yet.