Re:Why SWE-bench Verified no longer measures frontier coding...
by fulafel on Monday April 27, 2026 @01:00AM
(#47917856)
there's more details under the Too narrow and too wide tests heading.
It would be interesting to see a deeper investigation, into how the models are dealing with this and whether the successful ones seemed to be trained on the benchmark.
It would be interesting to see a deeper investigation, into how the models are dealing with this and whether the successful ones seemed to be trained on the benchmark.