News for hackers. Stuff that matters.
Re:SOTA on swebench-verified: relearning the bitter lesson by ofirpress on Thursday January 09, 2025 @10:20AM (#42646506)
I'm one of the co-authors of SWE-bench. We just created a Javascript (+visual) SWE-bench: https://www.swebench.com/multimodal.html

We're going to release the eval suite for this soon so that people can start making submissions.

There are no comments on this comment yet.