News for hackers. Stuff that matters.
Re:SWE-Bench Pro by CuriouslyC on Monday September 22, 2025 @09:36PM (#45341855)
I've done it? I have a benchmark called scramblebench that will do rewriting to evaluate model performance degradation with symbol replacement and layers of indirection.

There are no comments on this comment yet.