News for hackers. Stuff that matters.
Re:SWE-Bench Pro by flare_blitz on Monday September 22, 2025 @09:21PM (#45341762)
And your basis for saying this is...?
Re:SWE-Bench Pro by CuriouslyC on Monday September 22, 2025 @09:36PM (#45341855)
I've done it? I have a benchmark called scramblebench that will do rewriting to evaluate model performance degradation with symbol replacement and layers of indirection.