Re:SWE-Bench Pro
by CuriouslyC on Monday September 22, 2025 @09:36PM
(#45341855)
I've done it? I have a benchmark called scramblebench that will do rewriting to evaluate model performance degradation with symbol replacement and layers of indirection.
[ Parent
| on HN ]
There are no comments on this comment yet.