Re:Many SWE-bench-Passing PRs would not be merged
by hrmtst93837 on Thursday March 12, 2026 @03:47AM
(#47347692)
Chasing test-passing code is basically an invitation for models to learn all sorts of ugly workarounds and accidental patterns that humans would never tolerate for long. If you optimize only for "does it make CI go green" you'll eventually get code that's impossible to reason about and a codebase that accumulates landmines but the metrics sure look pretty for a while.
[ Parent
| on HN ]
There are no comments on this comment yet.