News for hackers. Stuff that matters.

A comment on Top model scores may be skewed by Git history leaks in SWE-bench. Parent comment

Re:Top model scores may be skewed by Git history leaks in SW... by cjsaltlake on Thursday September 11, 2025 @05:52PM (#45216493)
I'm also on the SWE-bench team. This was simply a classic bug. We had code before that we believed was sufficient to hide / remove future GitHub history and it turns out it was not. We've patched it.
[ Parent | on HN ]
Re:Top model scores may be skewed by Git history leaks in SW... by numbsafari on Friday September 12, 2025 @06:52AM (#45220803)
Your classic bug is being used as justification to destroy the careers and lives of tens of thousands of people. Read the room.
[ Parent | on HN ]