News for hackers. Stuff that matters.

A comment on Top model scores may be skewed by Git history leaks in SWE-bench. Parent comment

Re:Top model scores may be skewed by Git history leaks in SW... by Dylan16807 on Friday September 12, 2025 @05:31PM (#45227003)
"It's probably not X, but we should consider X as we look at this." and "I feel like this might be X but I'm 50:50 on it." are not anywhere near defamation. You have to get a lot closer to certainty before it's an issue.

And listing out "a possibility but you don't want to dig deeper" is often a good contribution to a conversation.

In this case they worded it badly, but the basic idea of the comment isn't awful.

[ Parent | on HN ]
Re:Top model scores may be skewed by Git history leaks in SW... by gchamonlive on Friday September 12, 2025 @06:11PM (#45227333)
That someone in the team might not have done it on purpose, but left it for convenience? How does that benefit the debate? I really fail to see any silver lining in doing such speculative comments without any substance whatsoever to back it up.
[ Parent | on HN ]