News for hackers. Stuff that matters.
Re:Top model scores may be skewed by Git history leaks in SW... by sebzim4500 on Thursday September 11, 2025 @04:08PM (#45215610)
The verified refers to the fact that the benchmark problems were verified by human experts to be reasonable.

It says nothing about data contamination, which would depend on the model and would not be the fault of the benchmark.

There are no comments on this comment yet.