News for hackers. Stuff that matters.
Re:The One Billion Row Challenge by rkangel on Thursday January 04, 2024 @08:01AM (#38866474)
Have you considered having two datasets? The "development" dataset which is public, and the "competition" dataset which is private?

That might help against algorithms that are (accidentally, or on purpose) tuned to the specific dataset.

Re:The One Billion Row Challenge by paxys on Thursday January 04, 2024 @09:49AM (#38867648)
Yeah if you are releasing the competition dataset then it can and will 100% be gamed. What is to stop me from just hardcoding and printing the result without any computation?
Re:The One Billion Row Challenge by refulgentis on Thursday January 04, 2024 @10:57AM (#38868516)
Your code is submitted (per parent comment)
Re:The One Billion Row Challenge by paxys on Thursday January 04, 2024 @11:45AM (#38869177)
Sure, but who is manually checking every entry?
Re:The One Billion Row Challenge by 946789987649 on Thursday January 04, 2024 @12:13PM (#38869550)
You don't need to check every entry, just the top few.