Yeah if you are releasing the competition dataset then it can and will 100% be gamed. What is to stop me from just hardcoding and printing the result without any computation?
Re:The One Billion Row Challenge
by refulgentis on Thursday January 04, 2024 @10:57AM
(#38868516)
Your code is submitted (per parent comment)
Sure, but who is manually checking every entry?
Re:The One Billion Row Challenge
by 946789987649 on Thursday January 04, 2024 @12:13PM
(#38869550)
You don't need to check every entry, just the top few.
That might help against algorithms that are (accidentally, or on purpose) tuned to the specific dataset.