News for hackers. Stuff that matters.
Re:ARC-AGI Leaderboard by 3form on Saturday July 25, 2026 @03:33AM (#49045346)
How do they handle these assurances? Personally I have zero trust in the AI companies not trying to use this data to get ahead in the game, and short of sharing the weights and harness so that the benchmarkers can run the models themselves, I don't see a satisfactory solution with this mindset.
Re:ARC-AGI Leaderboard by villish on Saturday July 25, 2026 @03:49AM (#49045442)
OpenAI's Zero Data Retention claim held up in court. They were unable to produce prompts and outputs because they were never retained.

I believe that is only available through Enterprise API for both Anthropic and OpenAI.

Re:ARC-AGI Leaderboard by Barbing on Saturday July 25, 2026 @04:25AM (#49045668)
Is there a distinction we can independently assess between never retained and deleted or hidden?

Asking especially given CEO’s track record https://news.ycombinator.com/item?id=47659135