News for hackers. Stuff that matters.

A comment on Claude Sonnet 4.5. Parent comment

Re:Claude Sonnet 4.5 by squigz on Tuesday September 30, 2025 @01:59AM (#45422390)
This seems like a non-issue, unless I'm misunderstanding. If failures can be used to help game benchmarks, companies are doing so. They don't need us to avoid compiling such information, which would be helpful to actual users.
[ Parent | on HN ]
Re:Claude Sonnet 4.5 by dns_snek on Tuesday September 30, 2025 @02:16AM (#45422472)
People might want to use the same test scenario in the future to see how much the models have improved. We can't do that if the example gets scraped into the training data set.
[ Parent | on HN ]