News for hackers. Stuff that matters.
Re:Claude Code Daily Benchmarks for Degradation Tracking by jabedude on Thursday January 29, 2026 @01:08PM (#46813971)
But that's removing a component that's critical for the test. We as users/benchmark consumers care that the service as provided by Anthropic/OpenAI/Google is consistent over time given the same model/prompt/context
Re:Claude Code Daily Benchmarks for Degradation Tracking by plagiarist on Thursday January 29, 2026 @03:21PM (#46816020)
Might as well have the free tokens, then, especially if it is an open benchmark they are already aware of. If they want to game it they cannot be stopped from doing so when it's on their infra.