News for hackers. Stuff that matters.
Re:Claude Code Daily Benchmarks for Degradation Tracking by emp17344 on Thursday January 29, 2026 @12:06PM (#46812999)
Any chance you’re just learning more about what the model is and is not useful for?
Re:Claude Code Daily Benchmarks for Degradation Tracking by jerf on Thursday January 29, 2026 @12:23PM (#46813262)
I dunno about everyone else but when I learn more about what a model is and is not useful for, my subjective experience improves, not degrades.
Re:Claude Code Daily Benchmarks for Degradation Tracking by emp17344 on Thursday January 29, 2026 @12:34PM (#46813436)
Not when the product is marketed as a panacea.
Re:Claude Code Daily Benchmarks for Degradation Tracking by data-ottawa on Thursday January 29, 2026 @01:36PM (#46814420)
There are some days where it acts staggeringly bad, beyond baselines.

But it’s impossible to actually determine if it’s model variance, polluted context (if I scold it, is it now closer in latent space to a bad worker, and performs worse?), system prompt and tool changes, fine tunes and AB tests, variances in top P selection…

There’s too many variables and no hard evidence shared by Anthropic.

Re:Claude Code Daily Benchmarks for Degradation Tracking by acuozzo on Thursday January 29, 2026 @01:47PM (#46814593)
No because switching to the API with the same prompt immediately fixes it.

There's little incentive to throttle the API. It's $/token.