Re:Claude Code Daily Benchmarks for Degradation Tracking
by emp17344 on Thursday January 29, 2026 @12:06PM
(#46812999)
Any chance you’re just learning more about what the model is and is not useful for?
[ Parent
| on HN ]
Re:Claude Code Daily Benchmarks for Degradation Tracking
by jerf on Thursday January 29, 2026 @12:23PM
(#46813262)
I dunno about everyone else but when I learn more about what a model is and is not useful for, my subjective experience improves, not degrades.
Re:Claude Code Daily Benchmarks for Degradation Tracking
by emp17344 on Thursday January 29, 2026 @12:34PM
(#46813436)
Not when the product is marketed as a panacea.
Re:Claude Code Daily Benchmarks for Degradation Tracking
by data-ottawa on Thursday January 29, 2026 @01:36PM
(#46814420)
There are some days where it acts staggeringly bad, beyond baselines.
But it’s impossible to actually determine if it’s model variance, polluted context (if I scold it, is it now closer in latent space to a bad worker, and performs worse?), system prompt and tool changes, fine tunes and AB tests, variances in top P selection…
There’s too many variables and no hard evidence shared by Anthropic.