News for hackers. Stuff that matters.
Re:Claude Code Daily Benchmarks for Degradation Tracking by eterm on Thursday January 29, 2026 @11:20AM (#46812297)
4. The graph starts January 8.

Why January 8? Was that an outlier high point?

IIRC, Opus 4.5 was released late november.

Re:Claude Code Daily Benchmarks for Degradation Tracking by littlestymaar on Thursday January 29, 2026 @11:23AM (#46812353)
Or maybe, juste maybe, that's when they started testing…
Re:Claude Code Daily Benchmarks for Degradation Tracking by eterm on Thursday January 29, 2026 @11:28AM (#46812414)
Wayback machine has nothing for this site before today, and article is "last updated Jan 29".

A benchmark like this ought to start fresh from when it is published.

I don't entirely doubt the degradation, but the choice of where they went back to feels a bit cherry-picked to demonstrate the value of the benchmark.

Re:Claude Code Daily Benchmarks for Degradation Tracking by littlestymaar on Thursday January 29, 2026 @11:30AM (#46812454)
Which makes sense, you gotta wait until you get enough data before you can communicate on the said data…

If anything it's coherent with the fact that they very likely didn't have data earlier than January the 8th.

Re:Claude Code Daily Benchmarks for Degradation Tracking by pertymcpert on Thursday January 29, 2026 @12:46PM (#46813632)
People were away for the holidays. What do you want them to do?
Re:Claude Code Daily Benchmarks for Degradation Tracking by F7F7F7 on Thursday January 29, 2026 @06:14PM (#46818233)
Right after the Holiday double token promotion users felt (perceived) a huge regression in capabilities. I bet that triggered the idea.