News for hackers. Stuff that matters.

A comment on Claude Sonnet 5. Parent comment

Re:Claude Sonnet 5 by frozeus on Wednesday July 01, 2026 @05:48AM (#48744394)
They have updated it
[ Parent | on HN ]
Re:Claude Sonnet 5 by LUmBULtERA on Wednesday July 01, 2026 @06:38AM (#48744729)
Did Anthropic have Opus 4.8 and Sonnet 5 switched in the Agentic Search chart at first?
[ Parent | on HN ]
Re:Claude Sonnet 5 by fluidcruft on Wednesday July 01, 2026 @07:21AM (#48745014)
No, and the original had everything more expensive. There's a comparison here:

https://www.reddit.com/r/ClaudeAI/comments/1ukgqwr/looks_lik...

The explanation Anthropic gave for the update doesn't address how the x-axis needed to range up to $50 previously and only $10 now. In any case the pass rates are also lower.

Probably the difference between whatever it is people notice when they say models become "nerfed".

[ Parent | on HN ]
Re:Claude Sonnet 5 by LUmBULtERA on Wednesday July 01, 2026 @09:53AM (#48746821)
Huh, super interesting. Thanks!
[ Parent | on HN ]
Re:Claude Sonnet 5 by theptip on Wednesday July 01, 2026 @09:41PM (#48755402)
Ha! So we were not looking at the same chart. That makes more sense.

> Anthropic did post an official explanation, stating the original chart used a "simpler methodology" that "underestimated Sonnet 5's performance." The new chart supposedly uses their "standard methodology."

Oops!

[ Parent | on HN ]