Insane! Even Haiku doesn't make such mistakes.
I am not sure it's a mistake, this might be their new "adaptive reasoning" + hidden reasoning trace, so we can't verify.
Oh, and also, the "none" and "medium" variants performed the same (??)
Claude is known for its shitty metering.
Medium reasoning has regressed since 4.6. While None and Max have improved since 4.6 in our benchmark.
We suspect that this is how Claude tries to cope with the increased user base.
Note, Google and OpenAI probably did something similar long ago.
In my tests, asking for "none" reasoning resulted in higher costs than asking for "medium" reasoning...
Also, "medium" reasoning only had 1/10 of the reasoning tokens 4.6 used to have.