News for hackers. Stuff that matters.
Re:Opus 4.7 to 4.6 Inflation is ~45% by QuantumGood on Saturday April 18, 2026 @05:51PM (#47819825)
Some have defined "fair" as tests of the same model at different times, as the behavior and token usage of a model changes despite the version number remaining the same. So testing model numbers at different times matters, unfortunately, and that means recent tests might not be what you would want to compare to future tests.

There are no comments on this comment yet.