News for hackers. Stuff that matters.
Re:Qwen4-Max by Eisenstein on Monday November 16, 2026 @05:22AM (#50516010)
A fourth option is realizing that benchmarks exist because it is impossible to measure the value we want to measure, so we need a stand-in. The stand-in will sometimes correlate with performance but often just act as a way to compare. When used to compare, it is most important that the benchmark be fair and trustworthy.

There are no comments on this comment yet.