News for hackers. Stuff that matters.
Re:Qwen4-Max by spider-mario on Monday November 16, 2026 @10:39AM (#50518760)
> Usage? If most people predominantly default to Medium thinking level for usage then it would make sense to benchmark that first.

Sure, that’s not in question. The discussion here is not about what to measure (we agree that benchmarking only max is suboptimal) but how to compare if you have a fixed set of measurements, outside of your control, which includes only “max” for model A but a wider range from model B.

The person I was responding to was claiming that the sensible thing to do, then, was to truncate the model B measurements to “only max” as well.

There are no comments on this comment yet.