News for hackers. Stuff that matters.
Re:Qwen3.5 122B and 35B models offer Sonnet 4.5 performance ... by Aurornis on Saturday February 28, 2026 @07:18PM (#47202135)
The models outperform on the benchmarks relative to general tasks.

The benchmarks are public. They're guaranteed to be in the training sets by now. So the benchmarks are no longer an indicator of general performance because the specific tasks have been seen before.

> And could quantization maybe explain the worse than expected results?

You can use the models through various providers on OpenRouter cheaply without quantization.

There are no comments on this comment yet.