Re:MaxxBench – "Nice DeepSWE score. But is it true?"
by girvo on Sunday November 08, 2026 @12:19AM
(#50410614)
> Very much disagree, to me it clearly shows the gap between Open Source and the frontier.
Yes, this is true.
> You can not do real code work with open source models right now.
This is false, or you're using "real" as a loophole. You can absolutely do real coding work with open source models, right now, right this second.
I'm doing so today using Qwen 3.8 Flash Next running locally, and GLM 5.3 Flash hosted.
We could do real work with Opus 4.5, 4.6. These models (for coding) are more than good enough to do work that Opus 4.6 could do, and in some ways are superior.
Re:MaxxBench – "Nice DeepSWE score. But is it true?"
by lisplist on Sunday November 08, 2026 @12:24AM
(#50410637)
Even if frontier models are much stronger than open weights, strong disagree on this. You very much can get real work done using open weights models.
Re:MaxxBench – "Nice DeepSWE score. But is it true?"
by gabucino on Sunday November 08, 2026 @02:25AM
(#50411133)
>You can not do real code work with open source models right now
uh-huh yeah, perhaps you can't
Re:MaxxBench – "Nice DeepSWE score. But is it true?"
by verdverm on Sunday November 08, 2026 @10:20AM
(#50414028)
> You can not do real code work with open source models right now.
I only use open weights and get plenty of real work done. Turns out most real tasks are not that hard, rather they are tedious.
Especially since this benchmark is still mostly DeepSWE, and the only reason the open source models are doing decent is because much of the information hasn't changed. The open source models have been benchmaxxed to death.