Re:Open models by OpenAI
by thegeomaster on Tuesday August 05, 2025 @04:13PM
(#44803654)
[delayed]
Qwen3 has multiple variants ranging from larger (230B) than these models to significantly smaller (0.6b), with a huge number of options in between. For each of those models they also release quantized versions (your "fewer bits per parameter).
I'm still withholding judgement until I see benchmarks, but every point you tried to make regarding model size and parameter size is wrong. Qwen has more variety on every level, and performs extremely well. That's before getting into the MoE variants of the models.
The benchmarks of the OpenAI models are comparable to the largest variants of other open models. The smaller variants of other open models are much worse.
I would wait for neutral benchmarks before making any conclusions.
With all due respect, you need to actually test out Qwen3 2507 or GLM 4.5 before making these sorts of claims. Both of them are comparable to OpenAI's largest models and even bench favorably to Deepseek and Opus: https://cdn-uploads.huggingface.co/production/uploads/62430a...
It's cool to see OpenAI throw their hat in the ring, but you're smoking straight hopium if you think there's "no reason to run other open source models now" in earnest. If OpenAI never released these models, the state-of-the-art would not look significantly different for local LLMs. This is almost a nothingburger if not for the simple novelty of OpenAI releasing an Open AI for once in their life.
> Both of them are comparable to OpenAI's largest models and even bench favorably to Deepseek and Opus
So are/do the new OpenAI models, except they're much smaller.
Re:Open models by OpenAI
by UrineSqueegee on Tuesday August 05, 2025 @04:12PM
(#44803633)
I'd really wait for additional neutral benchmarks, I asked the 20b model on low reasoning effort which number is larger 9.9 or 9.11 and it got it wrong.
Qwen-0.6b gets it right.
According to the early benchmarks, it's looking like you're just flat-out wrong: https://blog.brokk.ai/a-first-look-at-gpt-oss-120bs-coding-a...
Looks OpenAI's first mover advantages are still alive and well
Re:Open models by OpenAI
by sourcecodeplz on Tuesday August 05, 2025 @03:23PM
(#44802979)
From my initial web developer test on https://www.gpt-oss.com/ the 120b is kind of meh. Even qwen3-coder 30b-a3b is better. have to test more.
There's basically no reason to run other open source models now that these are available, at least for non-multimodal tasks.