News for hackers. Stuff that matters.
Re:Open models by OpenAI by Imustaskforhelp on Tuesday August 05, 2025 @01:56PM (#44801693)
Okay I will be honest, I was so hyped up about This model but then I went to localllama and saw it that the:

120 B model is worse at coding compared to qwen 3 coder and glm45 air and even grok 3... (https://www.reddit.com/r/LocalLLaMA/comments/1mig58x/gptoss1...)

Re:Open models by OpenAI by pxc on Tuesday August 05, 2025 @03:31PM (#44803094)
Qwen3 Coder is 4x its size! Grok 3 is over 22x its size!

What does the resource usage look like for GLM 4.5 Air? Is that benchmark in FP16? GPT-OSS-120B will be using between 1/4 and 1/2 the VRAM that GLM-4 5 Air does, right?

It seems like a good showing to me, even though Qwen3 Coder and GLM 4.5 Air might be preferable for some use cases.

Re:Open models by OpenAI by ascorbic on Tuesday August 05, 2025 @02:26PM (#44802147)
That's SVGBench, which is a useful benchmark but isn't much of a test of general coding
Re:Open models by OpenAI by Imustaskforhelp on Tuesday August 05, 2025 @03:02PM (#44802679)
Hm alright, I will see how this model actually plays around instead of forming quick opinions..

Thanks.

Re:Open models by OpenAI by logicchains on Tuesday August 05, 2025 @02:10PM (#44801922)
It's only got around 5 billion active parameters; it'd be a miracle if it was competitive at coding with SOTA models that have significantly more.
Re:Open models by OpenAI by jph00 on Tuesday August 05, 2025 @03:09PM (#44802787)
On this bench it underperforms vs glm-4.5-air, which is an MoE with fewer total params but more active params.