Dear reader do not be alarmed. That rumbling sound you are hearing is simply the frantic movement of goal posts.
Re:Open models by OpenAI
by whynotminot on Wednesday August 06, 2025 @08:32AM
(#44811118)
He’s saying there’s different goalposts at different model sizes. Is that unreasonable?
Please don't post snark like this on HN. If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.
Re:Open models by OpenAI
by lannisterstark on Wednesday August 06, 2025 @11:44AM
(#44813547)
This isn't reddit.
I'm not going to be surprised that a 20B 4/32 MoE model (3.6B parameters activated) is less capable at a particular problem category than a 32B dense model, and its quite possible for both to be SOTA, as state of the art at different scale (both parameter count and speed which scales with active resource needs) is going to have different capabilities. TANSTAAFL.