Re:Notes from the Mistral AI Now Summit in Paris
by pavpanchekha on Friday May 29, 2026 @02:54PM
(#48327680)
OpenAI used to make Codex-specific models, but they stopped. What I've gathered from interviews and similar is that training two models isn't worth the (small) lift from having a coding-specific model. You're pre-training on everything anyway, and coding RL is reasonably useful for general-purpose models too.
[ Parent
| on HN ]
Re:Notes from the Mistral AI Now Summit in Paris
by greyskull on Friday May 29, 2026 @03:13PM
(#48327914)
Interesting. I'd have guessed there would be meaningful opex benefits to serving smaller models.
Re:Notes from the Mistral AI Now Summit in Paris
by mediaman on Friday May 29, 2026 @07:05PM
(#48330504)
What I've heard is that much of the model "intelligence" is a commingled bucket: although you can specialize specific knowledge somewhat, it's hard to specialize advanced reasoning to specific domains because so much of reasoning is a generalized capability that is not unique to, say, coding.
It turns out coding has to do with a lot of the same reasoning needed in math or in legal analysis, even if the grammatical expression is different.
This is less true of lower intelligence tasks. Classification requires a lot less reasoning capacity and so can be much smaller and more specialized.