News for hackers. Stuff that matters.
Re:Notes from the Mistral AI Now Summit in Paris by pavpanchekha on Friday May 29, 2026 @02:54PM (#48327680)
OpenAI used to make Codex-specific models, but they stopped. What I've gathered from interviews and similar is that training two models isn't worth the (small) lift from having a coding-specific model. You're pre-training on everything anyway, and coding RL is reasonably useful for general-purpose models too.
Re:Notes from the Mistral AI Now Summit in Paris by greyskull on Friday May 29, 2026 @03:13PM (#48327914)
Interesting. I'd have guessed there would be meaningful opex benefits to serving smaller models.
Re:Notes from the Mistral AI Now Summit in Paris by mediaman on Friday May 29, 2026 @07:05PM (#48330504)
What I've heard is that much of the model "intelligence" is a commingled bucket: although you can specialize specific knowledge somewhat, it's hard to specialize advanced reasoning to specific domains because so much of reasoning is a generalized capability that is not unique to, say, coding.

It turns out coding has to do with a lot of the same reasoning needed in math or in legal analysis, even if the grammatical expression is different.

This is less true of lower intelligence tasks. Classification requires a lot less reasoning capacity and so can be much smaller and more specialized.