News for hackers. Stuff that matters.

A comment on Why Sam Altman Won't Be on the Hook for OpenAI's Spending Spree. Parent comment

Re:Why Sam Altman Won't Be on the Hook for OpenAI's Spending... by diamond559 on Saturday November 08, 2025 @11:57AM (#45858122)
haha good one, so why haven't they done this yet? What are they waiting for? Let's see these super advanced "experts" with "specialized models"!!
[ Parent | on HN ]
Re:Why Sam Altman Won't Be on the Hook for OpenAI's Spending... by locknitpicker on Saturday November 08, 2025 @01:21PM (#45858735)
> haha good one, so why haven't they done this yet? What are they waiting for? Let's see these super advanced "experts" with "specialized models"!!

I understand it's very easy to post ignorant messages in internet forums, but the answer to your question is yes, "they have done it" and it does result in cheaper training costs. See models such as DeepSeek-MoE or Mixtral.

https://github.com/deepseek-ai/DeepSeek-MoE

https://mistral.ai/news/mixtral-of-experts

[ Parent | on HN ]