News for hackers. Stuff that matters.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r... by Majromax on Thursday November 06, 2025 @03:26PM (#45839972)
> If OpenAI or Anthropic could squeeze the same output out of smaller GPUs and servers they'd be doing it for themselves.

First, they do this; that's why they release models at different price points. It's also why GPT-5 tries auto-routing requests to the most cost-effective model.

Second, be careful about considering the incentives of these companies. They all act as if they're in an existential race to deliver 'the' best model; the winner-take-all model justifies their collective trillion dollar-ish valuation. In that race, delivering 97% of the performance at 10% of the cost is a distraction.

Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r... by cubefox on Thursday November 06, 2025 @09:30PM (#45842966)
> > If OpenAI or Anthropic could squeeze the same output out of smaller GPUs and servers they'd be doing it for themselves.

> First, they do this; that's why they release models at different price points.

No, those don't deliver the same output. The cheaper models are worse.

> It's also why GPT-5 tries auto-routing requests to the most cost-effective model.

These are likely the same size, just one uses reasoning and the other doesn't. Not using reasoning is cheaper, but not because the model is smaller.

Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r... by gunalx on Friday November 07, 2025 @04:12AM (#45844771)
But they also squesed a 80% cut in O3 at some point, supposedly purely on inference or infra optimization
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r... by anabis on Monday November 10, 2025 @07:48PM (#45882816)
> delivering 97% of the performance at 10% of the cost is a distraction.

Not if you are running RL on that model, and need to do many roll-outs.