News for hackers. Stuff that matters.
Re:How the AI Bubble Bursts by jerojero on Monday March 30, 2026 @09:49AM (#47574327)
Companies doing foundational models need to cover the cost of training which is much more expensive than training something like kimi.
Re:How the AI Bubble Bursts by wongarsu on Monday March 30, 2026 @09:53AM (#47574373)
Yes. I would not consider Kimi a particularly good model relative to its size, and making a SotA model is a lot more expensive. But training costs are explicitly excluded when talking about the cost to serve tokens
Re:How the AI Bubble Bursts by gruez on Monday March 30, 2026 @09:52AM (#47574351)
>Companies doing foundational models need to cover the cost of training [...]

But that's moving the goalposts? The original claim was on inference itself, not the whole company.

> The cost to serve tokens is absolutely profitable today and that’s been true for at least a year.

Re:How the AI Bubble Bursts by lbreakjai on Monday March 30, 2026 @10:45AM (#47575037)
But that's the same as thinking "This bar is selling a cocktail for $15. I could make it at home for 30 cents. They're making $14.7 dollars of profit per cocktail, the owner must be a millionaire now!"

Everything is profitable if you ignore the costs.