News for hackers. Stuff that matters.
Re:Kimi K3 is now live by grommz on Thursday July 16, 2026 @02:05PM (#48938013)
Imagine you're a mid sized company and you can host this model locally. Suddenly there are zero reasons to pay a single red cent to the bloodsucking American AI cartel.
Re:Kimi K3 is now live by cavemandaveman on Thursday July 16, 2026 @02:23PM (#48938237)
Can you host the model for a lower cost per token than you'd pay Anthropic or OpenAI for a similar level of intelligence? I doubt you're beating their efficiencies of scale.
Re:Kimi K3 is now live by zbendefy on Thursday July 16, 2026 @03:32PM (#48939175)
I dont have estimates on the cost of running models, but I think openai and anthropic are running on subsidized prices. At actual prices it might be worth it in the future.
Re:Kimi K3 is now live by anthonypasq on Thursday July 16, 2026 @03:36PM (#48939215)
how is this idea still so persistent? The fact people are able to run open models with about the same performance at 1/10th the cost should make it glaringly obvious that Anthropic has massive inference margins at api pricing.
Re:Kimi K3 is now live by entrope on Thursday July 16, 2026 @03:52PM (#48939410)
I think the idea conflates price discrimination -- where people on individual subscriptions pay a much lower price per token than corporate accounts pay -- with using venture capital funding for opex. Both are subsidies in some senses, but the former is sustainable indefinitely.
Re:Kimi K3 is now live by preg_match on Sunday July 19, 2026 @03:13PM (#48970897)
When people say "subsidized pricing" they're usually referring to subscription pricing, not API pricing.
Re:Kimi K3 is now live by criley2 on Thursday July 16, 2026 @03:01PM (#48938776)
No, and the reason is simple: Usage is bursty and if you don't maximize usage of the hardware you're going to lose on price.

Ok you can host this model once. What if I want a dozen subagents? Ok you can host it 12 times at once. What if we go a whole week only using max 4 at a time? Etc etc. The limits imposed by self-hosting might be bearable for a variety of reasons, but it's going to be more expensive and less convenient/useful.

Re:Kimi K3 is now live by preg_match on Sunday July 19, 2026 @03:16PM (#48970915)
The flip side is if you already have the hardware and can utilize it. Also, if this is for security or IP concerns, you largely don't have a choice. The US players are out.

The marginal cost goes down significantly if you have datacenters. Baring in mind that US API pricing is kind of absurd. Even if you, say, only utilize your DC 1/10 of the time... you might still be ahead of API pricing by a wide margin.

Re:Kimi K3 is now live by woctordho on Friday July 17, 2026 @12:10AM (#48943256)
Yes in a mid-sized company. I'm exactly doing this, and what I'm competing against is the OpenAI API priced 0.2 CNY = 1 USD in China.
Re:Kimi K3 is now live by bhouston on Thursday July 16, 2026 @02:21PM (#48938218)
Whether it is "open" or not seems to be in question. While it was initially called an "open" model, it seems that "open" mentions have been scrubbed from website.
Re:Kimi K3 is now live by kingleopold on Thursday July 16, 2026 @02:33PM (#48938373)
hardware, electricity cost and other extra time consuming deployment, are they joke to you? ROI needs to positive otherwise open models have still BIG COST.
Re:Kimi K3 is now live by WorldPeas on Thursday July 16, 2026 @06:53PM (#48941351)
not to mention thermal sinking, this is a very overlooked part of self-hosting at scale people overlook