News for hackers. Stuff that matters.
Re:OpenAI's Unit Economics by xyzsparetimexyz on Thursday January 29, 2026 @05:54AM (#46808427)
What I dont understand is, why would a company pay $10,000s a month to anthropic for Claude in a situation where a Chinese LLM is 99% as good, is open weight and runs on US servers and is 5% the price?
Re:OpenAI's Unit Economics by willis936 on Thursday January 29, 2026 @06:04AM (#46808516)
By what metrics are they 99% as good? There are a lot of benchmarks out there. Please share them.

I think the answer lies in the "we actually care a lot about that 1% (which is actually a lot more than 1%)".

Re:OpenAI's Unit Economics by samuelknight on Thursday January 29, 2026 @06:31AM (#46808795)
Open models have been about 6 to 9 months behind frontier models, and this has been the case since 2024. That is a very long time for this technology at it's current rate of development. If fast takeoff theory is right, this should widen (although with Kimi K2.5 it might have actually shortened).

If we consider what typically happens with other technologies, we would expect open models to match others on general intelligence benchmarks in time. Sort of like how every brand of battery-powered drill you find at the store is very similar, despite being head and shoulders better than the best drill from 25 years ago.

Re:OpenAI's Unit Economics by hobofan on Thursday January 29, 2026 @06:41AM (#46808886)
> That is a very long time for this technology at it's current rate of development.

Yes, as long as that gap stays consistent, there is no problem with building on ~9 months old tech from a business perspective. Heck, many companies are lagging behind tech advancements by decades and are doing fine.

Re:OpenAI's Unit Economics by SecretDreams on Thursday January 29, 2026 @06:59AM (#46809036)
> Sort of like how every brand of battery-powered drill you find at the store is very similar, despite being head and shoulders better than the best drill from 25 years ago.

They all get made in China, mostly all in the same facilities. Designs tend to converge under such conditions. Especially since design is not open loop - you talk to the supplier that will make your drill and the supplier might communicate how they already make drills for others.

Re:OpenAI's Unit Economics by Topfi on Thursday January 29, 2026 @06:15AM (#46808636)
I'm still testing myself and cannot make a confident statement yet, but Artifical Analysis is a solid and independent, though also to be fair somewhat imperfect source for a general overview: https://artificialanalysis.ai/

Purely according to Artificial Analysis, Kimi K2.5 is rather competitive in regard to pure output quality, agentic evals are also close to or beating US made frontier models and, lest we forget, the model is far more affordable than said competitors, to a point where it is frankly silly that we are actually comparing them.

For what it's worth, of the models I have been able to test as of yet, when focusing purely on raw performance (meaning solely task adherence, output quality and agentic capabilities; so discounting price, speed, hosting flexibility), I have personally found the prior Kimi K2 Thinking model to be overall more usable and reliable than Gemini 3 Pro and Flash. Purely on output quality in very specific coding tasks, Opus 4.5 was in my testing leaps and bounds superior of both the Gemini models and K2 Thinking however, though task adherence was surprisingly less reliable than Haiku 4.5 or K2 Thinking.

Being many times more expensive and in some cases less reliably adhering to tasks, I really cannot say that Opus 4.5 is superior or Kimi K2 Thinking is inferior here. The latter is certainly better in my specific usage than any Gemini model and again, I haven't yet gone through this with K2.5. I try not to just presume from the outset that K2.5 is better than K2 Thinking, though even if K2.5 remains at the same level of quality and reliability, just with multi modal input, that'd make the model very competitive.

Re:OpenAI's Unit Economics by eru on Thursday January 29, 2026 @06:32AM (#46808808)
Usain Bolt's top speed is about 44.72 km/h. My top speed sprinting is about 25 km/h. That's at least 50% as good. But I'd have a hard time getting paid even half as much as Mr Bolt.
Re:OpenAI's Unit Economics by SecretDreams on Thursday January 29, 2026 @07:01AM (#46809056)
Yeah, but you'd both be quite suitable to go walk to the grocery store.
Re:OpenAI's Unit Economics by eru on Thursday January 29, 2026 @12:40PM (#46813531)
Sure, but that would be a waste of Mr Bolt's capability for locomotion.
Re:OpenAI's Unit Economics by solumunus on Thursday January 29, 2026 @07:33AM (#46809321)
Even someone with marginally less top speed isn’t getting paid half as much as Usain Bolt. Athletes aren’t getting paid per unit of output. This analogy is not analogising.
Re:OpenAI's Unit Economics by eru on Thursday January 29, 2026 @12:40PM (#46813544)
No, no, you understood it exactly right: someone who's 99% as fast as Usain Bolt doesn't get 99% as much attention and money either.
Re:OpenAI's Unit Economics by solumunus on Saturday January 31, 2026 @08:14AM (#46836401)
Which doesn’t even slightly apply to what you’re drawing the analogy against. Your attempted analogy is invalid.
Re:OpenAI's Unit Economics by atwrk on Thursday January 29, 2026 @08:52AM (#46810192)
OK but what if, staying in that analogy, you just have to wait 6-12 months to become as fast as Usain is right now?
Re:OpenAI's Unit Economics by falcor84 on Thursday January 29, 2026 @10:39AM (#46811618)
In this analogy Usain Bolt will get twice as fast too, right? Using a solution that is always twice weaker than SotA, would put a company (or a national olympic team) at a significant disadvantage to competitors which do use the SotA.
Re:OpenAI's Unit Economics by Lerc on Thursday January 29, 2026 @07:01AM (#46809060)
I don't think 99% of the best is a good metric.

It is highly dependent on what the best represents.

If you had a 100% chance of not breaking your arm on any given day, what kind of value would you place on it over a 99% chance on any given day. I would imagine it to be pretty high.

The top models are not perfect, so they don't really represent 100% of anything on any scale.

If the best you could do is have a 99% chance of not breaking your arm on any given day, then perhaps you might be more stoic about something that is 99% of 99% Which is close enough to 98% that you are 'only' going to double the number of broken arms you get in a year.

I suspect using AI in production will be a calculated more as likelihood of pain than increased widgets per hour. Recovery from disaster can eat any productivity gains easily.

Re:OpenAI's Unit Economics by senko on Thursday January 29, 2026 @07:00AM (#46809043)
As a heavy Claude Code user, I would like to have that option.

But if it's just 33% as good, I wouldn't bother.

Top LLMs have passed a usability threshold in the past few months. I haven't had the feeling the open models (from any country) have passed it as well.

When they do, we'll have a realistic option of using the best and the most expensive vs the good and cheap. That will be great.

Maybe in 2026.

Re:OpenAI's Unit Economics by fy20 on Thursday January 29, 2026 @03:58PM (#46816490)
GLM-4.7 is pretty good. It is not as good as Opus 4.5 though.

If you are a business there is no point trying to save $50 a month, as the cost of the engineers time is much greater.

Re:OpenAI's Unit Economics by energy123 on Thursday January 29, 2026 @06:39AM (#46808881)
I tried that but I'm back to paying OpenAI $200/month because the quality was significantly worse on my codebase.
Re:OpenAI's Unit Economics by re-thc on Thursday January 29, 2026 @06:01AM (#46808482)
How do they run on US servers? Self host? That’s not going to be cheap whilst the big AI players horde resources like memory.
Re:OpenAI's Unit Economics by Topfi on Thursday January 29, 2026 @06:31AM (#46808799)
There are many providers (Fireworks, Groq, Cerebras, Google Vertex), some using rather common hardware from Nvidia, etc., others their own solutions focused solely on high throughput inference. They often tend to be faster, cheaper and/or more reliable than what the lab that trained the model is charging [0], simply because there is some competition, unlike with US frontier models which at best can be hosted by Azure, AWS or GCloud at the same price as the first party.

[0] https://openrouter.ai/moonshotai/kimi-k2-thinking

Re:OpenAI's Unit Economics by re-thc on Thursday January 29, 2026 @08:10AM (#46809736)
And who funds those providers? They can clearly pull the plug any time. The so called many providers is the same group under the hood.

Nvidia was noted as having most of their revenue heavily tilted against only a few major customers for example.

Re:OpenAI's Unit Economics by Topfi on Thursday January 29, 2026 @08:33AM (#46809995)
I don’t really understand your point. A company offering only inference will inherently always have lower costs and require less hardware than one that both provides inference and does training of new models.
Re:OpenAI's Unit Economics by re-thc on Thursday January 29, 2026 @09:11AM (#46810431)
The point is it doesn't work like that. Check out all the special purpose vehicles, loans and fund raises going around in that space. Deals claiming for $x billion in funds only got millions + GPU rentals in special deals. And the offering of those deals still hinges on the top 3 said customers buying to float things up.

i.e. whether you go for "only inference" or "both" it'll work out similar somewhere.

Re:OpenAI's Unit Economics by Topfi on Thursday January 29, 2026 @09:32AM (#46810710)
If you are referencing Nvidia, note that Vertex, Groq, Cerebras, etc. all do not rely on GPUs for much or all of their inference and are all the better for it.

Kind of why Nvidia see themselves forced to make such deals, to lock labs in before they loose another to objectively superior inference.

Staying purely with US labs, they just lost Meta and both Anthropic and Gemini models have been available on Vertex without relying on GPUs for a while. OpenAI equally is turning towards Cerebras so yeah, those deals will mean little for inference.

Those circular deals aren’t a thing for the inference providers I tend to go for and they don’t change the fact that using a full GPU purely for inference is like using a pickup truck for a track day. It can be done and the flexibility has advantages, but once you focus on one task, there are better tools for the job.

Re:OpenAI's Unit Economics by atwrk on Thursday January 29, 2026 @08:57AM (#46810251)
You just click "buy" with another provider? They just host the model for money, nothing more.

To be clear: The models are open weights everyone can simply download, because many labs publish them as such. The providers in question are generic hosters. It's the same as if you would get some managed wordpress hosting somewhere.

Re:OpenAI's Unit Economics by re-thc on Thursday January 29, 2026 @09:11AM (#46810437)
> You just click "buy" with another provider? They just host the model for money, nothing more.

Start with where the GPU and rest of it comes from.

Re:OpenAI's Unit Economics by lancekey on Thursday January 29, 2026 @09:24AM (#46810591)
I'm starting to add inference providers to computeprices.com, but if you even just look at GPU/hr rentals, there are some reasonable options out there.

I personally have been enjoying shadeform to build the GPU setup I like.

Re:OpenAI's Unit Economics by Arkhaine_kupo on Thursday January 29, 2026 @05:57AM (#46808446)
Isn't there pretty good indications that the chinese llms have been trained on top of the expensive models?

Their cost is not real.

Plus you have things like MCP or agents that are mostly being spearheaded by companies like Anthropic. So if it is "the future" and you believe in it, then you should pay a premium to spearhead it.

You want to bet on the first Boeing not the cheapest copy of a Wright brother plane.

(Full disclosure, I dont think its the future and I think we are over leveraging on AI to a degree that is, no pun intended, misanthropic)

Re:OpenAI's Unit Economics by malka1986 on Thursday January 29, 2026 @05:59AM (#46808471)
> Isn't there pretty good indications that the chinese llms have been trained on top of the expensive models?

So what ?

Re:OpenAI's Unit Economics by fc417fc802 on Thursday January 29, 2026 @06:24AM (#46808707)
Well it raises an interesting conundrum. Suppose there's a microcontroller that's $5.00 and another that's $0.50. The latter is a clone of the former. Are you better off worrying only about your short term needs, or should you take the long view and direct your business towards the former despite it being more expensive?
Re:OpenAI's Unit Economics by blitzar on Thursday January 29, 2026 @06:31AM (#46808788)
Suppose both microcontrollers will be out of date in a week and replaced by far more capable microcontrollers.

The long view is to see the microcontroller as a commodity piece of hardware that is rapidly changing. Now is not the time to go all in on betamax and take 10 years leases on physical blockbuster stores when streaming is 2 weeks away.

Ai is possibly the most open technological advance I have experienced - there is no excuse, this time, for skilled operators to be stuck for decades with AWS or some other propriety blend of vendor lock-in.

Re:OpenAI's Unit Economics by fc417fc802 on Thursday January 29, 2026 @08:26AM (#46809916)
This isn't betamax vs VHS. It's VHS vs a clone of VHS. The long view necessarily has to account for R&D, long term business partners, and lots of other externalities. The fact that both manufacturers will have a new model of VCR out next month, and yet another the month after that, really has nothing to do with the conundrum I gave voice to.

I'll also note that there's zero vendor lock-in in either scenario. It's a simple question about the tradeoffs of indirect parasitism within the market. I'm not even taking a side on it. I don't even know for certain that any given open weights Chinese model was trained against US frontier models. Some people on HN have made accusations but I haven't seen anything particularly credible to back it up.

Re:OpenAI's Unit Economics by malka1986 on Thursday January 29, 2026 @10:19AM (#46811348)
If the clone is 1/10th of the price, and of equivalent quality, why would I use the original ? I would be undercut by my concurrents if i did that, it would be a very bad business decision.
Re:OpenAI's Unit Economics by FridgeSeal on Thursday January 29, 2026 @07:06AM (#46809093)
Well the company of the former microcontroller has gone out of their way to make getting and developing on actual hardware as difficult and expensive as possible as possible, and could reasonably accused of doing “suspect financial shenanigans”, and the other company will happily sell me the microcontroller for a reasonable price. And sure, thy started off cloning the former, but their own stuff is getting really quite good these days.

So really, the argument pretty well makes itself in favour of the $0.5 micro controller.

Re:OpenAI's Unit Economics by woadwarrior01 on Thursday January 29, 2026 @07:04AM (#46809075)
That's a very tenuous analogy. Microcontrollers are circuits that are designed. LLMs are circuits that learned using vast amounts of data scraped from the internet, and pirated e-books[1][2][3].

[1]: https://finance.yahoo.com/news/nvidia-accused-trying-cut-dea...

[2]: https://arstechnica.com/tech-policy/2025/12/openai-desperate...

[3]: https://www.businessinsider.com/anthropic-cut-pirated-millio...

Re:OpenAI's Unit Economics by fc417fc802 on Thursday January 29, 2026 @08:16AM (#46809821)
> Microcontrollers are circuits that are designed. LLMs are circuits that learned using vast amounts of data

So I suppose the AI companies employ all those data scientists and low level performance engineers to what, manage their website perhaps?

It's poor form to go around inserting your pet issue where it isn't relevant.

Re:OpenAI's Unit Economics by ForHackernews on Thursday January 29, 2026 @06:27AM (#46808754)
You're asking whether businesses will choose to pay a 1000% markup on commodities?
Re:OpenAI's Unit Economics by antonvs on Thursday January 29, 2026 @04:16PM (#46816711)
It would mean that their costs are lower than they would be to achieve the same capabilities otherwise.
Re:OpenAI's Unit Economics by zozbot234 on Thursday January 29, 2026 @07:38AM (#46809364)
> Isn't there pretty good indications that the chinese llms have been trained on top of the expensive models?

How do you even do that? You can train on glorified chat logs from an expensive model, but that's hardly the same thing. "Model extraction" is ludicrously inefficient.

Re:OpenAI's Unit Economics by Arkhaine_kupo on Thursday January 29, 2026 @08:03AM (#46809655)
> How do you even do that?

I am not going to comment on how they did it. But they were openly accused by OpenAI of it. I believe the discussion is over destillation vs foundational models.

https://www.jdsupra.com/legalnews/openai-accuses-deepseek-of...

There are other theories like OpenAI inflated their training costs to seek further investment in later growth quarters. Meanwhile Deepseek under reported their cost to portray China as more cost efficient investment. If that was the case then their performance is similar, with similar training costs but one side reported even the coffee from the coffee machine in the office in the total while the other only counted the minimal CPU cycle cost and not the GPU, energy, engineering etc. Which is plausible too.

I have no dog in the fight but the first accusation seemed quite serious, hence why I asked

Re:OpenAI's Unit Economics by blitzar on Thursday January 29, 2026 @06:01AM (#46808484)
> Isn't there pretty good indications that the chinese llms have been trained on top of the expensive models?

there are pretty good indications that the american llms have been trained on top of stolen data

Re:OpenAI's Unit Economics by svara on Thursday January 29, 2026 @06:40AM (#46808883)
This is proven. You can prove it yourself easily. Take a novel from your bookshelf, type in any sentence from the novel and ask it what book it's from. Ask it for the next sentence.

This works with every novel I've tried so far in Gemini 3.

My actual prompt was a bit more convoluted than this (involving translation) so you may need to experiment a bit.

Re:OpenAI's Unit Economics by ForHackernews on Thursday January 29, 2026 @06:26AM (#46808738)
This so-called "PC compatible" seems like a cheap copy, give me a real IBM every time.
Re:OpenAI's Unit Economics by re-thc on Thursday January 29, 2026 @06:04AM (#46808521)
> Their cost is not real.

They can’t even officially account for any nvidia gpus they managed to buy outside the official channels.