(But to be clear: 25-50% faster is still a big win in my book.)
I guess my question is when do we say a model is "good enough"? For my use cases Opus 5.5 feels as if it is exactly at that point. And at that point of course one of the main factors I will evaluate against is price. So far I am happy with my (heavily subsidized) subscription, but if the time comes, I'll happily switch the inference API any of my agents are calling. So far I have no big lock in on any providers.
Because again - I think lots of businesses are already taking a good look at models well off the "cutting edge" because they're good enough for what that business is trying to do. They're already there.
If you're doing categorization, tagging, form-filling, customer support routing, etc... you don't need anywhere close to cutting edge expensive models.
Hell - Jev being so popular is basically exactly that group going "what's the cheapest way we can make this decision".
Meanwhile, there are plenty of spaces where you still want real model improvement. But a lot of traditional business was basically process and paper pushing. You don't need a Phd level model for that, you need an intern level model.
---
But that's the trap for the large providers - intern level models are cheap and easily available with current open weights. It's going to be a very tight market, and margins will go down to essentially the floor (especially once we exit the current constrained-compute market).
Somewhat ironically - the technology itself makes switching costs basically zero. It's not just that there's no big lock in, AI is like an anti-moat. It actively fills in and paves over whatever moat you might have for price conscious customers.
I also agree that more capable models are still desirable in plenty of spaces. I just see that there is so much lag in the diffusion of existing models, which, again, are already sufficiently capable.
To your point, I think we’re past the hump on the Pareto distribution. The models are good enough for most things, and the rate they’re improving at the things they’re bad at is dropping. The odds a new model is good at something the old one was bad it is okay, the odds it’s something you care about is dropping. It makes a lot of sense to discriminate on price rather than features in that environment.
But the under-reported corellary of this is that a TON of industries essentially operate on hardware right out of that time period (or slightly after, circa 2000s)
banking
Insurance
Healthcare
Gov
retail
Transportation
etc...
Hell, I was writing code to run on IBMs Z/arch as recently as 2021 for banks with mainframes deployed around 2004. They were just then finally considering an upgrade to the later models.
Further, even if this is your take (and I won't touch the geopolitics here, maybe you're right, maybe you're not regarding ulterior motives) - go use non chinese open models that are also good.
Laguna, Nemotron, Mistral, Arcee, Llama, etc...
In organic capitalism you need to compel arrays of discrete private entities to invest in your idea. In sandbox capitalism, the money can just appear in any amount at the behest of a single controlling individual.
I mean this is not the case for either, but the systems are setup to drift in these directions - a market needs some sort of regulation to keep things sane, otherwise you end up with standard oil and the like.
You want the people with guns controlling things to be at least nominally interested in “the people” and produce more than just “return on investment”.
Not saying that China is like this or that US is bad, but saying that China is bad because it is “controlled capitalism” is kinda missing the point of what it should be in the best case.
Contrast that to US being happy with everyone eating each other alive until all but one company is left standing and can now dictate the prices and enshittify the product to pay back their VC loans.
Less intervening and micro management but oh boy say something not nice about government and potus and suddenly you are a new enemy of the state and 3-letter agencies work day and night to bring you down for good. Or in reverse - put a public bribe to potus and his clan and enjoy some favors for few weeks.
2 years ago I would agree more strongly with you, but we are in new era from now on.
real-life, unregulated capitalism lends itself to exactly what you described
In actual capitalism, POTUS wouldn't have enough power to be worth bribing.
The problem isn't the money, the problem is the power.
And that's the rub - it doesn't matter if inference is profitable, the US labs have promised the whole kitchen sink, and taken serious investment on that pitch. They won't make it back in a cut-throat market for inference. They have to continue pitching the idea that only their models are worth using, for quality/safety/performance/etc reasons.
Which means continuing to develop and release new models. At huge expense.
Side note - while deepseek seems to be doing fine, I'll note that the emphasis on cost effectiveness is very much not a thing for the US labs right now... and it was for non-us labs. I'd be quite interested in knowing if anthropic is pulling in the same returns, or what the margin on their subscription plans actually is.
---
I'm already seeing this directly at work - lots of devs still happily use claude for development, but the products we're making aren't. They'll use kimi, glm, gpt-oss, etc... basically - if cloudflare is hosting it, we're exploring it (mainly for contractual/security reasons): https://developers.cloudflare.com/workers-ai/models/.
Because we are price sensitive, and we already have to do all the work of creating very robust evaluation frameworks for our products, so we might as well choose the cheapest model that meets our standards.
whiiiiich is why we're seeing things like Haiku and gpt-luna priced down near the open models at ~.10/mm in, ~.50/mm out. They've been forced to cut prices to keep commercial customers on their cheaper models instead of moving away.
This will continue. If inference is profitable and easy, prices will continue to erode. Go browse openrouter, plenty of providers happy to undercut the competition. Bigger shops with auditing requirements will avoid them, but smaller ones won't.