But Microsoft coming from the side like this might be very different if it holds up.
Of course, I would not surprised if they also do this, mainly because after OpenAI and Anthropic have succeeded to gather most training information that was easily accessible in the past and now it has become much more difficult to do the same. For some information that was hoarded by OpenAI and Anthropic public access may have become impossible otherwise than through their LLMs.
Nonetheless, distillation cannot be the main source of improvement for the Chinese models. While OpenAI and Anthropic provide negligible information about their models, the Chinese AI companies are much more transparent about their methods and we can see that there is a lot of diversity among their models and a lot of innovations with each new version.
Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".
My assumption is, that Chinese model found things Frontierlabs already had but didn't share. There was this paper were i had the feeling that this was a real and significant Research Result from Deepseek "DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression" but otherwise its just unclear.
The main issue is, that as long as it seems plausable that they do distillation, its hard to determine how big the gap is.
Not saying they can't catch up but they are also potentially limited by resources (money & nvidia GPUs)
There is evidence (in particular from the analysis of reasoning traces [1]), but what models claim about their identity is pretty much worthless as evidence. LLMs are not self-aware. These claims come from whatever is in their training data, and Claude/GPT output including this is all over the web, including in some huggingface data dumps. Consider that people got Opus claiming to be Qwen or DeepSeek when asked in Chinese, and you'll see how weak this particular evidence is.
[1] E.g. https://arxiv.org/abs/2608.09867
Patrick Toulme noted a while ago that the biggest advantage of that in his opinion came from bootstrapping the post-training process: https://xxcancel.com/PatrickToulme/status/206921157543762774...
At Thinking Machines, they said that they used open-weights models for bootstrapping post-training, including Kimi K2.5: https://thinkingmachines.ai/news/introducing-inkling/
Speaking of Thinking Machines, that's another data point. Their Inkling Small 2 model is just a bit behind DeepSeek V4.1 Flash 1017 in benchmark, and in my tests, that seems to be accurate, but mostly because they used less training data for pre-training, so they have less of a knowledge base, while similar reasoning capabilities. (One of the most interesting parts of Inkling Small 2 is that their training must have been very cost-efficient, apparently using less, but higher quality training data.)
And we're now seeing more and more Western near-frontier models from labs other than Anthropic and OpenAI to question whether distilling reasoning traces is really much of a difference maker.
Personally, my theory is that the gap is primarily due to Chinese labs having a harder time getting the necessary compute (especially top of the line GPUs) for training. These are, as far as I can tell, orders of magnitude differences in availability, so it wouldn't be surprising that a large compute gap is reflected in capabilities (and also indirectly visible through model sizes).
Don’t hold your breath.
And 6 month feels still very different.
Its for sure an option or might have some kind of impact but if you have some kind of restrictions on what you should use and the price is not that big but the quality and possibilites are better, I can see companies just staying with Anthropic or OpenAI.
You also don't just switch out a model, they might need prompt updates etc.
But we will see I don't mind competition
It's like they're runners drafting behind the lead runner. It is easier to run in their wake. If the lead wants to stay in front, they have to keep running into the wind.
Microsoft didn't win spreadsheets by having the most advanced or releasing the most often. They made a really good, easy to use product, and got it in front of everyone. (Though Office's p-code was a huge advantage to portability)
And people wonder why we have so many things being attacked by agents…
Anthropic's productization is an onrder of magnitude better than OpenAI, imo, even if OpenAI has nearly the same, if not better, raw model performance. UX wins every time.
They won by owning the distribution. Essentially making it the default option for businesses. Bundling with Office, owning the operating system (eg. Making competing products error out), licensing deals and many other things very similar to their Embrace, Extend, Extinguish strategy (which they used against open standards)
" DOS Isn’t Done Until Lotus Won’t Run "
although this article and others say it probably never happened in reality
https://raywoodcockslatest.wordpress.com/2021/06/09/dos-lotu...
Honestly, this line up is impressive, I wanted to try MAI since v1 came out, but Microsoft locked down Copilot subscriptions. If they gave me a comparable plan to Claude Max I'd consider it.
Google newest models are unavailable on some pro accounts and perform best only with Antigravity. Trying to plug it in some other harness and its terrible. If you try to connect your subscription with Hermes etc you might get banned.
While Microsoft models are hidden away in Azure and you can't really subscribe to it.
So every time I read Google/MS announcements I just shrug. If I want to use models like these I might as well get DeepSeek on Openrouter instead.
I think only google is catching up, and others plateaued.
Time and time again it's been clear that LLMs are commodities with no winners. You'll jump where wallet and performance in your applications will bring you.
I sort of agree with you on Claude, but I've recently started using gpt-sol 6.1 and it took me a lot more iteration to get what I want than with Claude.Admittedly I was using Claude code and gpt with pi, but if the difference is the agent, then the situation is even more dire for open ai and anthropic. Today I looked at some code that got generated and it's an absolute Horrorshow. It's just some quick prototyping, but the code structure is a horrible mess.
I ended up pointing my local Qwen 3.8 FN (Halogen on Ryzen 395) to the code and it was solving a bunch of basic issues that gpt introduced to the code. And I feel it's running faster as well.
All that to say, I now feel that openai (sol at least), is worse at coding tasks then a local 180B parameter model (while Claude seems still ahead, but I'm unsure how much of that is the framework). They really are falling behind.
I think it’s inevitable. Hardware manufacturing will ramp up to meet a demand and the demand from consumers is there. The big providers can’t monopolize a commodity forever.
The biggest hope is HBF (high bandwidth flash) which has the bandwidth of HBM with the density of flash. It has much more latency but when you’re repeatedly pumping weights through a compute unit it’s not a blocker.
I swear people forget about inference providers that serve open weight models. It is hard to beat their prices. They are usually barely more expensive than electricity, so running local inference barely wins on cost (if you don't factor in the upfront hardware costs).
That is a very tenuous lead and doesn't speak to much of a sustainable competitive moat for either company. The have to keep sprinting as fast as possible on the hamster wheel to just stay ahead.