I'll pay Microsoft to run them if they're open weights. I don't want to deal with the hassle of doing that myself. But I won't even touch them if I can't possibly own the weights myself.
The market is already full of closed weights. We don't need more.
I've lost track of the anguished cries of those unhappy when either of these has happened.
History shows that if you give a corporation power to extract money from you, most of them will do that without any regard to the user.
That power is the model weights. If there is a market around open weights, they will exist and corps will not be able to squeeze so hard.
Unfortunately not many people understand this simple and intuitive reality, and thats why we suffer
I see minimal downside in using closed weight models as long as they're behind a router, you have good prod sourced evals and you have fail over to other models configured and tested (running either dark or active:active) with real prod workloads.
But you have to choose which is your complement and which is your main product.
In this case there is huge demand from companies who consume API tokens at currently high prices who do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.
The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.
It reminds me of when Apple switched to their own silicon in the iPhones and we had year after year of hardware with 1.5-2.5x performance compared to the previous year. We very rapidly got to the point where the processor in my phone was more power than I would ever need (unless apps got more and more bloated and inefficient, which they obviously did).
Fun fact - Enterprises are just big groups of people.
If none of your people have ever used a tool because it's expensive, locked away in a some walled garden, and obscure then none of the enterprises will have demand for it. Management might force them to use some cheap model, but users will all be pushing for the models with mindshare, and Microsoft will lose marketshare as a consequence.
Apple knew this when they put Apple IIe's in schools. It's still paying dividends. Today, Anthropic and OpenAI know it and are actively hemorrhaging money trying to become synonymous with AI. Microsoft seems to think that this is all a race to the bottom. I think they're wrong.
There is a lot of choice...
one is not true, the other is not all that relevant considering disparity in pricing local vs API even subsidized.
Even if both were true, this is Microsoft. There's negative chance of them producing anything close to frontier anytime soon or at all. They've been absent altogether and relied on others; The little they did is not even in also ran category like grok is for example.
they will happily use a microsoft model that is slightly less capable at fraction of the cost.
FWIW it is worth noting that the GP's suggestion is more in line with Microsoft's own stated belief in the future of "unmetered AI".
At the moment, Microsoft is arguably meeting that claim with their support for and encouragement of Nvidia Nemotron Bolt, which is an actually pretty good, quite interesting, unusually-trained-and-sized-to-fit MoE model that was designed to go with the launch of the Nvidia/Microsoft RTX Spark machines.
(Good Sam Witteveen video about it: https://www.youtube.com/watch?v=WJpeW9lCSUM )
But it would be good to see Microsoft themselves distilling an open weights model.
Like any vendor with a profit motive they do have to decide the obvious, though: how do you make money from it, when right now it could cost several hundred million dollars to train (even if you adjust the training of a larger proprietary model so you can distill the smaller one from it)?
There is, essentially, no way to keep an open weights model from being copied/distilled/extracted, and IMO what that tends to suggest is that open weights models will essentially gravitate to sort of uncontroversial, "standard library" tasks.
So I think it also means that Microsoft's approach on open weights will ultimately be the same as Apple's: they will focus their efforts on LLMs that meaningfully add function to their OS and can be decapitated to make similarly useful decision models.
Put another way: given the geopolitical angle of the last few weeks, I think it is possible that the open weights coding models we have now may be among the best we will ever get, until the nearly inevitable GPU/tensor hardware glut arrives.
I think we are not far off this with Pi, Muse Glimmer, Qwen, Gemma etc., but sooner or later we will all have to work out how to put money behind it.
The main problem is that the open source movement has trouble even raising the money to properly pay linchpin individuals like Harlan Stenn (NTP).
Even Omarchy, which is uncomfortably effective at raising money for what amounts to a barely differentiated Linux distribution, is not raising LLM-training money; it’s barely even raising the kind of money it would take to post-train Qwen, I think.
We're in the 80s era in the OS analogy.
Gotta wait until there's a race to the bottom, prices drop and a bunch of these projects to build an AI model turn out to lose money. Then people will realize it's financially more sensible to pitch in and collaborate on one good model instead of building their own.
Not to nitpick, but Windows Phone also failed because Microsoft released the first generation of devices with Windows Phone 7, convinced a bunch of people to buy them, and then released a second generation of devices with updated Windows Phone 8, a version that the first generation couldn't upgrade to meaning that anyone who got in on the ground floor got locked out immediately.
When you go out of your way* to screw the people most interested in your new product it doesn't really engender large amounts of trust in what would have been your second wave of customers.
* Well, to be specific, WP8 was based off of the NT kernel and WP7 was based off of the WinCE kernel so it was probably 'the right choice' on some level, but making the entire first generation of a new product line EOL immediately rather than making an effort to ensure those people get... something... is still a dick move.
But Windows Phone history is a long list of things they should have done
The final build of WM10 was actually not awful... too bad it came 2 years after launch. :P
How do they compare with the fuzzily-priced only-our-agent cheap tokens you get on a Claude Pro or Max plan?
Google and Microsoft are already the bulk of the market share.
Most knowledge workers are either on Microsoft 365 or Google cloud services for anything from mail to meetings, calendars, calcs, etc.
And all of Gemini and Copilot have already moved into the offices of most people.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
The phone comparison doesn’t apply, IMO. Phones are entire ecosystems and they’re very sticky. People don’t switch phone OSes casually because they only buy a phone every several years. Getting locked into a phone you don’t like is too risky.
AI plans are not like that. Not yet, anyway. Vendors push for contracts and one year lock ins via discounts, but individuals and nimble companies are changing AI providers all the time.
Even my wife’s big company technically has a contract with one AI provider for the company, but teams across the company are getting extra spending to use on Claude or other models of their choice and the favorites are changing every few months.
Trying an AI model is low risk. You can do it for a month or even just earmark a token budget and try it. Nothing like buying a phone that you’re stuck with for years.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
Sharing repos directly exposes your vulnerabilities and unpatched software to AI. So you close it, then spend your own money closing gaps.
As your code and infrastructure begins to harden (paid for with time and churn), your costs for churn increases.
As costs increases, you start looking to reduce labor to stay profitable, and you begin to cut corners to do more with less, and speed productivity up (paid for with increased complexity and vulnerability to outages).
Outages increase, so again you decide to close your source repos and begin working privately. But then who is hosting your source? So you lock in with a vendor that does both: hosting and thinking.
And we'll try this out for a while until it causes too much pain to the economy, and we'll reverse course again.
We'll demand quality, labor from real people: bring them back!
But there is nobody to bring back. All the talent retired. Nobody picked up the Mantle except for AI.
Forwards and up, for eternity, because everyone wants things cheap, fast, and of the utmost quality.
It's a retarded three body problem fueled by greed, time, and legacy.
It had nothing to do with open sourcing their OS.
Its important to note most of the groundbreaking features the Windows Phone OS had were imitated by both iOS and Android in subsequent years after its failure.
MS AI inference is heavily used in business, especially among companies who value or require 100% assurance that their data is NOT leaking into the open. Microsoft has a secure AI interference and training platform and provides such guarantees, even for classified information.
Also: this is important -- https://microsoft.ai/news/introducing-mai-licensed-weights/
Windows phone was hardware and was decades ago... it has little bearing on their AI business model which really more of Cloud offering. Microsoft is doing very well in Cloud services and revenue... Depending how you slice up their cloud services business, Microsoft is the largest (by a fair margin) or second largest cloud computing business in terms of annual revenue.
All in all, if the models perform as well in the real world as they do in benchmarks, this is fairly impressive and also concerning for OpenAI and Anthropic (downward price pressure).
If anything this highlights how commoditizable LLMS are. Is it as good as Opus but significantly cheaper? Then that's a very easy switch. Not to mention Office and Windows... they're not short of ways to get this in front of people.
Linux, Android, ElasticSearch, Apache, Nginx, PHP, Python, Perl, WebKit, Mozilla/Firefox, Chromium, Postgresql, Rust, MySQL, Redis, React, Jquery, VueJS, Blender, RepRap/Prusa... I am sure I could come up with a 100+ off the top of my head, I was just mixing it up a bit.
> We’ve heard again and again from leaders that no one wants to pour their IQ into someone else’s model.
> We heard you. We started with Custom Models. AT&T developed an MAI custom model for 5G network operation analytics and it outperformed GPT-6.1 Sol at 50x cheaper cost. On complex scenarios, they found that Code 2 delivered frontier-level performance at a significantly lower price than alternatives.
And a link to: https://microsoft.ai/news/introducing-mai-licensed-weights/
I don't really understand what this means.
Price/token and data protection agreements are all that matters.
MS dominates at the latter, and they can subsidize the former. I would not bet against them.
Otherwise, it's Windows Phone OS all over again.