News for hackers. Stuff that matters.
Re:Microsoft AI: Seven new world-class models at scalable pr... by dofm on Wednesday November 18, 2026 @12:52PM (#50549595)
> These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).

FWIW it is worth noting that the GP's suggestion is more in line with Microsoft's own stated belief in the future of "unmetered AI".

At the moment, Microsoft is arguably meeting that claim with their support for and encouragement of Nvidia Nemotron Bolt, which is an actually pretty good, quite interesting, unusually-trained-and-sized-to-fit MoE model that was designed to go with the launch of the Nvidia/Microsoft RTX Spark machines.

(Good Sam Witteveen video about it: https://www.youtube.com/watch?v=WJpeW9lCSUM )

But it would be good to see Microsoft themselves distilling an open weights model.

Like any vendor with a profit motive they do have to decide the obvious, though: how do you make money from it, when right now it could cost several hundred million dollars to train (even if you adjust the training of a larger proprietary model so you can distill the smaller one from it)?

There is, essentially, no way to keep an open weights model from being copied/distilled/extracted, and IMO what that tends to suggest is that open weights models will essentially gravitate to sort of uncontroversial, "standard library" tasks.

So I think it also means that Microsoft's approach on open weights will ultimately be the same as Apple's: they will focus their efforts on LLMs that meaningfully add function to their OS and can be decapitated to make similarly useful decision models.

Put another way: given the geopolitical angle of the last few weeks, I think it is possible that the open weights coding models we have now may be among the best we will ever get, until the nearly inevitable GPU/tensor hardware glut arrives.

Re:Microsoft AI: Seven new world-class models at scalable pr... by pianopatrick on Wednesday November 18, 2026 @01:34PM (#50550201)
Long term I think the economics point to having a "Linux of AI". I.e. Operating systems were the same way, expensive to make but everyone needed one and did not want to pay for one. So maybe many of the big corporations will eventually collaborate on one ecosystem of open weight models where they share the costs of training it. Then they can compete on other things like serving it or whatever.
Re:Microsoft AI: Seven new world-class models at scalable pr... by dofm on Wednesday November 18, 2026 @02:48PM (#50551165)
Yeah, I think this too. It is not going to be cutting edge but it is going to be something that can be supported, reasoned about, customised etc.

I think we are not far off this with Pi, Muse Glimmer, Qwen, Gemma etc., but sooner or later we will all have to work out how to put money behind it.

Re:Microsoft AI: Seven new world-class models at scalable pr... by CrimsonCape on Wednesday November 18, 2026 @08:14PM (#50554776)
I mean, nobody is really out there broadcasting their 501c that is collecting funds to build a world class open weight model... the question is does this 501c exist, and if not, why not make one? The first major hurdle i'm guessing, is that it would take actual liquidity and not funny-money.
Re:Microsoft AI: Seven new world-class models at scalable pr... by dofm on Wednesday November 18, 2026 @08:28PM (#50554918)
I agree that is what it would take.

The main problem is that the open source movement has trouble even raising the money to properly pay linchpin individuals like Harlan Stenn (NTP).

Even Omarchy, which is uncomfortably effective at raising money for what amounts to a barely differentiated Linux distribution, is not raising LLM-training money; it’s barely even raising the kind of money it would take to post-train Qwen, I think.

Re:Microsoft AI: Seven new world-class models at scalable pr... by pianopatrick on Wednesday November 18, 2026 @09:32PM (#50555342)
All the companies still seem to think it's worthwhile to build their own.

We're in the 80s era in the OS analogy.

Gotta wait until there's a race to the bottom, prices drop and a bunch of these projects to build an AI model turn out to lose money. Then people will realize it's financially more sensible to pitch in and collaborate on one good model instead of building their own.