News for hackers. Stuff that matters.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by Xenoamorphous on Monday February 26, 2024 @09:51AM (#39511863)
I guess it has a cost, though? I presume OpenAI didn’t like this move. If that’s the case, what might be the consequences?
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by bhouston on Monday February 26, 2024 @09:56AM (#39511929)
> I guess it has a cost, though? I presume OpenAI didn’t like this move. If that’s the case, what might be the consequences?

Until OpenAI releases GPT 5 and it blows everyone away, OpenAI's leverage is constantly decreasing as the gap between their best model and everyone else's best model decreases.

There doesn't seem to be moats right now in this industry except for pure model performance.

Maybe someone should as ChatGPT what OpenAI should do to maintain long-term leadership in this industry?

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by robrenaud on Monday February 26, 2024 @11:13AM (#39512983)
If I had to pick one player who wanted to win the AI race and was willing to be ruthless to do it, I'd pick Nvidia. Computation is the excludable bottleneck, and Nvidia is the essentially the singular company who makes AI computers.

Hire Ilya, get him to hire as many of the best folks he can.

Stop selling GPUs. Hoard them. Introduce some subtle bug into the drivers that dramatically increases their rate of burn out.

Figure out some reasonable way to give attribution to original content creators, approximately solve the content ID problem of the AI age. Cut the content creators into the rev share in proportion to their data importance to the model. Make the content creators incredibly pissed off that their work is being stolen by big AI companies unfairly and encourage to them to sue the other big AI firms. Their content share multiplier increases if they get injunctions against LLM firms.

Convince politicians that the AI firms have performed an intellectual heist of epic proportions, and that they must not be allowed to even generate synthetic training data from poisoned models. With the content creators united behind you, convince congress that poisoned models must be destroyed, that even using synthetic training data from poisoned models must be illegal. Make them start over from a clean room with no copyrighted data.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Monday February 26, 2024 @12:54PM (#39514513)
> Make them start over from a clean room with no copyrighted data.

And when such models become popular[0], all the artists now have no job and no way to get compensation for being unable to work through no fault of their own.

I don't think that's really a winning condition. It might make you feel better about the world, but the end result is still all the artists being out of work.

[0] some models are already trained that way, although I assume you're using the word "copyrighted" in the conventional sense of "neither public domain nor an open license", as e.g. all my MIT licensed stuff is still copyrighted but it's fine to use.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by robrenaud on Monday February 26, 2024 @01:49PM (#39515295)
In my hypothetical future, at least the people who create the content used to train the models can get "training royalties", which they aren't getting now.

There is still also money to be made in producing physical art or performances, even when AI can produce amazing digital works.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Tuesday February 27, 2024 @02:46AM (#39521280)
"Make them start over from a clean room with no copyrighted data." makes "the people who create the content used to train the models" the empty set.

> There is still also money to be made in producing physical art or performances, even when AI can produce amazing digital works.

Perhaps, but it may be akin to the way there is still money to be made from horse drawn carriages in city centres, even when cars displaced them over a century ago — a rare treat for special occasions, to demonstrate wealth.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by rusticpenn on Tuesday February 27, 2024 @04:22AM (#39521951)
> It might make you feel better about the world, but the end result is still all the artists being out of work.

Is it not the same with every leap in technology? There were professions like street lamp lighters, alarm services etc that have become redundant now?

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Tuesday February 27, 2024 @12:08PM (#39526521)
Sure, though I suspect "art" is the human version of a peacock tail — the difficulty is the point, it how we signal our worth to others, cheapening it breaks that signal — which would suggest that making all forms of art easy messes with (many of) us at a deep, essentially automatic, level.

More specifically, I was responding to the idea that "compensating creators" would actually solve anything; to use your examples, it would be as if the literal luddites were suggesting passing laws saying that "all textile machines that work like humans need to compensate the humans they displace", and my response would be analogous to saying "there's already machines which don't work like humans, so you're going to be out of work and have no compensation".

The Luddite movement preceded The Communist Manifesto by about 30 years. Everything's sped up since then, so I'd be surprised if we have to wait 30 years for a political shift which is to AI what Communism was to industrialisation.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by bhouston on Monday February 26, 2024 @01:00PM (#39514598)
>If I had to pick one player who wanted to win the AI race and was willing to be ruthless to do it, I'd pick Nvidia. Computation is the excludable bottleneck, and Nvidia is the essentially the singular company who makes AI computers.

I've thought the same thing. NVIDIA getting into AI seriously is a vertical integration play and they often do that -- like NVIDIA trying to buy ARM.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by Ringz on Monday February 26, 2024 @11:40AM (#39513409)
Sounds like someone has finally asked ChatGPT for a feasible plan to consolidate the AI landscape.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by johngossman on Monday February 26, 2024 @11:24AM (#39513158)
> Stop selling GPUs. I'm not sure Wall St. would reward that plan
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by CamperBob2 on Monday February 26, 2024 @11:45AM (#39513483)
Yeah, he seems to have left out the critical middle step ("Gather investors to take $2T company private.")
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by smegger001 on Monday February 26, 2024 @09:17PM (#39519317)
don't stop just raise the margin slightly and limit the number available of the higher end chip using the proceeds to self fund building their own datacneter

do runs of cards for themselves with higher core counts and clock speed that they dont release to others.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by codexon on Monday February 26, 2024 @02:48PM (#39516001)
If google benchmarks are to be believed, gemini 1.5 will be better than gpt and they use their own chips (Google TPU), no nvidia involved. There is also Groq. I don't see Nvidia keeping their lead and profit margins forever.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by vGPU on Monday February 26, 2024 @11:38PM (#39520199)
Not to mention intel rapidly catching up in the $/perf calculation.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by SunlitCat on Monday February 26, 2024 @03:16PM (#39516265)
>Stop selling GPUs. Hoard them. Introduce some subtle bug into the drivers that dramatically increases their rate of burn out.

Well, they didn't stop selling GPU when cryptomining was going strong. Instead they continued to sell them (with a hefty markup, tho).

It's like selling shovels and picks during a gold rush.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by behnamoh on Monday February 26, 2024 @10:53AM (#39512679)
> There doesn't seem to be moats right now in this industry except for pure model performance.

Hard disagree. OpenAI's function calling is something no other commercial model provides, not even Gemini and Mistral Large.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by riquito on Monday February 26, 2024 @11:25AM (#39513163)
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by fzzzy on Monday February 26, 2024 @11:10AM (#39512932)
The mixtral large marketing at the top of hn right now claims json mode and native function calling. I haven't tried it, but that's what they say.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by jorvi on Monday February 26, 2024 @11:11AM (#39512950)
> There doesn't seem to be moats right now in this industry except for pure model performance.

Compute?

At least in the short term, it seems like the biggest wallets are going to win by default.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by asynchronous on Monday February 26, 2024 @10:08AM (#39512082)
They also have brand recognition, for what it’s worth. Every non-engineer in the world practically thinks AI == ChatGPT.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by bhouston on Monday February 26, 2024 @10:31AM (#39512399)
Sure that helps with the consumer market, but most people will use AI integrated into other products and not directly.

Those integrated AI solutions will usually be done via enterprise deals where brand name is not quite as important. It will be done by people who care about cost, reliability and ease of use.

Think of nginx's dominance in web servers even though it has no name recognition among the general population. Or Stripe's payment system.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by vinay427 on Monday February 26, 2024 @10:36AM (#39512457)
Yes, however it's increasingly likely that the GPT in ChatGPT will not be limited to OpenAI (in the US), so I'm not sure how much ChatGPT will be worth with countless other platforms containing GPT in their names.

https://techcrunch.com/2024/02/15/no-gpt-trademark-for-opena...

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ethanbond on Monday February 26, 2024 @10:29AM (#39512382)
Meh, I don't think it's worth much. In a few years that'll be like claiming that so-and-so had name brand recognition for transistors. Most people don't need to care who manufactures their transistors.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by donny2018 on Monday February 26, 2024 @11:20AM (#39513107)
It’s not necessarily a bad thing. Most people don’t know that TSMC exists, or what Microsoft does beyond Windows and Xbox (which are a small fraction of its business).
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ethanbond on Monday February 26, 2024 @01:35PM (#39515107)
Correct, I didn't say it's a bad thing. I said it's not clear that it's a good thing (i.e. an asset)
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by bhouston on Monday February 26, 2024 @10:34AM (#39512438)
Unless your market is direct to end user, end user brand name recognition doesn't matter. In the case of AI, at least so far, the primarily income won't be from end-users directly, but rather via enterprise integrations into existing tools that already have end user market share (e.g. Microsoft Office, Microsoft Windows, VS Code, Notion, etc.)
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by CamperBob2 on Monday February 26, 2024 @11:48AM (#39513542)
Most people don't need to care who manufactures their transistors.

They might, in an upside-down world where the Shockley Semiconductor board tried to fire Shockley, and where the Traitorous Eight not only didn't bail out but took his side.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Monday February 26, 2024 @01:02PM (#39514636)
Brands can change quickly, but they do matter in the short term. I've witnessed customer support teams use Firefox to say they only supported Internet Explorer and government ministers who thought it was "good" that IE was the "only" web browser, and weirdly a phone company whose customer support person thought their SIM cards worked better on Android than iPhone and that their web chat wouldn't work with a Mac even though they were talking to me on a Mac at the time.

And when I was a kid, it seemed like all the teachers thought it would be a waste of time to learn MacOS because "Apple would be bankrupt soon". (Given how much all the app UIs changed, right decision for the wrong reason).

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ethanbond on Monday February 26, 2024 @01:36PM (#39515117)
All of these examples are end-products. "AI" itself will not be. The winner in AI will be whoever permeates other products/brands most successfully, and end-user brand familiarity doesn't matter much for that. Familiarity among engineering and product leaders is what matters.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by mitjam on Monday February 26, 2024 @02:50PM (#39516024)
Maybe, but maybe AI will become front and center of consumer and productivity IT products and their premier brand ambassadors will be anthropomorphized AI agents. Hello Clippy, this time for real.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Monday February 26, 2024 @02:27PM (#39515767)
Indeed, I'm not disagreeing on that, merely opining that "ChatGPT" as a name could well be relevant for a bit.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by YetAnotherNick on Monday February 26, 2024 @10:50AM (#39512646)
The thing is that there is almost no lock in in the models. So brand recognition doesn't help much as people look into the benchmarks and price sometime in the future, if not when just starting out.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by ben_w on Monday February 26, 2024 @12:50PM (#39514460)
Eh, all this talk of "moats" etc. feels weird when just a few years ago it seemed like everyone was complaining they'd rearranged their corporate structure to include a fully-owned profit-making subsidiary to attract investments, and all the loud voices seemed to think a cap of x100 return on investment was so large it was unlikely to be reached.

And then OpenAI tripped and fell over a magic money printing factory, and the complaints are now in the set ["it's just a stochastic parrot", "it's so good it's a professional threat to $category", "they've lobotomised it", "they don't have a moat", "they're too expensive"].

As the saying goes, "Prediction is very difficult, especially if it’s about the future!"

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by iambateman on Monday February 26, 2024 @10:50AM (#39512642)
I suppose they didn't but Microsoft has a $3T market cap and OpenAI is theoretically valued at $80B.

OpenAI has 700 people, Microsoft has 220,000 people.

OpenAI is strong but they're still dependent on MSFT.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by cuckatoo on Monday February 26, 2024 @11:03AM (#39512825)
MSFT needs companies like OpenAI to give Azure credits to for their valuation to continue soaring. The deferred revenue on their balance sheet from the unspent Azure credits they give as investment are worth much more to their market cap than $80B.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by jart on Monday February 26, 2024 @11:13AM (#39512978)
It sounds like they took the Federal Reserve's business model and applied it to computing.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by consumer451 on Monday February 26, 2024 @09:53AM (#39511888)
Just to play this out, what possible moves would OpenAI make at this point that they wouldn't have until this happened?

Altman is out there trying to raise ridiculous sums to get away from Azure, didn't he make the first move here?

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by bhouston on Monday February 26, 2024 @10:35AM (#39512454)
I think the main move would be some type of true AGI that leads to a hard takeoff scenario, but it isn't clear we are close to that or not.

Basically something that is more than just another bump in the scorecard for GPT 5 over GPT 4. Otherwise it is still just a horse race between relatively interchangeable GPT engines.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by yellow_postit on Monday February 26, 2024 @11:19AM (#39513073)
OpenAI will want to expand to all clouds to increase TAM.

Microsoft will want to avoid things regulators in the current regime will go after.

This seems like a step towards both and ultimately good for developers as it seems likely to bring costs down by increasing competition.

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by kibwen on Monday February 26, 2024 @09:55AM (#39511915)
There are no consequences for Microsoft. It owns a 49% stake in OpenAI, so the only action that OpenAI could take to hurt Microsoft would be to deliberately destroy its own value.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by karmasimida on Tuesday February 27, 2024 @02:10AM (#39521030)
They are under an exclusive contract with MSFT, they can't do anything.