News for hackers. Stuff that matters.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by ninetyninenine on Saturday August 31, 2024 @02:23PM (#41410739)
Let's name them, and why?
Re:Nearly half of Nvidia's revenue comes from four mystery w... by jmathai on Saturday August 31, 2024 @02:26PM (#41410758)
Anyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
Re:Nearly half of Nvidia's revenue comes from four mystery w... by qwertox on Saturday August 31, 2024 @02:43PM (#41410883)
I doubt Anthropic builds their own GPU datacenter.

They might buy some, but I think that Google, Meta, Microsoft and Amazon and will be the ones buying in large batches to enable companies like Anthropic (and themselves) to scale up to world wide inferencing demands, as well as generally offering the most efficient GPUs to their customers.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by jmathai on Saturday August 31, 2024 @02:48PM (#41410926)
Think they're renting GPUs from the cloud providers?

Very plausible. I'm not sure at which point it makes economic sense to buy the GPUs and build out the infrastructure to continually be training something like Claude.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @02:54PM (#41410971)
> Think they're renting GPUs from the cloud providers

It's a major reason why they raised with Amazon [0]

There are actually a LOT of other large companies that participated in Anthropic's round but haven't announced it publicly.

[0] - https://www.aboutamazon.com/news/company-news/amazon-anthrop...

Re:Nearly half of Nvidia's revenue comes from four mystery w... by VirusNewbie on Saturday August 31, 2024 @03:51PM (#41411440)
They train on GCP now.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by bigyikes on Saturday August 31, 2024 @05:22PM (#41412109)
They also raised with Google, interestingly.

https://www.wsj.com/tech/ai/google-commits-2-billion-in-fund...

Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @07:23PM (#41412818)
Yep! You're right! I think they were initially using AWS though.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by spwa4 on Saturday August 31, 2024 @02:30PM (#41410791)
I think you should probably add all large cloud providers. Amazon and Microsoft should be in the list.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by azinman2 on Saturday August 31, 2024 @02:38PM (#41410845)
And we know OpenAI uses Microsoft for GPUs. My guess is Anthropic is similarly not owning their own data centers; didn’t they get a bunch of money from google? It’s probably being spent there.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @03:00PM (#41411019)
They use AWS.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by VirusNewbie on Saturday August 31, 2024 @03:53PM (#41411463)
No they don’t.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by azinman2 on Saturday August 31, 2024 @10:24PM (#41413710)
Care to substantiate?

According to Wikipedia:

In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month.

They probably use both. Almost certainly most of this is credits in their cloud platforms.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by danjl on Saturday August 31, 2024 @03:40PM (#41411357)
Oh, I would not forget governments. The NSA basically paid for Kepler with a single purchase...
Re:Nearly half of Nvidia's revenue comes from four mystery w... by marcosdumay on Saturday August 31, 2024 @02:31PM (#41410798)
I believe the GP refers to Google, Facebook, Amazon and Microsoft.

And while yeah, that's probably them, I'd put a non-trivial chance of some government intelligence organization to make it into the top 3.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by miki123211 on Saturday August 31, 2024 @02:44PM (#41410889)
ANd possibly some less-known companies, as fronts for the Chinese.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @03:02PM (#41411043)
> less-known companies, as fronts for the Chinese.

Not at that size. That is VERY on the nose sanctions evasion.

Such sanctions evasions tend to use multiple smaller parties doing purchases and then reselling.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @03:00PM (#41411023)
> I'd put a non-trivial chance of some government intelligence organization to make it into the top 3

Most likely DoE. TLAs purchase indirectly (or use other federal agencies in the DoD as a front)

Re:Nearly half of Nvidia's revenue comes from four mystery w... by ghshephard on Saturday August 31, 2024 @02:40PM (#41410859)
I’m guessing a massive amount is for inference for whatsapp, and the original goal was making for relevant instagram - and of course the massive Llama model training - my guess is Facebook is a relatively small component of Meta’s overall use of GPUs. Feed recommendations? (unless you were using facebook as a holder for Meta?)
Re:Nearly half of Nvidia's revenue comes from four mystery w... by vineyardmike on Saturday August 31, 2024 @03:31PM (#41411277)
It’s absolutely not WhatsApp. It’s their recommendation engines. They’ve publicly stated they’re buying enough GPUs to have the spare capacity to train another “reels” sized product for when the opportunity emerges.

(They absolutely use it as a holder for Meta)