News for hackers. Stuff that matters.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by jmathai on Saturday August 31, 2024 @02:26PM (#41410758)
Anyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
Re:Nearly half of Nvidia's revenue comes from four mystery w... by qwertox on Saturday August 31, 2024 @02:43PM (#41410883)
I doubt Anthropic builds their own GPU datacenter.

They might buy some, but I think that Google, Meta, Microsoft and Amazon and will be the ones buying in large batches to enable companies like Anthropic (and themselves) to scale up to world wide inferencing demands, as well as generally offering the most efficient GPUs to their customers.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by jmathai on Saturday August 31, 2024 @02:48PM (#41410926)
Think they're renting GPUs from the cloud providers?

Very plausible. I'm not sure at which point it makes economic sense to buy the GPUs and build out the infrastructure to continually be training something like Claude.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @02:54PM (#41410971)
> Think they're renting GPUs from the cloud providers

It's a major reason why they raised with Amazon [0]

There are actually a LOT of other large companies that participated in Anthropic's round but haven't announced it publicly.

[0] - https://www.aboutamazon.com/news/company-news/amazon-anthrop...

Re:Nearly half of Nvidia's revenue comes from four mystery w... by VirusNewbie on Saturday August 31, 2024 @03:51PM (#41411440)
They train on GCP now.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by bigyikes on Saturday August 31, 2024 @05:22PM (#41412109)
They also raised with Google, interestingly.

https://www.wsj.com/tech/ai/google-commits-2-billion-in-fund...

Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @07:23PM (#41412818)
Yep! You're right! I think they were initially using AWS though.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by spwa4 on Saturday August 31, 2024 @02:30PM (#41410791)
I think you should probably add all large cloud providers. Amazon and Microsoft should be in the list.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by azinman2 on Saturday August 31, 2024 @02:38PM (#41410845)
And we know OpenAI uses Microsoft for GPUs. My guess is Anthropic is similarly not owning their own data centers; didn’t they get a bunch of money from google? It’s probably being spent there.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by alephnerd on Saturday August 31, 2024 @03:00PM (#41411019)
They use AWS.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by VirusNewbie on Saturday August 31, 2024 @03:53PM (#41411463)
No they don’t.
Re:Nearly half of Nvidia's revenue comes from four mystery w... by azinman2 on Saturday August 31, 2024 @10:24PM (#41413710)
Care to substantiate?

According to Wikipedia:

In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month.

They probably use both. Almost certainly most of this is credits in their cloud platforms.

Re:Nearly half of Nvidia's revenue comes from four mystery w... by danjl on Saturday August 31, 2024 @03:40PM (#41411357)
Oh, I would not forget governments. The NSA basically paid for Kepler with a single purchase...