News for hackers. Stuff that matters.
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ... by HarHarVeryFunny on Tuesday January 21, 2025 @07:37PM (#42787202)
Largest GPU cluster at the moment is X.ai's 100K H100's which is ~$2.5B worth of GPUs. So, something 10x bigger (1M GPUs) is $25B, and add $10B for 1GW nuclear reactor.

This sort of $100-500B budget doesn't sound like training cluster money, more like anticipating massive industry uptake and multiple datacenters running inference (with all of corporate America's data sitting in the cloud).

Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ... by internetter on Tuesday January 21, 2025 @11:25PM (#42788991)
Shouldn't there be a fear of obsolescence?
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ... by HarHarVeryFunny on Tuesday January 21, 2025 @11:46PM (#42789119)
It seems you'd need to figure periodic updates into the operating cost of a large cluster, as well as replacing failed GPUs - they only last a few years if run continuously.

I've read that some datacenters run mixed generation GPUs - just updating some at a time, but not sure if they all do that.

It'd be interesting to read something about how updates are typically managed/scheduled.

Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ... by anonzzzies on Wednesday January 22, 2025 @03:00AM (#42790261)
Don't they say in the article that it is also for scaling up power and datacenters? That's the big cost here.
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ... by HarHarVeryFunny on Wednesday January 22, 2025 @07:47AM (#42792222)
There's the servers and data center infrastructure (cooling, electricity) as well as the GPUs of course, but if we're talking $10B+ of GPUs in a single datacenter, it seems that would dominate. Electricity generation is also a big expense, and it seems nuclear is the most viable option although multi-GW solar plants are possible too in some locations. The 1GW ~ $10B number I suggested is in the right ballpark.