Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ...
by internetter on Tuesday January 21, 2025 @11:25PM
(#42788991)
Shouldn't there be a fear of obsolescence?
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ...
by HarHarVeryFunny on Tuesday January 21, 2025 @11:46PM
(#42789119)
It seems you'd need to figure periodic updates into the operating cost of a large cluster, as well as replacing failed GPUs - they only last a few years if run continuously.
I've read that some datacenters run mixed generation GPUs - just updating some at a time, but not sure if they all do that.
It'd be interesting to read something about how updates are typically managed/scheduled.
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ...
by anonzzzies on Wednesday January 22, 2025 @03:00AM
(#42790261)
Don't they say in the article that it is also for scaling up power and datacenters? That's the big cost here.
Re:Stargate Project: SoftBank, OpenAI, Oracle, MGX to build ...
by HarHarVeryFunny on Wednesday January 22, 2025 @07:47AM
(#42792222)
There's the servers and data center infrastructure (cooling, electricity) as well as the GPUs of course, but if we're talking $10B+ of GPUs in a single datacenter, it seems that would dominate. Electricity generation is also a big expense, and it seems nuclear is the most viable option although multi-GW solar plants are possible too in some locations. The 1GW ~ $10B number I suggested is in the right ballpark.
This sort of $100-500B budget doesn't sound like training cluster money, more like anticipating massive industry uptake and multiple datacenters running inference (with all of corporate America's data sitting in the cloud).