News for hackers. Stuff that matters.
Re:So Who Is Building That 100k GPU Cluster for XAI? by echelon on Sunday August 04, 2024 @09:46AM (#41153502)
Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest. He was given all the money he needs to catch up and then some.

It doesn't look like there are any moats to speak of.

Re:So Who Is Building That 100k GPU Cluster for XAI? by Havoc on Sunday August 04, 2024 @09:54AM (#41153563)
>Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest.

With a 100k GPUs? I think not.

Nvidia shipped 150k+ to both meta and MS each JUST in 2023:

https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...

Certainly puts him in the running though

Re:So Who Is Building That 100k GPU Cluster for XAI? by rbanffy on Sunday August 04, 2024 @04:40PM (#41156184)
They also have the Dojo wafer-scale chips. A different process from the Cerebras one - this is more like a wafer sized interposer with large chipsets. Still pretty cool.