Re:So Who Is Building That 100k GPU Cluster for XAI?
by rbanffy on Sunday August 04, 2024 @04:40PM
(#41156184)
They also have the Dojo wafer-scale chips. A different process from the Cerebras one - this is more like a wafer sized interposer with large chipsets. Still pretty cool.
With a 100k GPUs? I think not.
Nvidia shipped 150k+ to both meta and MS each JUST in 2023:
https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...
Certainly puts him in the running though