Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by zamadatix on Tuesday May 30, 2023 @11:48PM
(#36134256)
For a single Grace+Hopper node? I'd bet it fits in that budget, the Grace Hopper datasheet says the combo has a CPU + GPU + memory TDP of 450W - 1000W programmable, and that leaves more than half of the room for the rest of the node's power budget. For the DGX GH200? It's 18,432 CPU cores with 256 GPUs across 16 full racks of servers :p.
[ Parent
| on HN ]
There are no comments on this comment yet.