Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by bigmattystyles on Tuesday May 30, 2023 @11:28PM
(#36134168)
I wonder if you can even run this on a regular 20A circuit - I'm thinking no - 20 * 120 = 2400 Watts - I assume that will not be enough...
[ Parent
| on HN ]
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by zamadatix on Tuesday May 30, 2023 @11:48PM
(#36134256)
For a single Grace+Hopper node? I'd bet it fits in that budget, the Grace Hopper datasheet says the combo has a CPU + GPU + memory TDP of 450W - 1000W programmable, and that leaves more than half of the room for the rest of the node's power budget. For the DGX GH200? It's 18,432 CPU cores with 256 GPUs across 16 full racks of servers :p.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by jeffnappi on Wednesday May 31, 2023 @12:28AM
(#36134465)
Here's an example of an 8x H100 machine - look at the tech specs: https://lambdalabs.com/deep-learning/servers/hyperplane
6x 3000W PSUs in a 3x3 redundant config. So 9000 watts total. So at least 240v x 50A. x2 for redundancy.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by mattlondon on Wednesday May 31, 2023 @01:38AM
(#36134853)
My hob in my kitchen is 7.3kw? Normal 32a * 240 circuit allows up to 7.68kw, and the 6mm^2 cable is rated to something like 45amps
This seems fairly common e.g. https://www.currys.co.uk/products/aeg-ikb64401fb-59-cm-elect...
I am sure data centers have larger circuit breakers and chunkier cables than my kitchen appliances!
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by throwaway2037 on Wednesday May 31, 2023 @04:04AM
(#36135744)
Woah, I looked at the specs:
Front left: 2.3 kW / 3.7 kW
Cripes. You can boil water extremely fast on that IH setup! I'm living with 1.5 kW, and it is painful...
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by Bedon292 on Wednesday May 31, 2023 @09:59AM
(#36138508)
When we first got our induction cooktop I was so excited about how ridiculously fast we could boil water. Which is definitely an odd thing to get excited about. It definitely isn't that powerful though. That's a lot of power.