Serving AI from the Basement – 192GB of VRAM Setup

Re:Serving AI from the Basement – 192GB of VRAM Setup by NavinF on Sunday September 08, 2024 @03:16PM (#41482437)

You could power limit the 3090s to fit a standard 120V*20A = 2400W outlet if you really want to. The default power limit is 350W each so you'll only lose a little perf.

Also most rooms have multiple circuits. Just connect half the GPUs to each outlet. I already do this with my desktop PC because it has 2 PSUs.

Also most homes in the US have 30A*240V = 7200W dryer/stove outlets in the kitchen, laundry room, garage, etc. That's where you want to keep loud computers.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by jrflowers on Sunday September 08, 2024 @03:21PM (#41482480)

Brb replacing my stove with a bunch of GPUs

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by philsnow on Sunday September 08, 2024 @03:32PM (#41482559)

Easy-bake cryptominer

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by lvncelot on Sunday September 08, 2024 @03:28PM (#41482528)

Inference Oven

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by qingcharles on Sunday September 08, 2024 @04:28PM (#41482939)

You can cook on the GPUs from now on.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by Dylan16807 on Sunday September 08, 2024 @04:30PM (#41482960)

A standard outlet is 15A, and you're only allowed to use 80% continuously. So now you're dropping to 150W each.

Using two circuits is viable.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by NavinF on Sunday September 08, 2024 @06:13PM (#41483689)

In the bay area every home I've lived in had 20A circuits for everything.

The NEC 80% rule is only relevant in data centers where someone enforces it. The time-current curve for any 20A breaker shows that it will take infinite time to trip when you draw 20A. This is correct behavior because 12awg wire can handle 20A indefinitely

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by Dylan16807 on Sunday September 08, 2024 @06:21PM (#41483729)

Do they actually install the 20A outlets with the sideways part? I don't know if I've ever seen one in person.

I guess the outlet doesn't matter a whole lot, especially if you take multiple cables to the wall.

But I still don't want to be doing unenforced electrical violations.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by NavinF on Sunday September 08, 2024 @06:58PM (#41483966)

Some outlets have the 20A sideways part, but from a safety/code perspective that's irrelevant.

Consider what happens when you plug two 10A devices into a power strip. In the US there are no true 15A rated outlets. All outlets must handle 20A because the electrical code allows any outlet to be on a 20A breaker.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by Dylan16807 on Sunday September 08, 2024 @07:00PM (#41483978)

> Consider what happens when you plug two 10A devices into a power strip.

I don't know about any argument that depends on such an action being safe. There's plenty of power strips I wouldn't trust with 20 amps.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by NavinF on Sunday September 08, 2024 @07:10PM (#41484032)

That's just how the US electrical code works. I assure you that every "15A" outlet on the wall can handle 20A. That's why products like this don't have a fuse: https://www.homedepot.com/p/Woods-2-ft-12-3-SJTW-Multi-Outle...

[ Parent | on HN ]