Serving AI from the Basement – 192GB of VRAM Setup

Re:Serving AI from the Basement – 192GB of VRAM Setup by throwthrowuknow on Sunday September 08, 2024 @04:03PM (#41482757)

Not speaking from direct experience building a rig like this but the blog post mentions having 3 power supplies so the most direct solution would be to put each on their own dedicated circuit. As long as you have space in your electrical box this is straightforward to do though I would recommend having an electrician do the wiring if you aren’t experienced with that type of home electrical work.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by gizmo686 on Sunday September 08, 2024 @04:44PM (#41483043)

Even without space in the existing box, installing a subpanel isn't that much more of a cost.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by XMasterrrr on Monday September 09, 2024 @02:14AM (#41485902)

Actually, putting each PSU on its own circuit is crazy dangerous. In the scenario of your suggestion, if one goes out, you are in for a fire. Highly recommend against that.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by gizmo686 on Monday September 09, 2024 @02:56AM (#41486073)

This might be one of those reasons why I'm not an electritian, but is it dangerous.

Back when I worked at a high-availability data center, all of our servers had dual psus, plugged into seperate circuits.

The transformer in the PSUs should electrical isolate the mains voltage from the low voltage side, so you aren't going to cause a short across the two circuts.

The only risk I see is a cascade failure, where the increased load on the second circuit causes its breaker to trip.

[ Parent | on HN ]

Re:Serving AI from the Basement – 192GB of VRAM Setup by throwthrowuknow on Monday September 09, 2024 @06:44PM (#41495010)

Do they not have fuses? Use 15A breakers?

[ Parent | on HN ]