Re:Serving AI from the Basement – 192GB of VRAM Setup
by michaelt on Sunday September 08, 2024 @03:28PM
(#41482535)
I have a much smaller setup than the author - a quarter the GPUs and RAM - and I was surprised to find it draws 300W at idle
Re:Serving AI from the Basement – 192GB of VRAM Setup
by nullindividual on Sunday September 08, 2024 @03:38PM
(#41482590)
The reason I asked is I used to run a dual X5650 server with SSDs and it was about $50/month with the cheapest (or very close to) rates in the US.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by disiplus on Sunday September 08, 2024 @05:55PM
(#41483565)
We have more expensive gas then usa, but i pay like a 5 cent per kwh @220V
Did not know how expensive it is in usa, especially California.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by rootusrootus on Sunday September 08, 2024 @07:26PM
(#41484135)
US generally has some of the cheapest electricity, about half of what Europeans pay. California has some areas that are abnormally expensive.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by nullindividual on Sunday September 08, 2024 @07:10PM
(#41484034)
I pay 10 cents per KWH. Most of the electricity in my state is produced by hydropower.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by fuzzybear3965 on Sunday September 08, 2024 @06:30PM
(#41483783)
Yep. ~$.33/kWh in Southern California (SoCal Edison) and going up all the time!
Re:Serving AI from the Basement – 192GB of VRAM Setup
by fragmede on Sunday September 08, 2024 @06:49PM
(#41483908)
$0.51/KwH during peek hours in San Francisco!
Re:Serving AI from the Basement – 192GB of VRAM Setup
by nirav72 on Sunday September 08, 2024 @11:01PM
(#41485103)
Depends on where you live in the U.S. On the west coast, you’ll definitely pay 2x the national average. I live in the south-eastern part of the U.S and electricity is quite a bit cheaper at 12 cents/kwh. But even here it varies by region in my state of Georgia. Down the road where I have friends and family , they get power from a different provider. Their cost are much higher. But they also have flexible pricing. Such as at night they pay a fraction of their day time rates. From 17 cents to 3 cents. While I have a fixed rate 24/7. Which is cheaper than their day time rates.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by trollbridge on Sunday September 08, 2024 @05:13PM
(#41483259)
This is a setup that might make more sense to run at full power during winter months.
What is your cost of electricity per kilowatt hour and what is the cost of this setup per month?