News for hackers. Stuff that matters.
Re:Serving AI from the Basement – 192GB of VRAM Setup by nullindividual on Sunday September 08, 2024 @02:35PM (#41482157)
Do you run this 24/7?

What is your cost of electricity per kilowatt hour and what is the cost of this setup per month?

Re:Serving AI from the Basement – 192GB of VRAM Setup by michaelt on Sunday September 08, 2024 @03:28PM (#41482535)
I have a much smaller setup than the author - a quarter the GPUs and RAM - and I was surprised to find it draws 300W at idle
Re:Serving AI from the Basement – 192GB of VRAM Setup by nullindividual on Sunday September 08, 2024 @03:38PM (#41482590)
The reason I asked is I used to run a dual X5650 server with SSDs and it was about $50/month with the cheapest (or very close to) rates in the US.
Re:Serving AI from the Basement – 192GB of VRAM Setup by disiplus on Sunday September 08, 2024 @05:55PM (#41483565)
We have more expensive gas then usa, but i pay like a 5 cent per kwh @220V

Did not know how expensive it is in usa, especially California.

Re:Serving AI from the Basement – 192GB of VRAM Setup by rootusrootus on Sunday September 08, 2024 @07:26PM (#41484135)
US generally has some of the cheapest electricity, about half of what Europeans pay. California has some areas that are abnormally expensive.
Re:Serving AI from the Basement – 192GB of VRAM Setup by nullindividual on Sunday September 08, 2024 @07:10PM (#41484034)
I pay 10 cents per KWH. Most of the electricity in my state is produced by hydropower.
Re:Serving AI from the Basement – 192GB of VRAM Setup by fuzzybear3965 on Sunday September 08, 2024 @06:30PM (#41483783)
Yep. ~$.33/kWh in Southern California (SoCal Edison) and going up all the time!
Re:Serving AI from the Basement – 192GB of VRAM Setup by fragmede on Sunday September 08, 2024 @06:49PM (#41483908)
$0.51/KwH during peek hours in San Francisco!
Re:Serving AI from the Basement – 192GB of VRAM Setup by nirav72 on Sunday September 08, 2024 @11:01PM (#41485103)
Depends on where you live in the U.S. On the west coast, you’ll definitely pay 2x the national average. I live in the south-eastern part of the U.S and electricity is quite a bit cheaper at 12 cents/kwh. But even here it varies by region in my state of Georgia. Down the road where I have friends and family , they get power from a different provider. Their cost are much higher. But they also have flexible pricing. Such as at night they pay a fraction of their day time rates. From 17 cents to 3 cents. While I have a fixed rate 24/7. Which is cheaper than their day time rates.
Re:Serving AI from the Basement – 192GB of VRAM Setup by trollbridge on Sunday September 08, 2024 @05:13PM (#41483259)
This is a setup that might make more sense to run at full power during winter months.