News for hackers. Stuff that matters.

A comment on Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups. Parent comment

Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by version_five on Sunday July 30, 2023 @08:09PM (#36937429)
FWIW I tired to look up some numbers, i found California "industrial" electricity at $0.18/Kwh https://www.eia.gov/electricity/monthly/epm_table_grapher.ph... and H100s using 300-700w https://www.nvidia.com/en-us/data-center/h100/ which implies a worst case marginal cost of .18*.7 = $.126 / gpu / hour. Looks like Montana is cheapest at ~$.05 / kwh which would bring that down to $.035. So there may be about a $0.09 California premium (vs the absolute cheapest possibility), which as you say is a small amount of the total cost, but could be material for large workloads.
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jedberg on Sunday July 30, 2023 @08:49PM (#36937702)
Retail residential power in the city of Santa Clara is $0.15/KwH, I'm sure commercial could be less. Especially if you throw some solar panels on the roof.

The most expensive part would be the land, but honestly there is some pretty cheap land outside the cities.

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by fragmede on Monday July 31, 2023 @01:42AM (#36939177)
For reference, I'm in SF and paid PGE $0.50938/KWh during peak hours, residential, last bill.
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jedberg on Monday July 31, 2023 @08:36PM (#36950856)
Yes, Santa Clara has their own non-profit power company so their rates are way less than PG&E
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by ec109685 on Monday July 31, 2023 @11:26AM (#36944051)
Meanwhile, AWS is charging $8 an hour for their top of the line gpu server.
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by wongarsu on Monday July 31, 2023 @02:40PM (#36946993)
$0.09 for the GPU alone. Add power for mainboard, RAM, and fans, efficiency loss at the power supply, networking, etc. After that another flat 30% for HVAC, since all that "consumed" electricity got turned into heat and the heat has to go somewhere.

And when we are talking about low margins, a 5-10% difference in cost is very significant.

[ Parent | on HN ]