Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ...
by wongarsu on Monday July 31, 2023 @02:40PM
(#36946993)
$0.09 for the GPU alone. Add power for mainboard, RAM, and fans, efficiency loss at the power supply, networking, etc. After that another flat 30% for HVAC, since all that "consumed" electricity got turned into heat and the heat has to go somewhere.
And when we are talking about low margins, a 5-10% difference in cost is very significant.
And when we are talking about low margins, a 5-10% difference in cost is very significant.