News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by bugbuddy on Thursday October 10, 2024 @11:18PM (#41805675)
At $2 per hour, factoring in the overall hardware cost, labor, electricity, and other sunk costs like floor space and bandwidth, how many total hours does it take to break even?

What is the expected hardware operation lifespan in hours of this system?

How much would the hardware cost have to drop for the economic of $2/hour to work?

Re:$2 H100s: How the GPU Rental Bubble Burst by hislaziness on Thursday October 10, 2024 @11:57PM (#41805949)
The details are in the article. They have done the math.
Re:$2 H100s: How the GPU Rental Bubble Burst by bugbuddy on Friday October 11, 2024 @12:12AM (#41806043)
There was no answer to my last question which I think is the most important thing when considering if we are going to have another GFC this year or next year.
Re:$2 H100s: How the GPU Rental Bubble Burst by rsynnott on Friday October 11, 2024 @08:18AM (#41808833)
Does "GFC" stand for "global financial crisis" here? It seems implausible that the collapse of the LLM bubble will cause one; it might have a pretty dramatic impact on the markets, but it's unclear how it would cause the sort of systemic failure that we saw in the noughties.
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Friday October 11, 2024 @02:08AM (#41806680)
You could technically break even at $2, assuming 100% allocation, and cheap electricity.

But reality is not 100%, so I would argue at-least 25% or even 50% drop in the H100 price (approx 50k each, after factoring other overheads)

Re:$2 H100s: How the GPU Rental Bubble Burst by latchkey on Friday October 11, 2024 @03:28AM (#41807154)
> What is the expected hardware operation lifespan in hours of this system?

Better question: what support contract does the provider have with their manufacturers? For example, we buy Dell pro support 3 year next business day contracts on all of our gear.