Re:$2 H100s: How the GPU Rental Bubble Burst
by hislaziness on Thursday October 10, 2024 @11:57PM
(#41805949)
The details are in the article. They have done the math.
Re:$2 H100s: How the GPU Rental Bubble Burst
by bugbuddy on Friday October 11, 2024 @12:12AM
(#41806043)
There was no answer to my last question which I think is the most important thing when considering if we are going to have another GFC this year or next year.
Re:$2 H100s: How the GPU Rental Bubble Burst
by rsynnott on Friday October 11, 2024 @08:18AM
(#41808833)
Does "GFC" stand for "global financial crisis" here? It seems implausible that the collapse of the LLM bubble will cause one; it might have a pretty dramatic impact on the markets, but it's unclear how it would cause the sort of systemic failure that we saw in the noughties.
Re:$2 H100s: How the GPU Rental Bubble Burst
by pico_creator on Friday October 11, 2024 @02:08AM
(#41806680)
You could technically break even at $2, assuming 100% allocation, and cheap electricity.
But reality is not 100%, so I would argue at-least 25% or even 50% drop in the H100 price (approx 50k each, after factoring other overheads)
Re:$2 H100s: How the GPU Rental Bubble Burst
by latchkey on Friday October 11, 2024 @03:28AM
(#41807154)
> What is the expected hardware operation lifespan in hours of this system?
Better question: what support contract does the provider have with their manufacturers? For example, we buy Dell pro support 3 year next business day contracts on all of our gear.
What is the expected hardware operation lifespan in hours of this system?
How much would the hardware cost have to drop for the economic of $2/hour to work?