News for hackers. Stuff that matters.

A comment on $2 H100s: How the GPU Rental Bubble Burst.

Re:$2 H100s: How the GPU Rental Bubble Burst by wg0 on Friday October 11, 2024 @03:13AM (#41807072)
> Collectively there are less than <50 teams worldwide who would be in the market for 16 nodes of H100s (or much more), at any point in time, to do foundation model training

At best 100 and this number will go down as many would fail to make money. Even traditional 100 software development companies would have a very low success rate and here we're talking about products that themselves work probabilistically all the way down.

[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Friday October 11, 2024 @03:44AM (#41807232)
Im quite sure there is more than a 100 clusters even. Though that would be harder to prove.

So yea, it would be rough

[ Parent | on HN ]