News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by cheschire on Friday October 11, 2024 @07:12AM (#41808406)
There is so much more to lifecycle sustainment cost than that.

Rackspace. Networking. Physical safety. Physical security. Sales staff. Support staff. Legal. Finance. HR. Support staff for those folks.

That’s just off the top of my head. Sitting down for a couple days at the very least, like a business should, would likely reveal significant depths that $2 won’t cover.

Re:$2 H100s: How the GPU Rental Bubble Burst by ericpauley on Friday October 11, 2024 @08:17AM (#41808829)
These are all costs of any server hosting business. Other commenters have already shown that $2/hr for a racked 1U server at 400W is perfectly sustainable.
Re:$2 H100s: How the GPU Rental Bubble Burst by dwattttt on Friday October 11, 2024 @06:14PM (#41814373)
Just because you have all of those costs already doesn't make them go away. If you're cross-subsidising the H100 access with the rest of a profitable business, that's a choice you can make, but it doesn't mean it's suddenly profitable at $2: you still need the profitable rest of the business in order to lose money here.
Re:$2 H100s: How the GPU Rental Bubble Burst by H8crilA on Friday October 11, 2024 @07:35AM (#41808537)
So you terminate all of the above right now, or continue selling at a loss (which still extends the runway) and wait for better times? Also, do you know that similar situations occasionally occur in pretty much any market out there?

The market doesn't care how much you're losing, it will set a price and it's up to you to take it, or leave it.