News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by tasuki on Friday October 11, 2024 @08:10AM (#41808782)
> If you're trying to do the latter, you're not considering how you are risking your business on unreliable compute.

What do you mean by "risking your business on unreliable compute"? Is there a reason not to use one of these to train whatever neural nets one's business needs?

Re:$2 H100s: How the GPU Rental Bubble Burst by oefrha on Friday October 11, 2024 @08:33AM (#41808914)
Well, someone who’s building a GPU renting service right now obviously wants to scare you into using expensive and “reliable” services; the market crashing is disastrous for them. The reality is high price is hardly an indicator of reliability, and the article very clearly explains why H100 hours are being sold at $2 or less, and it’s not because of certain providers lacking reliability.
Re:$2 H100s: How the GPU Rental Bubble Burst by latchkey on Friday October 11, 2024 @05:46PM (#41814114)
Nah, don't be silly. No need to scare anyone into anything. Use whatever you want to use. My point in saying and of this is to simply point out that we offer this service to people who value these things.
Re:$2 H100s: How the GPU Rental Bubble Burst by lazide on Friday October 11, 2024 @08:45AM (#41808993)
If it crashes half way through, you don’t get a useful model, and you’re still on the hook for the rental costs to get there maybe?
Re:$2 H100s: How the GPU Rental Bubble Burst by latchkey on Friday October 11, 2024 @05:47PM (#41814124)
Depends on the SLA.
Re:$2 H100s: How the GPU Rental Bubble Burst by tasuki on Friday October 11, 2024 @09:58PM (#41815712)
That's... possible? But a little unlikely.

I think I'll take that risk over paying more for your allegedly more reliable GPUs anytime.