News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by zaptrem on Friday October 11, 2024 @05:33AM (#41807865)
As someone who has done a bunch of large scale ML on hyperscaler hardware I will say the uptime is nowhere near 99.9999%. Given a cluster of only a few hundred GPUs one or multiple failures is a near certainty to the point where we spend a bunch of time on recovery time optimization.

There are no comments on this comment yet.