Re:$2 H100s: How the GPU Rental Bubble Burst
by zaptrem on Friday October 11, 2024 @05:33AM
(#41807865)
As someone who has done a bunch of large scale ML on hyperscaler hardware I will say the uptime is nowhere near 99.9999%. Given a cluster of only a few hundred GPUs one or multiple failures is a near certainty to the point where we spend a bunch of time on recovery time optimization.
[ Parent
| on HN ]
There are no comments on this comment yet.