News for hackers. Stuff that matters.
Re:GPU utilization is a misleading metric by aabhay on Friday August 23, 2024 @12:49PM (#41330583)
Power usage is indeed a better representation of GPU utilization during ML training. It has the advantage of combining many important indirect signals that aren’t visible, and avoids many downfalls of compute usage, which can go to 100% even in all-reduce deadlocks, among other scenarios.

There are no comments on this comment yet.