News for hackers. Stuff that matters.

A comment on GPU utilization is a misleading metric.

Re:GPU utilization is a misleading metric by ScoutOrgo on Friday August 23, 2024 @10:27AM (#41329322)
As someone that is familiar with using nvidia-smi to track util, what are some commands people use to track the SM efficiency? The end of the article had some references, but no examples of what to use explicitly.
[ Parent | on HN ]
Re:GPU utilization is a misleading metric by roanakb on Friday August 23, 2024 @02:34PM (#41331701)
Unfortunately, SM efficiency is not accessible via nvidia-smi. The best methods to track it would be to:

1. Profile your model with Pytorch Profiler 2. Export metrics with Nvidia DCGM

[ Parent | on HN ]