Re:Show HN: Graphsignal – ML profiler to speed up training a...
by p1esk on Tuesday July 05, 2022 @01:16PM
(#31990954)
Yes, I thought about it - in theory I can measure the total traffic with mpirun, then substract nvlink traffic (as measured by nvidia-smi) from it. However I'm not 100% sure that the nvlink traffic from nvidia-smi is the same as the nvlink traffic component of the mpirun. I'd prefer to measure internode traffic directly (e.g. using Mellanox tools) as a more reliable method.
[ Parent
| on HN ]
There are no comments on this comment yet.