Re:Analyzing the performance of Tensorflow training on M1 Ma...
by tbalsam on Thursday January 14, 2021 @12:28PM
(#25779240)
MV2 is memory-limited, the depthwise + groups + 1x1 convs has a long launch time on GPU. Shattered kernels are fine for CPU, but not for GPU.
Though per your note on the scales, that's really interesting empirical results. I'll have to look into that, thanks for passing that along.
It's pretty surprising to me that an M1 performs anywhere near a V100 on model training and I guess the most striking thing is the energy efficiency of the M1.