Analyzing the performance of Tensorflow training on M1 Mac Mini and Nvidia V100

Re:Analyzing the performance of Tensorflow training on M1 Ma... by fxtentacle on Thursday January 14, 2021 @06:14AM (#25774996)

For my workload (optical flow) I was honestly surprised to see that the Google Cloud V100 was not faster than my local GTX 1080. So I guess that varies a lot by how you're training, too.

For many of my AI training workloads, already the 1080 is "fast enough" and the CPU or SSDs are the bottleneck. In that case, GPU doesn't really matter that much.

[ Parent | on HN ]

Re:Analyzing the performance of Tensorflow training on M1 Ma... by spi on Thursday January 14, 2021 @07:12AM (#25775453)

Yes that might be the case. In my case I mostly trained big (tens to hundreds of millions of parameters) networks mostly made of 3x3 convolutions, and I think the V100 has dedicated hardware for that. Then as I mentioned you can get a further 2x speedup by using half precision.

If you train smaller models, or RNN, you probably lose most of the gains of dedicated hardware. But I guess that for this same reason the experiments in the article are little more than a provocation, I don't know if you could train a big network in finite time on M1 chips...

That said, of course, if the budget was mine, I wouldn't buy a V100 :-)

[ Parent | on HN ]