News for hackers. Stuff that matters.
Re:Google Services Experiencing Disruptions by sillysaurusx on Friday September 25, 2020 @03:41AM (#24587523)
You're almost certainly using the TPUs wrong. It's very easy to use them wrong, unfortunately.

When you use them right, a TPUv3-8 gets equivalent perf to a cluster of 8 V100s.

I was astounded. I trained StyleGAN 2 from scratch at 1024x1024 in 2.5 days. nvidia took 7 days for their official model. Granted, I used a v3-32, not a v3-8, but performance seems pretty similar.

There are no comments on this comment yet.