If you look at an image of a Cloud TPU board [0], I'm not sure how it would even work with off the shelf servers. It's 100% custom for a Google Datacenter.
Nvidia also has the full supply chain set up, as well as things like driver support and all the things required to sell this kind of complex physical hardware.
If you look at an image of a Cloud TPU board [0], I'm not sure how it would even work with off the shelf servers. It's 100% custom for a Google Datacenter.
Nvidia also has the full supply chain set up, as well as things like driver support and all the things required to sell this kind of complex physical hardware.
Google also has a program to give research scientists free access to TPUs: https://www.tensorflow.org/tfrc/
[0] https://storage.googleapis.com/gweb-uniblog-publish-prod/ima...
(I work on GCP, but not on ML and TPU stuff)