Re:Cloud TPU Pods Break AI Training Records
by boulos on Saturday July 13, 2019 @01:21PM
(#20429073)
Disclosure: I work on Google Cloud (even with Zak sometimes).
The DGX-2h is a beast! Don’t parse this as “huh, TPU Pods are about the same as just a few V100s”. The data sheet [1] is probably the easiest to follow, but their writeup is more informative [2].
These are souped up V100s, with awesome networking, which is pretty similar in style to a TPU Pod. So I’d say that they’re both purpose built systems for distributed ML training. The name for the NVIDIA system is even “DGX SuperPOD” :).
The DGX-2h is a beast! Don’t parse this as “huh, TPU Pods are about the same as just a few V100s”. The data sheet [1] is probably the easiest to follow, but their writeup is more informative [2].
These are souped up V100s, with awesome networking, which is pretty similar in style to a TPU Pod. So I’d say that they’re both purpose built systems for distributed ML training. The name for the NVIDIA system is even “DGX SuperPOD” :).
[1] https://www.nvidia.com/content/dam/en-zz/es_em/Solutions/Dat...
[2] https://devblogs.nvidia.com/dgx-superpod-world-record-superc...