Re:Introducing the TensorFlow Research Cloud
by jlebar on Wednesday May 17, 2017 @09:12PM
(#14364169)
A GPU is also comprised of multiple chips (RAM, etc). I don't think "performance per discrete piece of silicon" is an interesting metric.
[ Parent
| on HN ]
Re:Introducing the TensorFlow Research Cloud
by asdf_ on Wednesday May 17, 2017 @10:27PM
(#14364441)
A single V100 board is vastly smaller than a TPU module with 4 TPU chips.
The closest comparison in terms of size would be 1 Volta DGX-1 (8x V100s) compared to 2 TPU modules (8x TPU2 chips).
Volta DGX-1: https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
TPU Module: https://storage.googleapis.com/gweb-uniblog-publish-prod/ima...
And for completeness, this is the size of a single V100: https://cdn.arstechnica.net/wp-content/uploads/2017/05/34446...
You can see that 8x V100s are still more computationally dense than 8x TPU2 chips. Density is a very important factor in datacenter design.