News for hackers. Stuff that matters.

asdf_

Re:Introducing the TensorFlow Research Cloud on Thursday May 18, 2017 @12:25PM (#14368559)
Sure, no argument there. For Google, producing and using TPUs, is probably cheaper than buying nvidia hardware.
Re:Introducing the TensorFlow Research Cloud on Thursday May 18, 2017 @09:40AM (#14367078)
The interconnect hardware is present on the dgx-1 board.

The point of my previous comment is that it doesn't make sense to compare an entire TPU module (containing 4x TPUs) to a V100 board.

The closest comparison to a TPU module (with 4x TPUs) would be a dgx-1 board, which contains the nvlink bus that you mention, but also contains 8x V100 boards, hence why in my previous post I said you should compare the compute performance of a Volta DGX-1 (8x V100s) to 2 TPU modules (8x TPUs).

At the end of the day, it is simple, in a given area of space, you can get more compute performance from provisioning that area with V100s (in the form of using dgx-1s) versus provisioning it with TPUs (in the form of using TPU modules).

Re:Introducing the TensorFlow Research Cloud on Wednesday May 17, 2017 @10:27PM (#14364441)
A single V100 board is vastly smaller than a TPU module with 4 TPU chips.

The closest comparison in terms of size would be 1 Volta DGX-1 (8x V100s) compared to 2 TPU modules (8x TPU2 chips).

Volta DGX-1: https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...

TPU Module: https://storage.googleapis.com/gweb-uniblog-publish-prod/ima...

And for completeness, this is the size of a single V100: https://cdn.arstechnica.net/wp-content/uploads/2017/05/34446...

You can see that 8x V100s are still more computationally dense than 8x TPU2 chips. Density is a very important factor in datacenter design.

Re:Introducing the TensorFlow Research Cloud on Wednesday May 17, 2017 @10:25PM (#14364432)
A single V100 board is vastly smaller than a TPU module with 4 TPU chips.

The closest comparison in terms of size would be 1 Volta DGX-1 (8x V100s) compared to 2 TPU modules (8x TPU2 chips).

Volta DGX-1: https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...

TPU Module: https://storage.googleapis.com/gweb-uniblog-publish-prod/ima...

And for completeness, this is the size of a single V100: https://cdn.arstechnica.net/wp-content/uploads/2017/05/34446...

You can see that 8x V100s are still more computationally dense than 8x TPU2 chips. Density is a very important factor in datacenter design.

Re:Google AI Cloud TPUs on Wednesday May 17, 2017 @06:48PM (#14363472)
A single chip is only 45 TFLOPS. It is 180 TFLOPs per module (4x TPU chips): https://arstechnica.com/information-technology/2017/05/googl...
Re:Introducing the TensorFlow Research Cloud on Wednesday May 17, 2017 @06:21PM (#14363337)
Google's 180 teraflop number is for a module, which contains 4 TPU chips. Meaning each TPU is 45 teraflops. See: https://arstechnica.com/information-technology/2017/05/googl...
Re:Introducing the TensorFlow Research Cloud on Wednesday May 17, 2017 @06:17PM (#14363318)
It is actually 45 teraflops per TPU2 chip and 180 teraflops for a module (4x chips): https://arstechnica.com/information-technology/2017/05/googl...

V100 is 120 teraflops of tensor ops per chip: https://arstechnica.com/gadgets/2017/05/nvidia-tesla-v100-gp...