I thought the comparison of 1 second of computation today to the lifetime computation of older computers (since they were released) was clever.

This post states, "In order to take full advantage of the NVIDIA Tesla V100 GPUs and the Tensor cores, you will need to use CUDA 9 and cuDNN7." What version of TensorFlow does it use? From what I can tell, TensorFlow doesn't fully support the latest versions yet.

You can use the new AWS Deep Learning AMI which has a version of TensorFlow enhanced for CUDA 9 and Volta support https://aws.amazon.com/blogs/ai/announcing-new-aws-deep-lear...

Chris from NV here. You can also get a full compliment of DL framework containers, as well as CUDA 9/CuDNN 7/NCCL 2 base container, optimized for Volta by NVIDIA via this AMI https://aws.amazon.com/marketplace/pp/B076K31M1S?qid=1509089...

Are there any frameworks yet supporting the advertised 120 TFLOPs mixed precision training?

TF 1.4 does, but you need to build it yourself. RC1 is out:

https://github.com/tensorflow/tensorflow/releases/tag/v1.4.0...

  All our prebuilt binaries have been built with CUDA 8 and cuDNN 6.
  We anticipate releasing TensorFlow 1.5 with CUDA 9 and cuDNN 7.

Thanks Jeff, I forwarded your blog post to our Chief Scientist.