Re:Train TensorFlow models faster and at lower cost on Cloud...
by riku_iki on Wednesday December 12, 2018 @04:09PM
(#18667796)
Curious what will be the answer from Nvidia.
[ Parent
| on HN ]
Re:Train TensorFlow models faster and at lower cost on Cloud...
by david-gpu on Wednesday December 12, 2018 @04:27PM
(#18667903)
This is what NVidia says [0].
Notice how Google did not submit benchmark results for several tests.
[0] https://blogs.nvidia.com/blog/2018/12/12/record-breaking-mlp...
Re:Train TensorFlow models faster and at lower cost on Cloud...
by riku_iki on Wednesday December 12, 2018 @11:18PM
(#18669827)
NVidia won RESNET-50 benchmark with 80 nodes of DGX-1, curious if it is accessible in the cloud, and how much it will cost to rent it..
Re:Train TensorFlow models faster and at lower cost on Cloud...
by scottlegrand2 on Wednesday December 12, 2018 @07:37PM
(#18668942)
Indeed, all of this is but more examples of lies, damned lies, and benchmarks...
Re:Train TensorFlow models faster and at lower cost on Cloud...
by ianhowson on Wednesday December 12, 2018 @04:17PM
(#18667856)
> the largest Cloud TPU Pod configuration tested (256 chips) delivers a 200X speedup over an individual V100 GPU
So a Cloud TPU chip is slower than a V100 chip? Seems like that's the answer.
Re:Train TensorFlow models faster and at lower cost on Cloud...
by wskinner on Wednesday December 12, 2018 @04:56PM
(#18668093)
They seem roughly comprable. If you can get 85% scale out efficiency, based on the numbers in this post, 256 V100s would be at parity with 256 TPUs. In practice, you can get 90% scale out on Resnet with last year’s GPU and networking hardware. Network bandwidth is the bottleneck, and with better network hardware that could be improved. Maybe that’s why Google didn’t publish a benchmark for 256 V100s.
I’m also curious what the is the performance of the network interconnects in the TPU pod. I couldn’t find it documented, though I didn’t look super hard.
[1] https://github.com/uber/horovod/blob/master/docs/benchmarks....
Re:Train TensorFlow models faster and at lower cost on Cloud...
by KenoFischer on Wednesday December 12, 2018 @04:21PM
(#18667876)
Well, you lose some performance to distributed memory overhead of course, plus the TPU measure for that number is a previous generation TPU. The new ones are a decent bit faster. Plus you get four chips per "Cloud TPU". Putting all that together, TPUs are certainly a very competitive offering.
Re:Train TensorFlow models faster and at lower cost on Cloud...
by eanzenberg on Wednesday December 12, 2018 @04:16PM
(#18667849)
Their existing cards?