No conspiracy here, we were simply late to market on the V100 Beta. As many have noted, we also hold a really high reliability bar before going to Beta (“Google’s Beta is like AWS’s GA” though I wouldn’t claim that in all cases) and we’ve be in Alpha for months. If you’d like to be included in Alpha offerings drop us a line.
As I’ve said in previous threads: Compute Engine intends to be the best place for computing. That includes the kind of workloads TPUs are tuned for, but it also includes all the stuff that GPUs excel at. That’s not going away, and GCE isn’t favoring one over the other. We sell infrastructure, and we don’t try to (overtly) pick favorites, we let our customers do that.
Wow, that's so ... I don't even have a word for it.
It is like how they ported to Power for their stuff if needed.
Look at the shortage of late with Nvidia. Google does not have to deal with it.
But also I suspect they could not do WaveNet without their own silicon as the cost would be prohibitive. Using a NN for speech and competing against traditional approaches and have a competitive price is going to require really efficient silicon.
GPU shortage equals four-month wait time for buyers"
https://www.theregister.co.uk/2018/03/30/nvidia_geforce_chip...
But you are missing my point. Google is not dependent on Nvidia.
Really does not look like Nvidia could do what they need anyway. Doing their new text to speech on Nvidia I would not expect to have a price point to make viable.
Please show me an article where there's a shortage of Tesla cards.
But really now it is just Nvidia does not have the ability to meet Google's needs.
I am not aware of anything from Nvidia that could do 16k cycles through a NN in real-time at a cost that you could roll out at scale.
Google priced WaveNet competitively to the old way of doing. You can only do that with a very low cost for computation and the power required which Nvidia could not match with the TPU 1.0 let alone now they have the 3.0.
Plus could they do the new text to speech at a competitive price using Nvidia Silicon?
Google approach gets you a better result but the computational requirements would be huge compared to the traditional approach. You have to get the compute cost down as far as you can.