Yes I can say it is a lot cheaper. That is what this article is all about.
You can do about twice the images per dollar using the TPUs with GCP versus using Nvidia with AWS.
Or what am I missing?
BTW, Google has released to the general public. What are you talking about?
"Google’s AI chips are now open for public use"
https://venturebeat.com/2018/02/12/googles-ai-chips-are-now-...
It is a lot of work. But mainly that TPUv1 only did inference while TPUv2 does training+inference.
Here we can see the results where the Google TPU gets almost twice result per dollar over Nvidia. But then Google should be able to iterate more quickly.
Take the move from using CNN to using capsule networks. The idea for Capsules came from Hinton and Google is going to be there first to optimize in hardware. This is the benefit of playing in all layers of the stack.
Or the using NN for text to speech and offering at scale. Google just has inherent advantages over Nvidia and now we get to see a little more concrete results. But hope we get a lot more similar and see if the Google advantage holds up.