Re:Who uses Google TPUs for inference in production?
by amelius on Monday March 11, 2024 @03:16PM
(#39672212)
Or maybe they are just using nVidia. Who knows ...
[ Parent
| on HN ]
Re:Who uses Google TPUs for inference in production?
by vineyardmike on Monday March 11, 2024 @03:51PM
(#39672526)
Beyond the fact that this is hardly a secret, there’s lots of other signs.
1. They have bought far less from NVidia than other hyper scalers, and they literally can’t vomit without saying “AI”. They have to be running those models on something. They have purchased huge amounts of chips from fabs, and what else would that be?
2. They have said they use them. Should be pretty obvious here.
3. They maintain a whole software stack for them, they design the chips, etc. Then they don’t really try to sell the TPU. Why else would they do this?
Re:Who uses Google TPUs for inference in production?
by jeffbee on Monday March 11, 2024 @05:06PM
(#39673231)
They have announced publicly using TPUs for inference, as far back as 2016. They did not offer TPUs for Cloud customers until 2017. The development is clearly driven by internal use cases. One of the features they publicly disclosed as TPU-based was Smart Reply and that launched in 2015. So their internal use of TPUs for inference goes back nearly a decade.