Re:Who uses Google TPUs for inference in production?
by danjl on Monday March 11, 2024 @03:51PM
(#39672521)
I would guess that Google's vertexAI managed solution uses TPUs. Also Google uses them internally to train and infer for all their research products.
[ Parent
| on HN ]
Re:Who uses Google TPUs for inference in production?
by michaelt on Monday March 11, 2024 @03:56PM
(#39672585)
While you can use TPUs with vertexai, it's just virtual machines - you can have one with an nvidia card if you like.
Re:Who uses Google TPUs for inference in production?
by sciencesama on Monday March 11, 2024 @03:51PM
(#39672538)
80 to 90% are consumed internally !! Only from version 5 it is planned to be customer focussed !!