News for hackers. Stuff that matters.
Re:Who uses Google TPUs for inference in production? by danjl on Monday March 11, 2024 @03:51PM (#39672521)
I would guess that Google's vertexAI managed solution uses TPUs. Also Google uses them internally to train and infer for all their research products.
Re:Who uses Google TPUs for inference in production? by michaelt on Monday March 11, 2024 @03:56PM (#39672585)
While you can use TPUs with vertexai, it's just virtual machines - you can have one with an nvidia card if you like.
Re:Who uses Google TPUs for inference in production? by sciencesama on Monday March 11, 2024 @03:51PM (#39672538)
80 to 90% are consumed internally !! Only from version 5 it is planned to be customer focussed !!