News for hackers. Stuff that matters.
Re:Who uses Google TPUs for inference in production? by mrwilliamchang on Monday March 11, 2024 @06:12PM (#39673828)
To see memory consumption on the TPU while running on GKE you can look at kubernetes.io/node/accelerator/memory_used

https://cloud.google.com/kubernetes-engine/docs/how-to/tpus#...

There are no comments on this comment yet.