nellydpa7
Re:Powering cost-efficient AI inference at scale with Cloud TPU v5e on...
on Tuesday November 28, 2023 @09:05PM (#38454546)
The demo is really compelling. Using GKE or k8s sounds like a good idea for hosting LLMs, making them perform better and less costly overall. Not bad at all.