Re:Enabling next-generation AI workloads: Announcing TPU v5p...
by freedomben on Wednesday December 06, 2023 @01:21PM
(#38547604)
I'm not GP but have been in this boat. We tried a number of different approaches, and kubernetes was by far the most successful. Terraform to provision the k8s clusters, workloads deployed to k8s. With OpenShift it gets even better, though I left the project before we finished implementation so I can't say how it went in prod. Early tests were very good though. If you're feeling bold you can do a "stretch" cluster which has nodes in different data centers (some on-prem for example, some in the cloud, or all in the cloud but different zones). The latency between the masters and nodes can cause problems though so I wouldn't separate them geographically very far.
[ Parent
| on HN ]
There are no comments on this comment yet.