Re:RTX 4090 review: Spend at least $1,599 for Nvidia’s bigge...
by ftufek on Tuesday October 11, 2022 @11:51AM
(#33164864)
Just set the required/requested gpu number to 0 and k8s will let you use same gpu with multiple pods.
You'll need to make sure to not overload gpu mem, otherwise you'll get oom errors. You can use k8s patch functionality to add custom resources, essentially use that to represent gpu mem and include the amount of gpu the pod uses in its definition, that way you don't go over the limit.
You'll need to make sure to not overload gpu mem, otherwise you'll get oom errors. You can use k8s patch functionality to add custom resources, essentially use that to represent gpu mem and include the amount of gpu the pod uses in its definition, that way you don't go over the limit.