Re:dstack (K8s alternative) adds support for AMD accelerator...
by cheptsov on Wednesday August 21, 2024 @12:39PM
(#41311907)
Hi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
[ Parent
| on HN ]
Re:dstack (K8s alternative) adds support for AMD accelerator...
by abusaidm on Thursday August 22, 2024 @05:50AM
(#41318425)
I think framing it as being able to run LLMs with ease and portability across machines and hardware is an amazing sell. Most guides are very technical and detailed that it’s a barrier for many to self host.