Show HN: Modelship – an open source ray backed model cluster
https://github.com/modelship-ai/modelship
Hey all, just wanted to share how my spare time has been spent for quite some time now.Ok, this one started oddly. My aim initially was just to serve multiple models on one GPU and fire it up in my unraid machine.By the time that first bit was done, I realised I could just add one more thing... and another... and well, from beginning of this year when, imho, AI became useful, the whole thing it...