Ah, well today I learned about ECS. I guess we’ll migrate to that once I need to add complexity to our EKS setup.
I’m new to this stuff, so it’s hard to dig through all of the possible different solutions.
I looked into Ray a bit but it seemed a little too complicated vs. just running a CUDA accelerated docker container. Most of the streamlined solutions in this space are not made for full stack web developers deploying a service that happens to need a GPU. They’re for ML devs who are trying to own the production side of their part of the product.
I’m new to this stuff, so it’s hard to dig through all of the possible different solutions.
I looked into Ray a bit but it seemed a little too complicated vs. just running a CUDA accelerated docker container. Most of the streamlined solutions in this space are not made for full stack web developers deploying a service that happens to need a GPU. They’re for ML devs who are trying to own the production side of their part of the product.