News for hackers. Stuff that matters.
Re:Efficient GPU Usage in Cloud Services: Is Pay-per-Use Fea... by billconan on Monday April 29, 2024 @01:51PM (#40201632)
I think https://docs.ray.io/en/latest/index.html is a good solution? basically debug locally, execute remotely?
Re:Efficient GPU Usage in Cloud Services: Is Pay-per-Use Fea... by graphllama on Monday April 29, 2024 @03:01PM (#40202490)
Interesting! However this comes with the overhead of having to modify your code to adhere to the framework right? I was looking for a solution more along the lines of paying for the GPU when a task is actually scheduled or running on it rather than paying all the time when the VM is turned on. Basically a serverless GPU sort of a solution?