Re:Show HN: TensorDock – GPU Cloud Marketplace, H100s from $...
by jonathanlei on Wednesday May 01, 2024 @01:01PM
(#40226021)
Thanks! :)
We do have a managed container hosting service, but it's built on our own backend that auto-scales nodes for you when average GPU utilization surpasses a certain point, but it's not K8s -- which would have been a pain to configure given the distributed nature of all of our servers.
Also their customer service is insane. We get usually get replies within a few mins even at 1AM at night!
Question — Do you guys plan to have some sort of managed K8 service in the future ? Something like GKE ?