Re:Show HN: Neurox – GPU Observability for AI Infra
by mountainriver on Tuesday April 29, 2025 @07:25PM
(#43839268)
Kubernetes is now kinda a bad abstraction for accelerated compute with the GPU shortages
[ Parent
| on HN ]
Re:Show HN: Neurox – GPU Observability for AI Infra
by leeab on Tuesday April 29, 2025 @07:52PM
(#43839481)
Well, it depends on how many GPU clouds you're managing. We've talked to a bunch of companies, some startups, some enterprises and the main trend we found was the sheer number of companies with GPU clusters from multiple clouds...likely due to GPU shortage.
And yes, it's nowhere near 100% but an overwhelming majority was running Kubes for GPU workloads...mainly cuz so they'd have a unifying layer that wasn't managing each cloud separately and being proficient with their respective tooling.
Are you using something else? Slurm, docker, etc?