News for hackers. Stuff that matters.

A comment on Show HN: gpudeploy.com – "Airbnb" for GPUs. Parent comment

Re:Show HN: gpudeploy.com – "Airbnb" for GPUs by lelanthran on Sunday May 05, 2024 @06:52AM (#40263840)
>> Im also interested in what the differing factor is.

> vast has a lot of bad machines with terrible PCIe lanes and architecture you have to learn the hard way.

Wouldn't gpudeploy have exactly the same problem? How is it mitigated with gpudeploy?

[ Parent | on HN ]
Re:Show HN: gpudeploy.com – "Airbnb" for GPUs by everforward on Sunday May 05, 2024 @12:24PM (#40266033)
I think it's more of a business strategy issue than a technical one.

I suspect it would be trivial for Vast or GPUDeploy to spin up a benchmarking job before allowing sales on that machine. I'm not an expert on PCIe lanes, but I would think the performance issues would be visible via bandwidth or latency on the lanes.

It kind of makes sense to me, though. If I were looking for absolute reliability and was willing to pay for it, I'd just go to one of the many GPU cloud vendors. Likewise, I suspect anyone willing to really work on getting good performance would rather be a real provider or sub-provider than being part of this nebulous C2C GPU cloud.

[ Parent | on HN ]