News for hackers. Stuff that matters.

A comment on Show HN: Cloud GPUs for Deep Learning – At 1/3 the Cost of AWS/GCP. Parent comment

Re:Show HN: Cloud GPUs for Deep Learning – At 1/3 the Cost o... by typon on Wednesday March 17, 2021 @03:51PM (#26496021)
Hey ilmoi,

Do you support multi-node training? Particularly, can I reserve for example a 64-GPU instance via 8 nodes and perform distributed training?

[ Parent | on HN ]
Re:Show HN: Cloud GPUs for Deep Learning – At 1/3 the Cost o... by ilmoi on Wednesday March 17, 2021 @03:57PM (#26496079)
You can! All machines within a single account are inside a private VLAN, which means they all talk to each other (out of the box, no setup required), but nobody else on gpu.land sees them.

See the "Are instances within my account connected?" item in the FAQ - https://gpu.land/faq

If you're going to need 64 GPUs I'll have to increase your account limit (currently 16 GPUs per account). Email me at [email protected]

[ Parent | on HN ]