News for hackers. Stuff that matters.

A comment on gpulist – Craigslist for GPUs. Parent comment

Re:gpulist – Craigslist for GPUs by stonogo on Wednesday February 14, 2024 @09:05PM (#39378280)
They're not only insane (i.e. offering H100s for rent at a quarter the price they'd be to purchase) they're also impossible, since every listing claims to have deployed an Infiniband fabric speed which is firmly in the future.
[ Parent | on HN ]
Re:gpulist – Craigslist for GPUs by jonathanlei on Wednesday February 14, 2024 @10:48PM (#39378889)
Jonathan from TensorDock (https://tensordock.com/) here - we listed two of our A100 and H100 clusters on the site.

The IB equipped on our clusters (can't speak to others) is 8x 400 Gbps. Most customers training foundational models are able to fully utilize that fabric in parallel.

[ Parent | on HN ]
Re:gpulist – Craigslist for GPUs by stonogo on Thursday February 15, 2024 @04:32AM (#39380703)
Which HCAs are enabling that? You're using eight 4-link QSFPs here?, presuming this is NDR?

And out of curiosity, is aggregate bandwidth the normal marketing metric in this industry? In my neck of the woods this would be reported as an NDR400 system.

[ Parent | on HN ]