Ask HN: How bad is the GPU shortage for startups/researchers?
Curious how folks are faring with GPU access for training / inference? (those of us outside of big contracts / commits with the big three)
I've seen folks try to address the shortage through a number of mechanisms: - Co-op pool for recipients of a specific AI investment fund - Collating a transparent price book (Shadeform) - People putting a rack under their desks?
(Full disclosure, I am thinking about renting out GPUs, trying to get a pulse on the market)
(
4 comments
| 12 points
| on HN
)
If you need 8xH100 only option is AWS, p5.48xlarge - $98/hour
I recommend skypilot for finding a good region