News for hackers. Stuff that matters.

A comment on Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups.

Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by dudus on Sunday July 30, 2023 @09:07PM (#36937802)
I know AWS/GCP/Azure have overhead and I understand why so many companies choose to go bare metal on their ops. I personally rarely think it's worth the time and effort, but I get that with scale saving can be substantial.

But for AI training? If the public cloud isn't competitive even for bursty AI training, their margins are much higher than I anticipated.

OP mentions 10-20x cost reduction? Compared to what? AWS?

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jerjerjer on Monday July 31, 2023 @04:25AM (#36940030)
AWS offers p5.48xlarge which is 8xH100 for $98.32, so 12.29$ per hour per H100 - ~6x the price.
[ Parent | on HN ]