News for hackers. Stuff that matters.

A comment on Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups. Parent comment

Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by whimsicalism on Sunday July 30, 2023 @06:49PM (#36936802)
Significantly more expensive than equivalent 3090 configuration if you can do model parallelism
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by quickthrower2 on Sunday July 30, 2023 @06:53PM (#36936850)
What do you mean by this? I use less than the $30/m free included usage.

I am guessing you mean at some point just buy your own 3090 as it will be cheaper than paying a cloud per second for a server-grade Nvidia setup.

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by whimsicalism on Sunday July 30, 2023 @06:57PM (#36936880)
I think this is more applicable for training usecases. If you can get by with less than $30/mo in aws compute (quite expensive) then it likely does not make a didference.

What I mean is that you can rent out 4 3090 GPUs for much cheaper than renting an A100 on aws because you are not paying Nvidia's "cloud tax" on flops/$

[ Parent | on HN ]