Not true, H100s cost $2-3/GPU/hr on the open market.

Yes, they even do at $1/GPU/hr. However, 8xH100 cluster at full utilization is ~8kWh of electricity and costs almost ~0.5M$. 16xH100 cluster is probably 2x of that. How many years before you break-even at ~24$/GPU/day income?

7

https://www.google.com/search?q=0.5e6%2F8%2F24%2F365

Did you really not understand rethoric nature of my question and assumed that I can't do 1st grade primary school math?

Who cares? That's someone else's problem. I just pay 2-3$/hr and the H100s are usable

Look, I understand that some people are short-sighted and can hardly think out of the box and that is totally fine by me. I don't judge you for being that so I kindly ask you not to judge my question. Learn to give some benefit of the doubt.

You should care about counterparty risks. If your business model depends on unsustainable 3rd party prices powered by VC largesse and unrealizable dreams of dominance, the very least you can do is plan for the impending reckoning, after which GPU proces will be determined by costs.

H100 GPUs are more or less similar in price/performance. It is 2-3x more expensive per hour for 2-3x higher performance.