I don't think renting out hardware is a bad model at all. Google spinning out their TPU work in this manner could be fine.

I think some (large) buyers will want on-prem and they have large enough budgets to make that worthwhile.

I don't think "sell individual TPUs to random people" is a great model. Most are better served by the cloud rental approach (although they might not think so themselves).