Well, one can probably set up a "that shit doesn't really do anything serious" MVP on something even awfully host-prohibitive like Heroku, while preparing for a real deployment. Just to show off "we have a product and working on improvements".

Would probably work just fine if they don't do anything heavyweight but just some CRUD/form processing with a billing integration and a few extras, like many websites/webapps essentially are. ;)

In this sense it's probably a reasonable to not bother about the initial infrastructure before you actually need it. Just don't tie yourself to the cloud, because it'll bite very painfully.