Azure can make sense pricing wise for startups that have been accepted into their Bizspark program (which doesn't take much). Bizspark gives basically a single web server and database free and you can easily scale from there if you are willing to pay.

On the downside, deploying to Azure is a bit of a pain and its 15-20 minutes per deployment gets old, especially early on when you are deploying more often.