Personally I host MVC 3 on a Windows server 2008 R2 with Hetzner for €65 per month.
The Bizspark programme will help you to keep the licensing cost down to pretty much zero in the short run so I don't think this should be a major concern.
Like another commenter suggests you can look at Mono which will let you run MVC 3 (with the Razor view engine), however note that EntityFramework isn't supported and you would be advised to start from scratch in Mono and port to .NET actual later if you chose that route rather than the other way.
Best thing I ever did ... sure it costs 3x what I was paying for a VPS, but it has been rock solid compared to a number of resource leak issues with Mono, and the fact that I can admin a windows box with googling everything I need to do.
If you are developing a for-profit venture and the cost of deploying on Windows vs Linux is a breaking point for a .NET project then I'd suggest you look at the business plan again and decide if it has enough profit in it.
Also, has any startup actually deployed a large scale web app on Mono with ASP.NET?
- Cost. I have found no way to accurately estimate what the development and deployment will cost me initially, nor when I need to scale. BizSpark makes it affordable for a very short time all things considered, but it's really sorta like a free crack rock. - Linux. I simply don't feel comfortable deploying anything publicly on Windows. It might be more secure now than in the past, but my experience is on Linux and I feel like it's a whole new world to come up to speed on the linux side. It's almost as if Microsoft should have a ".Net for Startups who are used to *nx OSes" class. - Linux. I develop on and am most comfortable with Linux. I'd have a hard time spending my days on Windows 7.
Other than that, certain features of .NET do indeed look interesting. At least C# as a language has improved over its parent (Java).