There's almost nothing that's profitable at a fraction of a cent per user per month. The net is cheap, but it isn't that cheap.
http://mailinator.blogspot.com/2008/08/benchmarking-talkinat...
"In my benchmarks now, on my quad-core desktop the talkinator server can push about 39000 messages per second. Keep in mind this is processed messages as in decoded, packaged, and queued for particular recipients."
The typical architecture for web applications is pretty inefficient.
I guess maybe you and I define scaling differently. I'm thinking like adding in web servers, load balancing, replicating db. You may be just talking optimizing code and caching or something.
Curiously, can you serve even some simple dynamic content like a Wordpress blog to a million somewhat frequent users a month?
VPS servers are so cheap and more than enough. The current web stacks are just ridiculously lousy.
I do agree about the ones that take a ton of funding and have a ridiculous burn rate though.