Don't get me wrong, I understand the value proposition of a highly tuned blackbox Rails stack, and there is certainly no faster way to get up and running. So it may become the place to be for early stage startups and prototypes. But the particular model that Heroku has is sort of like the Drupal of infrastructure: it's an amazing platform that has everything you need out of the box, but which also comes with a lot of baggage that can easily become an albatross when you are really trying to dial in a growing app.
It's more like "VC funded companies throw money at hosting at the moment".
I worked out a while back what it'd cost to run Mibbit on EC2 (Let alone any intermediary), and it was crazy money. But we use a fair bit of bandwidth and not too much CPU so it all depends.
One thing that can be gleaned from the history of languages and computing platforms is that once computing performance started skyrocketing, it has been the easiest languages and platforms that have been winning. And RoR is very easy and Heroku is a very easy way to deploy and host RoR.
If Heroku becomes the place to be for commercial web apps, if it becomes the visual studio for web apps, those 200 mill will look like a steal.