Or half-hosted on IBM, half-hosted on Internap, half-hosted on Dell public cloud, half-hosted in a private cloud... all with the same OpenStack API.
If you decide you want to run your own hardware (as Zynga did & Justin.TV did when EC2 got too expensive), you just install OpenStack on your hardware - it is open source.
This is why Amazon scrambled to partner with Eucalyptus recently, so that they could have something to point to as an alternative that supports the EC2 API.
There was also some reverse-proxy which "normalises" your requests for a given provider presented on Fossdem this year, but I can't recall the name.
The API issue is a triviality compared to hiding those details. I think that's the real power of OpenStack - the shared API is a convenience, but the shared model is priceless.