Yeah I think people way overestimate how much scaling they will really have to do. If you write something reasonably efficient you can serve a surprising level of traffic with just a regular ol' big-fat-server and a cache.