A good rule of thumb I once heard (from Jeff Dean, I think) was that (in a complex system) every 10X you go up in scale you need to re-consider basic design elements, trade-offs, etc, and probably change some of them.

It's hard to design something (large and complex) for much more than 10X scale with only HW capacity increases.