We get Stacked Memory HMC soon, Its not hard to envision a 2U server with ultra high speed 1TB+ Memory in 2020. At 10nm, 2U Server would get a Dual 32 Core Xeon. Everyone would do In Memory database and computing, most of today's scaling problem would be 10x easier then. It would properly take a lot longer to reach the scale problem Google and Twitter once had.

So i dont see distributed computing become the norm either. At least not in the next few years.