It is a bit premature in a way; paraphrasing here, but "a million is not cool. You know what's cool? A billion" No matter how much you optimise CPU caches and memory allocators, at some point your application won't fit in a single machine, and you'll have to go distributed. Datacenters, not mainframes :)