However, the cache does not need to operate at that speed only the core so it's best to ignore the cache, but I can't find good numbers on a naked CPU. Anyway, using a 55nm GPU 285 GTX that has a 470 mm die size and 240 processor elements we can see each element is only using ~2mm of die. Which is only off by a factor of 4 so ~14nm would work.
In theory you could end up with a ~1THz GPU with ~1000 SPs and around 4000x more processing power. But it would need insane memory bandwidth etc.
They're great and all when it comes to benchmarks and stuff, but their design has a number of serious drawbacks:
1) The control lines for a long pipeline are incredibly convoluted/complicated as necessitated by the movement of individual instructions from one stage to the other along the pipeline across many, many cycles (all of which involve storing the results of the current cycle to a register somewhere along the pipeline, adding immense overhead in today's systems).
2) Flushing longer pipelines is an incredibly taxing procedure. You either flush the entire pipeline and lose a huge chunk of work, basically throwing out several thousand cycles of work as a result of a single branch or value mis-prediction; or you can selectively clear the pipeline which is an extraordinarily difficult feat that involves keeping track of which operation in what order wrote back what data to which register... for dozens of operations.
Granted long pipelines suck, but my point was you can have a higher clock speed than the time it takes light to travel from one end of you're CPU to the other and back. One of the more interesting options IMO is to have 2 separate threads with separate registers using the same hardware so you can interleave calculations without a long pipeline. The issue becomes do you have 2 half speed virtual cores or a single high clock speed core and what do you do about instructions that take more than one clock cycle.
The "more interesting option" you're referring to is implemented in P4 and Nehalem under the trademark of "HyperThreading."
But really this is totally speculation until someone builds one.
Link to article about Graphene Memory: http://www.dailytech.com/Researchers+Create+New+Memory+from+...
According to wikipedia, a 'standard atom' is between 60 and 600 picometers in diameter, so yeah, you'd need transistors the size of atoms.
Of course, this is assuming the same general processor design. You could go 3D and get everything closer together without shrinking transistors as much... or you could change the design all together.