I had that problem before getting a retina MBP. I've basically retired my desktop at this point, and when I need some quiet time with the monitors, I can drive three externals plus the onboard display.

(I'm getting rid of my 3x23" 1080p panels for two 27" 2560x1440 panels, because I want to be able to drive those and my Cintiq at the same time.)