Re:Heroku's Ugly Secret: The story of how the cloud-king tur...
by mixedbit on Thursday February 14, 2013 @03:13AM
(#5218384)
I think you misunderstood: they optimized the long running requests and the optimization incurred 5ms performance loss for short requests. It is not that the additional 5ms solved the problem.
I imagine the long tail disappears in a similar way that a traffic jam is prevented by lowering the speed limit.