This a life changing video by Gil Tene on this topic. Bottom line is because of the number requests to support a single customer "request", the high percentiles are the ones that actually matter.

https://www.youtube.com/watch?v=lJ8ydIuPFeU&list=WL&index=22...