Presumably Uber is capable of identifying this suboptimal routing just as they can (and do, AFAIK) monitor the route your driver takes after you're picked up.

I'd hope that drivers who Uber estimates are N minutes away from pickup but consistently take N+5 to actually make the pickup are subject to penalties.