You are right that it's not an easy problem to solve but I think you would also agree the economic incentives are there and you don't necessarily have to have people in the vehicles to see improvements on the problems I cited above.
Amazon's scheme for drone delivery seemed kind of crazy at first glance but it does have some sound economics behind it. Here's a reference that seems to have a reasonably balanced view: http://thedronegirl.com/2017/05/07/drone-delivery-economics-...
As for that Kittyhawk prototype - one prop failure at altitude and the pilot is dead. There's a reason they're testing over water at very low altitudes. Quadcopters have a very bad failure mode: they always crash. You want at least six motors, if not more, to avoid a crash every time a single motor fails. But, of course, more motors requires more battery power, which raises the weight, which makes it less maneuverable, and so forth.
From a pure "worst case failure mode" ground traffic is a better first automation target for moving small quantities of people.