And yet autopilot is doing millions of miles a year with fewer incidents than humans, and expanding in capability (for example taking lane changes and turns), all while constantly lowering the level of accidents.

I think average conditions do matter, and supervised computers will continue to take over driving until humans are simply not required. Of course they will not replace humans this year or next, but at some point humans will be passengers, not drivers.