Yes indeed - but luckily driving is a fairly narrow task by human standards. An AI trained specifically do this should be more like an animal's well known behaviours.

If driverless cars were crashing because all of a sudden a giant sheet of glass appeared in the middle of the road, or a giant alien death ray shot up the tarmac, I think most people would have some sympathy.