Until someone misuses the protocol to gain an advantage or to cause a disruption (assuming it is peer to peer, decentralized).
If it is centralized, then um, there are other worries (privacy, control, etc).
Even if their reaction processing times are orders of magnitude faster and the sensors give you significantly better awareness, if there are conditions where the sequence of AI responses and priorities are conflicting or wrong, then you'll just be faster and better at getting the wrong solution, sometimes tragically so.
I don't doubt that we'll ultimately be much better off with self-driving cars being the rule, but it may be a bumpy road to get there.
I absolutely agree there is still a ways to go before this is mainstream technology. I also agree that we will get there eventually, and the world will be a better place for it.
I drive a manual transmission car, and enjoy using the flexibility that provides in my daily driving.
I drive emergency vehicles of various sizes, in a lot of less than ideal conditions (I live in upstate New York, so weather is a big factor in driving conditions).
I have no problem believing that a computer will be able to do an objectively better job of driving than I can. It will be able to react more predictably in routine driving, and respond _much_ faster to exceptional situations. In a collision, a modern car is _done_ processing the event (detecting the impact, deciding which safety restraints to deploy, and deploying them) before your body even recognizes that it happened.
A computer controlled car will make fewer mistakes and react better in emergencies than a human being will. It has nothing to do with the skill of the driver. It has everything to do with the amount of data that the car can gather (do you have 360 degree radar vision or direct access to sensors built into the car), and the speed with which it can process that data. This technology still has a lot of maturing to do, but it has made amazing strides in the past decade, and I'm confident that it will continue to do that.
I, for one, welcome our new robot chauffeurs.