...which is also partly the motivation to improve.
I expect self-driving cars long-term to be a lot like air travel. It'll have a reputation for being super unsafe, with lots of people paranoid of it, for decades after it has far eclipsed the safety of regular human car driving. The paranoid hyper-focus and ridiculous press coverage is also what will enable it to become essentially perfect (like passenger air travel is today in the developed world).
It's because in almoost all cases, one fatal mistake results in one fatal accident. And in most cases, the failing party is part of the accident - giving us reason enough to believe people to what they can to avoid it.
With AI, one sloppy mistake can be the root cause of 100 fatalities, with no risk to the one who made the mistake. That's part of the reason we don't accept it.
Humans are able to "Level 5" driving, so...