Your narrative is a thing which could happen, not the current truth on the ground. The truth is every time a Tesla rams into a stationary object at speed, or an Uber runs down someone crossing the road, the public’s faith in the tech erodes. Every time that happens we edge closer to overburdensome regulation in the “Thanks to 3 mile island & Chernobyl it’s basically impossible to build a new nuclear plant in the US” sense, and farther away from your utopian dream.
There are very little examples of autonomous cars causing trouble on the road and plenty of them preventing accidents - an example would be videos on youtube showing Teslas predicting accidents in advance and taking action.
Not to rehash this discussion, but: the bar is actually set very high, and current self-driving tests are seemingly not meeting it. There's a lot of deaths because there's a whole lot of driving.
Give humans credit where it's due.
This is a time when an entire driverless car industry is trying to convince the world that its products are safe before it can even come up with convincing stats - Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day. An additional 20-50 million are injured or disabled. More than half of all road traffic deaths occur among young adults ages 15-44. THAT is not convincing enough? Autonomous cars are the future and will allow us to focus on other activities during the daily commute or long distance travels. Will decrease deaths, will optimize energy consumption by intelligently setting the right route and speed. Humans are inferior to computers on the road, that's a fact.