People are not going to be swayed by statistics, they are going to be swayed by their emotions and if the self driving car attempts that 'hit the road' so to speak are going to be sub-par in the public perception even if they are might be statistical win then they will get banned. So if you are really gung ho on having self-driving happening then this should concern you too because otherwise you will never reach that goal.
Self driving cars need to be - right from the get go - objectively obviously better than human drivers in all everyday situations. Every time that you end up in a situation where a self driving car kills someone human drivers - and all their relatives and the press - are going to go 'well, that was stupid, that would not have happened to me' and then it will very soon be game over. And you won't get to play again for the next 50 years.
See also: AI winter.
So if you identify a failure mode that contributes to a catastrophic hazard for instance, you better build your system to drive the probability down. The resultant severity x probability score you end with has to fall within the risk parameters deemed acceptable by management/safety
Well, no. Has any of the systems been tested in heavy snows on icy roads or on a road without maps?
silly mistakes
A person died.
Lots of people die in car accidents.
Nearly 40,000 people die each year in car accidents. At least 8 of the top 10 causes of accidents would be improved with self-driving cars.
1. Speeding
2. Drunk Driving
3. Speeding
4. Reckless Driving
5. Rain
6. Running Red Lights
7. Night Driving
8. Design Defects
9. Tailgating
10. Wrong-Way Driving/ Improper Turns
Well, no. Has any of the systems been tested in heavy snows on icy roads or on a road without maps?
Aside from figuring out where the edge of the road is, the biggest accident risk that I've seen with driving in heavy snow is speed -- no one wants to drive 15mph for 2 hours through a snowstorm to stay safe, so they drive 30 - 50mph instead.
And I'm not sure how to solve the road visibility issue with self driving cars, but presumably the same heuristics that humans use could be emulated in software (which I suppose is primarily following the car ahead or his tracks or looking for roadside signs that mark the edge of the road).
I doubt anyone would refer to those as silly mistakes either.
My point with the second part is that humans have proven driving in snow storm and places that aren't fully mapped is possible, something that self-driving cars have not.
Who goes to jail when the self driving car kills people?
https://www.theverge.com/2019/9/24/20881534/volkswagen-diese...
The interesting moral dilemma is what to do if the car decided it was better to run into a pedestrian and protect the driver than to run into a brick wall and protect the pedestrian.
There's no easy answer to that dilemma.
"I can text because my car will warn me if I run off the road or stop me before I hit the car in front of me"
"I don't need to slow down on this snowy road, ABS will help me stop safely"
"Sure, I'm driving too fast for this road, but my airbags and seatbelts will protect me if I crash"
https://www.wired.com/2011/07/active-safety-systems-could-cr...
Meanwhile, you let humans who are far less than 100% accurate (and are often distracted) keep killing people? I went into a panic stop one rainy night when a billowing piece of plastic blew across the road in front of me, it looked exactly like a jogging person to myself and my passenger.
We don't need self-driving cars to be perfect before they are released, just better than people.