I think that's the point of self-driving's limitations. There are many, many ways in which human drivers fail, to the tune of 35k dead per year. But there are also many, many, many ways in which human drivers handle situations safely that would result in self-driving cars either plowing straight ahead or stopping confused, either situation being worse than what happens today. I think these latter situations affect far more than 35k people per year. They might affect more than 35k people per day.
Death vs inconvenience is an obvious trade, self-driving isn't all or nothing. Safety features like auto-stopping and lane-keeping probably reduce that 35k number dramatically if they're more widespread, without taking human hands off the wheel for the other situations.
You are not going to get perfect centralised road status information for driving cars.
1. There was a burst water main on the country road near my house and when I got there the waterboard had not long arrived. There was a man stopping traffic and trying to get them to turn around on a tiny road. No GPS updates, no notifications prior to this, just a bunch of pissed-off drivers having to do a U-turn at the behest of this puny human telling them to go back.
2. Roadworks with a detour that didn't work properly: they had put one of the yellow "Detour" signs in the wrong place but since I knew the area, I went a different way. Will AGI even be able to read a detour sign and know what it is in reference to the journey I am currently trying to make?
I love the concept of AI but it's an absoulte joke these days with everything claiming to be "AI"... case in point: I have been looking at headphones lately and found a pair (Sony I think!) that claimed to have AI to help noise cancelling! WTF? Even the reviews said that it only worked with constant noise like engines... so they invert the sound waves to cancel each other out? Where's the AI?