And that there are many places with stop signs that are almost completely obscured by foliage, or simply by the angle of roads on the crossroads.
Not everything is California. And not every city has a grid.
When autonomous cars can survive in a place like Rome or Paris[1], or even downtown Manhattan. Then we can talk about fully replacing humans.
[1] Rome and Paris are notorious for people having special city cars because they get banged up so much in the course of normal life
Here's an example of traffic in a modern European city: https://www.youtube.com/watch?v=HfJ-VokP3EQ
And another: https://www.youtube.com/watch?v=lay8aZlsbB0
How long until autonomous cars can do that? Hell, I'd shit my pants trying to do that.
PS: in the real world there are also many roads that flat out don't have lanes drawn on them.
So yeah, there's a very long way to go until self-driving cars are ready to replace human drivers.
The system will have to work in 100% of circumstances before laws will be changed to allow for driverless cars. I could see that happening in 20 years, but I really doubt it'll be on the streets in 5 years like Elon Musk and others have suggested.
In Switzerland we have those wonderful pass roads. On one side you have the mountain, on the other side there's nothing. Never in my life would I let a computer drive down that road with my family in it:
https://www.youtube.com/watch?v=HDilGBIiKxI
Sometimes roads are so narrow, that drivers naturally honk while going round corners. If there's a honk back you gotta slow down. Now add some snow fall and fog and drive down in the night. Good luck!
Most likely, it'll start out as driving assist systems (like an advanced cruise control, similar to what tesla recently deployed). The computer does the driving, but the car needs a driver in the drivers seat, picking his nose and waiting for the very rare instance when intervention is needed.
To be honest, I think this would be a step back. Risk compensation[0] will ensure humans will put way too much faith in the system, and not be alert enough to intervene when needed. Plus, driving is boring enough when you're actually driving the car. Just sitting still on a 4+ hour journey, not able to actually do anything else (because you need to keep your eyes on the road) sounds like a special kind of hell to me.
Self-driving cars would be a huge leap forward. More driving assist systems will just make people less careful.
We can already see a lot of manufacturers rebranding their driving assist systems as "self-driving cars" because it's the cool thing to do.
I rather hope that individual vehicles for everyone just turns out no longer to make sense eventually and goes away.