The GPS get it wrong very often too. There is an enormous amount of magic going on behind the scene to put a car on an actual road on the map.
When I'm driving on the highway with spotty coverage, I very often hear "Turn Left in 50 m" when the magic fails and the GPS (mobile phone running TomTom in this case) now thinks I teleported on a side road.
Similarly, you could get yourself lost for hours if you follow your GPS blindly in a small European city. Actually, you would probably get into a traffic accident before that.
When I see people comment on GPS, I can only imagine that in 20 years, you will see headline like "Family had to be rescued after their autonomous car failed to exit Walmart Parking lot for 5 hours and ran out of gas. Google made no comment."
I do hope it supports other mapping apps though, or if not I hope Apple gets pressured to support that. And I don't really see why they wouldn't, it makes their product better.