I suppose I was thrown off by your phrasing "fundamental difference between humans and algorithms" and "algorithms will never be able to do that" and "I don't believe in algorithms that would do image or voice recognition as well as we do".
In fact, it seemed to me the entire point of your comment was to take the specific limitations of Google's current algorithm, and use it as an example of a general principle that algorithms are fundamentally limited in ways humans are not. If that wasn't the point of your original comment, what was?
Google's approach to the problem has nothing to do with the (nonexistent) "A.I." as media likes to present it, it's just incredibly complex software that's trying its best to tackle the problem of navigating the roads, recognizing signs, other vehicles, etc. I can imagine it's an enormous effort that doesn't guarantee success. See "Siri, Call Me An Ambulance" meme as an example of a comparable effort ;)
It is quite possible that the learning abilities come along with downsides.
The skill and alertness of the drivers in Sciliy were much greater than in the UK and the US but they had to be as those were relied on more than rules and systems.
I also wonder about what human driven cars, motorbikes and bikes might start to do once they know and can identify that there are nearly uncrashable and will reliably take avoiding action - will they learn that they can just pull out and let the computers avoid them?
While some humans may be able to adopt to driving in Sicily or Thailand after the U.S., algorithms will never be able to do that. Unless, of course, specifically designed for driving in the U.S., Sicily and Thailand. (Or Russia for that matter, where driving is barely subject to any formalization.)
Humans can learn and adapt, it's in our nature, but an algorithm is just a reflection of some narrow aspect of what we, humans, have learned. Change a few external variables and your algorithm fails miserably.
I'm sorry, but somehow I don't believe in the future of self-driving cars, just like I don't believe in algorithms that would do image or voice recognition as well as we do.