I'm driving southbound on Fair Oaks in Sunnyvale, approaching Arques. On the corner is a mini strip mall with a small parking lot. Out of the corner of my eye, I see a young child, maybe 4 years old, running around that parking lot being chased by his mother or caretaker.
Now, being well off the road and out of its universe of conditions that would be considered by an AI, he would be ignored. But I just knew, somehow, that this was trouble.
The kid, thinking this is a fun, impromptu chase game, then sprints directly into traffic right in front of me. I stop with a foot to spare.
Edge conditions: it's what's for dinner. (tm)
A human could see a group of kids looking in the direction of the street at someone occluded from view and realize the possiblity of a child dashing out onto the street well in advance. The self-driving car would have to detect, classify and react after the child comes into view. It is this kind of common sense AI that we cannot engineer our way out.
A couple days ago there was a viral post about how self-driving cars react to a 35 mph sign vandalized to look like 85 mph. A human would know that the sign is wrong - the self driving car would need this 'use case' programmed in - maybe have location based speed limits programmed in.
Reading the article:
> ‘It is worth noting that this is seemingly only possible on the first implementation of TACC when the driver double taps the lever, engaging TACC.’
It isn't a strict self driving situation, but makes for great click bait. I can't imagine that this isn't an easy fix (Tesla's are also easy to update collectively via software update, try doing that to human beings).
Would be really interesting if Waymo could prove this out somehow.