>Sure, one might say these new self driving systems will "just" have to follow that same rule as well,

Next round of CAPTCHA: click the squares with blind pedestrians

think about it, this is how these things are being trained--by people frantically trying to click stupid images just to get to the webpage they wanted.