No, it doesn't, the same way we don't need decades of testing to build an edifice or centuries of flying to test an airplane. Actually, as every human driver is literally a different person, by your logic we would need driving tests enduring several billion miles.
We can make tests using the worst situations, corner cases and even simulated accidents to see how the driving AI reacts. The problem is hard, but engineering is a finer art than what you imply.
And yes, UMich/Ford's self-driving car project is making a testing field specifically designed for increased hazardous environment. But that environment is always artificial, and the hard part is to catch the last 1% situations, or the last 0.000001% in order to reach a level of billion miles safe record, because you don't even know what those are.
Autonomous navigation is fancy on all side (Yes I do this research), but all field experts know any security audit can probably reveal a bunch of failure modes because nobody has really worked on making it robust again adversaries.
But shouldn't we also look at injuries, both physically and mentally, and perhaps even material damage? That probably gives a much higher resolution to compare those 1M km's from Google with.
Now that you can see a slow version of self-driving car already out there with 25 mph top speed and impossible to cause serious injury in the first place. This might be the future of self-driving cars, to provide accessibility and enable those who can't drive.