Beware of the No True Scotsman fallacy. A human who drove into a wall could not possibly have been a Safe, Competent Driver, could they? A True Safe, Competent Driver would never drive into a wall.

Unless you're serious about bringing the bar way up for getting a driver's license, I think it's fair to compare self-driving technology with real humans, including the unsafe and incompetent. In most of the world, even those caught red-handed driving drunk are eventually allowed to drive again.