It will be interesting to see if the substantial safety margin decreases as more people buy in.
I do know that there is not much better than average driver! There is much worse than average: people who drive drunk, and a few other classes of people who shouldn't drive at all. However the vast majority are all about equal: in reasonable mental health and limited to the same eye and reaction times. A few people have and follow better training and so are slightly safer - but this is slight. Most people think they are better than average because they excuse their mistakes as a "one time mistake", while confusing "the other guy's" mistakes with the other guy must be a bad driver.
Some outside factor might cause a signal failure, causing cascading destruction.
There's a shit ton of software between the gas pedal and the machinery of just about every car on the road today whether that be an ICE, hybrid, or EV. We're a long ways away from the go-go pedal directly pulling a cable opening the throttle plate.
I did buy a Model-Y shortly before his Trump endorsement, and then sold it for technical reasons.
On a cold January morning, I was pulling up to a stop-sign, didn't have any autopilot turned on, and the car accelerated.
I think there is just too much software between gas pedal and the machinery of the car. They're honestly kind of dangerous vehicles. The average person can't handle the responsibility of a self-driving vehicle.
I told all of my friends and family that I would not recommend the vehicle yet to a non-technical person, even when I was myself driving it and loving it.