I think part of the problem is that random failure modes that auto driving does is extremely terrifying, even if you know statistically it is safer. The nature of the failures are unpredictable and alien to a human understanding of driving, and therefore appears something akin to “a small portion of the time, your car will randomly, catastrophically explode, but it happens less often than when you would statistically have an accident”. People would 150% not drive that thing!