Do those non-autopilot vehicles exclusively drive on the highway? Highway driving might be more deadly but accidents are less likely to happen in the first place due to lane separation, large curve radius, no stationary obstacles, no pedestrians, lower relative velocity, etc.

It's like trying to compare Rotweilers to Pitbulls. Both are dangerous but one of them is 20x more dangerous.