True, and that kind of flawed argument bugs me. However, there is also data that showed that accident rates went down significantly on the same cars after Tesla first enabled autopilot via a software update. This is much more compelling to me; if the same people driving the same cars in the same areas became less likely to get into an accident as soon as autopilot became available, then I don't see how you can really argue that the feature is not beneficial to safety.
That study was later shown to have employed sketchy data and egregiously flawed methodology. A deeper dive showed that the crash rates may have actually gone up with Autopilot. HN discussion here: https://news.ycombinator.com/item?id=19127613
What's the point of comparing Telsa Autopilot related crashes to crashes involving at least one motorcycle?
I think it's obvious the answer is: deception*.
But when the argument is "using the vehicle this way is a lot safer than the minimum requirements to be on the road", it's a relevant and fair statistic.
A more fair comparison would be: other drivers of similar demography driving other vehicles of similar age and specifications.
I could buy a car with 3 star crash ratings, and people would be fine with that. I could get in a taxi with a mediocre driver, and people would be fine with that.
Why does the comparison have to be to me driving, in a car like this?
When I'm shopping for a car, it makes sense.
But for public policy discussions, what matters is how the safety ranks against the general population.
You can't determine whether Autopilot makes driving safer by comparing miles driven only on highways by Teslas to miles driven across the whole vehicle fleet.
That assume almost everyone using autopilot will replace that with manual driving in the same car. Some of them might get cheaper cars or take uber and end up less safe.
And even then, there's lots of stuff you can do to a car that makes it less safe that we don't ban, as long as it's still sufficiently safe.
If anything, increase safety standards. If you want to do something that won't cost extra money then do something to ban oversized cars at the same time...
What I mean to say is, when car considering the safety data of any vehicle, it is insufficient to know that the vehicle performs better than whole-fleet.
It’s also necessary to know whether any particular vehicle outperforms others in its class.
One of those without the other is necessary but not sufficient.
The driver that's above average but could be more above average isn't where we need to be fixing things. Not when there are millions of drivers that are either hyper-aggressive or senile still on the roads.
Eh, Tesla likes to point to this statistic every time the safety of Autopilot comes into question, but it is an apples-to-oranges comparison because AP is only used on highways where traffic incidents are already far less common per mile driven.
Detailed data is hard to come by, but more nuanced studies have been far from conclusive in favor of the "Autopilot is safer than human drivers" thesis.