But exactly how NHTSA reached that conclusion has been a mystery. It’s also the subject of an ongoing lawsuit between the agency and a group of researchers aiming to obtain NHTSA’s data so it can try to replicate the findings.
That may be an impossible task.
On Friday, in response to a Freedom of Information Act request filed in March by Jalopnik, NHTSA said it was unable to provide most of the materials and data used in the investigation, citing a “confidentiality determination” it granted Tesla in July. (It’s not uncommon for companies to submit requests to NHTSA for certain information to be treated as confidential. From there, NHTSA then chooses whether or not to grant the request.)
In particular, the agency said, NHTSA is withholding in full an “excel spreadsheet Tesla submitted that contains production data from disclosure because the spreadsheet contains information related to trade secrets and commercial or financial information.”
[...]
Autosteer, however, is relatively unique to Tesla. That’s what makes singling out Autosteer as the source of a 40 percent drop so curious. Forward collision warning and automatic emergency braking were introduced just months before the introduction of Autosteer in October 2015. A previous IIHS study shows that both the collision warning and auto emergency braking can deliver a similar reduction in crashes.
https://jalopnik.com/feds-cant-say-why-they-claim-teslas-aut...
EDIT: So let me add that yes, this report probably isn't as pro-autopilot as some people are claiming, but I would still consider it positive for Tesla considering it is the only publicly available report on the subject and it shows that autopilot is at least no worse than a human driver.
That doesn't follow logically at all. Collision avoidance and autosteer were introduced within months of one another. One could be reducing accidents while the other increases them. The most conservative interpretation is that the study may not have properly isolated these variables and is misattributing the safety gain of collision avoidance to autosteering.
> The only way for autopilot to be less safe than a human (taking the numbers from that study as true) is for those safety features to be substantially more effective on a Tesla.
You lumped the two types of features together. There's your logical flaw. The most conservative interpretation is that, yes, Tesla collision avoidance could be great while autosteering is "not nearly as effective as they claim."
For example the most recent fatality was directly caused by an autosteering error directing the car towards a median. However the accident could have been prevented if the automatic emergency breaking triggered before the collision. Considering it didn't, I have a hard time imagining that the automatic breaking has surpassed the rest of the industry to a large enough extent that could make up for the autosteering being as dangerous as you are suggesting.
It is certainly possible, it just seems unlikely that Tesla threads the needle to be extremely competent at one feature while also being incompetent enough to bungle a very related feature. That scenario relies on a lot more assumptions than the scenario I proposed which is why I described my original scenario as being the most conservative.
> I have a hard time imagining that the automatic breaking has surpassed the rest of the industry to a large enough extent that could make up for the autosteering being as dangerous as you are suggesting.
This is another comprehension error. You claim was "autosteering at worst had no effect on the accident rate." Thus any increase in the accident rate caused by autosteering, not merely a "large" one, would invalidate your claim.
I disagree that your interpretation is the most conservative interpretation. The most conservative interpretation is that we know basically nothing about the safety of Tesla's autopilot. There are so many unaccounted variables here - the presence of AEB and collision detection, total utilization of TACC vs TACC + Autosteer, utilization of Autosteer over time (for example: are people conservative with it at first and then gradually increase their usage into riskier driving situations?), non-airbag accidents, the constantly updating nature of Autopilot systems (for example what if an update actually makes the vehicle less safe?), whether people have more accidents initially driving any EV due to being unfamiliar with the instant torque of EVs and so on and so on. Mix in proprietary data which no one is willing to share and I think the only thing we can say is that we don't know.
Also:
>it shows that autopilot is at least no worse than a human driver.
It does not show that!
There are human driven miles in both buckets, for all we know the second bucket could have more human driven miles than the first bucket which is why the accident rate is lower. Tesla has never proven that it's Autopilot system is safer than or as safe as a human driver.
If one has "moments" of inattention significant enough to drift out of a lane or "drive into another vehicle", one should not be driving.
There is a current (Toyota ?) commercial where a young driver with her father is saved from mowing down a crosswalk full of pedestrians by some form of "auto stop" and the father proudly declares "it stopped for you". If you need that to avoid killing people, you should not be driving.
The driver has no reliable way of estimating x or y and therefore can’t judge the risk of their lack of attention causing a crash. Maybe they “shouldn’t” be driving according to this formula, but they don’t know that, and autosteer could save them from an accident.
Most likely, the presence of autopilot increases x and decreases y. We can’t tell which affect dominates by arguing on the internet. We need data.
Full automatic steer isn’t needed for this. Many many cars, for at least a decade, have had lane keep assist.
Now active lane keep assist is even more common, which steers you back into your lane, but doesn’t actively steer until you drift, preventing the main abuses of the feature.
Instead of just speculating, the NHTSA did an actual study on this, and they reached the opposite conclusion. They investigated crash rates in Tesla vehicles that had the original autopilot hardware installed, both before and after autosteer was enabled via a software update, and found that autosteer reduced accident rates by 40%.
When Tesla talks about how much lower their accident rate per mile is compared to other cars, that's kind of statistical bullshit, since there are plenty of other uncontrolled variables that are in play that could affect this besides the cars themselves. But in the case of the NHTSA study, they were looking at the same drivers in the same cars, and the only difference was that one day a software update came out and enabled autosteer, and suddenly accident rates went way down. That's pretty damn convincing if you ask me.
https://static.nhtsa.gov/odi/inv/2016/INCLA-PE16007-7876.pdf