News for hackers. Stuff that matters.
Re:Teslas running Autopilot have been in 273 crashes in less... by bradfa on Wednesday June 15, 2022 @09:22AM (#31752485)
A "crash" in this case is any crash where the automated driving aids were in use less than 30 seconds prior to the crash. So for example, if the car realized it couldn't deal with something 29 seconds up the road, gives a 10 second warning to the human that the human needs to take over, and then the human drives into a crash, this would count as an Autopilot crash.

I'm no Tesla fan, but that's a bit disingenuous.

Re:Teslas running Autopilot have been in 273 crashes in less... by ra7 on Wednesday June 15, 2022 @09:31AM (#31752614)
> A "crash" in this case is any crash where the automated driving aids were in use less than 30 seconds prior to the crash.

It's 5 seconds, not 30 seconds. From Tesla safety report [1]:

> To ensure our statistics are conservative, we count any crash in which Autopilot was deactivated within 5 seconds before impact, and we count all crashes in which the incident alert indicated an airbag or other active restraint deployed.

[1] https://www.tesla.com/VehicleSafetyReport

Re:Teslas running Autopilot have been in 273 crashes in less... by bradfa on Wednesday June 15, 2022 @09:36AM (#31752678)
The article states: "The NHTSA order required manufacturers to disclose crashes where the software was in use within 30 seconds of the crash, in part to mitigate the concern that manufacturers would hide crashes by claiming the software wasn’t in use at the time of the impact."
Re:Teslas running Autopilot have been in 273 crashes in less... by ra7 on Wednesday June 15, 2022 @09:52AM (#31752890)
Ah, thanks for clarifying. I thought you referred to Tesla's counting methodology.
Re:Teslas running Autopilot have been in 273 crashes in less... by moralestapia on Wednesday June 15, 2022 @09:28AM (#31752568)
It's not disingenuous,

The whole point is "my new system reduces crashes", if it doesn't, in the bottom line, then it doesn't.

Re:Teslas running Autopilot have been in 273 crashes in less... by imdsm on Wednesday June 15, 2022 @09:40AM (#31752713)
As has been stated, though, simply saying there have been 273 crashes by itself means nothing.

If I said to you "following the introduction of a new drug there have been 1000 heart attacks in the USA this year so far", you may think, shit, 1000 people have had heart attacks, but when you realise that there are 800,000 heart attacks per year in the USA, making it about 400,000 pro-rata for June, reducing that down to 1000 would be amazing.

So, 273 crashes. But what would that figure be without the system?

We need the data to compare this to groups of drivers who don't use these systems. Otherwise, it's meaningless. The numbers are meaningless. Like values without units.

Re:Teslas running Autopilot have been in 273 crashes in less... by moralestapia on Wednesday June 15, 2022 @09:47AM (#31752818)
Huh?

But we DO have the data for "groups of drivers who don't use these systems" ...

Re:Teslas running Autopilot have been in 273 crashes in less... by wyldfire on Wednesday June 15, 2022 @09:38AM (#31752703)
But with a raw number in the headline -- instead of some kind of ratio that could compare with/without the new system -- it's not that honest.
Re:Teslas running Autopilot have been in 273 crashes in less... by qeternity on Wednesday June 15, 2022 @09:35AM (#31752665)
I think OP is saying something slightly different: the Tesla numbers could be substantially worse if Autopilot simply disengages 1 millisecond before impact, it would not count as an Autopilot crash.
Re:Teslas running Autopilot have been in 273 crashes in less... by bitexploder on Wednesday June 15, 2022 @11:47AM (#31754780)
The WaPo article addresses that and counts them as AutoPilot engaged crashes. It seems to disengage 1 second before many of the crashes. It is nearly impossible to draw any conclusions about anything from this article. Other than, people use AutoPilot and sometimes they crash using it.

The one interesting bit is where the damage happened on the cars and the hitting of stationary objects. Those seem like unforced autopilot errors.

Re:Teslas running Autopilot have been in 273 crashes in less... by moralestapia on Wednesday June 15, 2022 @09:38AM (#31752701)
1 ms < 30 seconds, so that data is there as well.

Also,

>I'm no Tesla fan, but ...

Sounds like he's vouching for them.

Anyway, the argument is not against @bradfa, it is about whether AP makes driving safer or not.

Re:Teslas running Autopilot have been in 273 crashes in less... by bradfa on Wednesday June 15, 2022 @09:38AM (#31752690)
And there's recent articles where almost exactly this has been found. Autopilot deactivating 1 second before impact.

In these kinds of cases, then yes, Autopilot is definitely partly at fault, but also the human is because Autopilot is only a level 2 system, the human is still responsible.

Re:Teslas running Autopilot have been in 273 crashes in less... by vagrantJin on Wednesday June 15, 2022 @10:00AM (#31752981)
> Autopilot is only a level 2 system, the human is still responsible.

True.

> In these kinds of cases, then yes, Autopilot is definitely partly at fault,

Partly? Now that's called shilling.

Re:Teslas running Autopilot have been in 273 crashes in less... by userbinator on Wednesday June 15, 2022 @09:26AM (#31752551)
How does it not count? 10 seconds doesn't seem like much time for a human not really paying attention to the road, as would probably be the case, to assess the situation and respond. Although the cutoff is at 30 seconds, I wonder what the distribution is actually like.
Re:Teslas running Autopilot have been in 273 crashes in less... by mwint on Wednesday June 15, 2022 @09:27AM (#31752563)
10s is basically an eternity in car time. Pretty sure I could wake up from a nap and boot my brain enough to drive in 5s or less. A car going 80mph can stop in around 4s.
Re:Teslas running Autopilot have been in 273 crashes in less... by Someone on Wednesday June 15, 2022 @09:38AM (#31752700)
> Pretty sure I could wake up from a nap and boot my brain enough to drive in 5s or less.

Citation needed, certainly for the case at hand, where you’re suddenly required to drive a car in an emergency situation.

(Edited to add the claim I responded to, because it looks like a few replies didn’t look at that context)

Re:Teslas running Autopilot have been in 273 crashes in less... by mwint on Wednesday June 15, 2022 @09:46AM (#31752802)
On the contrary, I’d challenge anyone to find a non-contrived example of a crash that is unavoidable with 10 seconds of warning. Driving off a 1600 foot cliff does not count.
Re:Teslas running Autopilot have been in 273 crashes in less... by jepler on Wednesday June 15, 2022 @10:06AM (#31753092)
Your car has gone the wrong way down an express lane some distance, and deactivated when a semi trailer traveling 75mph in the opposite direction is detected. There is no shoulder, and it's stopping distance plus yours is greater than the remaining distance between you (.1 mile is way insufficient)
Re:Teslas running Autopilot have been in 273 crashes in less... by mwint on Wednesday June 15, 2022 @10:08AM (#31753124)
”Wrong way down an express lane” is super contrived. Those are the kinds of clear cut issues that self driving is guaranteed to be better at than humans.
Re:Teslas running Autopilot have been in 273 crashes in less... by lostmsu on Wednesday June 15, 2022 @12:11PM (#31755192)
If semi can stop in 6 seconds sounding horn would do it.
Re:Teslas running Autopilot have been in 273 crashes in less... by vagrantJin on Wednesday June 15, 2022 @10:11AM (#31753160)
Every crash is avoidable by definition.

Human error/poor decisions, mechanical/electronic failures, acts of god could all reasonably be labelled as reasons.

Regardless of time.

Re:Teslas running Autopilot have been in 273 crashes in less... by mwint on Wednesday June 15, 2022 @10:24AM (#31753356)
Not every crash is physically avoidable _given a time constraint_. When you're a millisecond from impact, there's nothing you can do. One second, there exist many cases where there's nothing you can do.

10 seconds before impending collision, and it's hard to imagine the case where there's no time to react in some way that avoids the accident.

Re:Teslas running Autopilot have been in 273 crashes in less... by zozbot234 on Wednesday June 15, 2022 @10:06AM (#31753093)
You are always required to drive the car. Autopilot does not replace an attentive human driver, there is no excuse for being distracted or spacing out.
Re:Teslas running Autopilot have been in 273 crashes in less... by pwinnski on Wednesday June 15, 2022 @09:50AM (#31752853)
Pretty sure you could not, and your confidence is terrifying.
Re:Teslas running Autopilot have been in 273 crashes in less... by mwint on Wednesday June 15, 2022 @10:15AM (#31753230)
Set a timer and watch it count to 10s. It’s a long time.

Remember, people fall asleep while driving cars pretty regularly. I know people who have fallen asleep driving on the freeway, woken up in the median, and just guided the car back on the road to continue.

Are they stupid for not taking breaks, etc? Yeah. But is it unreasonable to think 10s for taking over control from sleep is doable? No, it’s doable for people with the right mental state. The most common mistake is overcorrection on waking up.

Re:Teslas running Autopilot have been in 273 crashes in less... by bradfa on Wednesday June 15, 2022 @09:39AM (#31752710)
With level 2 autonomous driving systems the human is required to always be watching and ready to take over. 10 seconds is a reasonable amount of time for this transition according to Mercedes Drive Pilot system: https://www.roadandtrack.com/news/a39481699/what-happens-if-...
Re:Teslas running Autopilot have been in 273 crashes in less... by andrewaylett on Wednesday June 15, 2022 @12:08PM (#31755133)
That 10s is for a L3 system -- L2 systems require the driver to maintain attention at all times. "FSD" is still a level two system.

In level two, it's not about "handing back control" -- the driver is assumed to be in control at all times, with the car assisting. If the car assists too much then people will start treating it as if it were an L3 system, but it's really not.

Re:Teslas running Autopilot have been in 273 crashes in less... by boringg on Wednesday June 15, 2022 @09:31AM (#31752604)
Are you talking from sleep or in the back seat of the car (both illegal)?! 10 seconds is long as hell - i have no clue what you are talking about.
Re:Teslas running Autopilot have been in 273 crashes in less... by robertlagrant on Wednesday June 15, 2022 @09:36AM (#31752675)
Definitely sleeping in a cat is illegal.
Re:Teslas running Autopilot have been in 273 crashes in less... by hendrikrassmann on Wednesday June 15, 2022 @09:35AM (#31752660)
I'm just going to interpret "[autopilot] couldn't deal with something" as "autopilot would also have crashed the car in that situation".

To me a situation in which autopilot would have crashed, gave control to the driver, who couldn't "save" the bad situation, is just an autopilot crash.

Re:Teslas running Autopilot have been in 273 crashes in less... by zozbot234 on Wednesday June 15, 2022 @09:59AM (#31752974)
Autopilot is a SAE level 2 driver assist system; it should never be trusted to keep you safe. Whether or not the system bails out completely prior to a crash is immaterial.
Re:Teslas running Autopilot have been in 273 crashes in less... by jsight on Wednesday June 15, 2022 @10:40AM (#31753582)
That's a definition that no other car company would accept either, as their systems would score very poorly.
Re:Teslas running Autopilot have been in 273 crashes in less... by d_watt on Wednesday June 15, 2022 @09:38AM (#31752699)
1. While that’s true there’s no reason to think that extreme case is normal for these.

2. Even if it was, it’s sort of irrelevant. When considering the safety of the feature, the whole process, including allowing the driver to become distracted, must be considered. This isn’t a clean room where you can just focus on the performance of the models, this is a real life car interacting with other unpredictable cars, being driven by an imperfect human. If the nature of these systems is that it makes the drivers complacent, that’s absolutely something that needs to be taken into account when thinking about the overall experience of a self driving system.

Re:Teslas running Autopilot have been in 273 crashes in less... by aqme28 on Wednesday June 15, 2022 @09:40AM (#31752723)
What's your alternative? Tesla has also faced criticism for turning off autopilot less than a second before the crash, and then claiming that because the car was not on autopilot it was driver error.

"On Thursday, NHTSA said it had discovered in 16 separate instances when this occurred that Autopilot “aborted vehicle control less than one second prior to the first impact,” suggesting the driver was not prepared to assume full control over the vehicle.

CEO Elon Musk has often claimed that accidents cannot be the fault of the company, as data it extracted invariably showed Autopilot was not active in the moment of the collision. "

* https://fortune.com/2022/06/10/elon-musk-tesla-nhtsa-investi...

Re:Teslas running Autopilot have been in 273 crashes in less... by bradfa on Wednesday June 15, 2022 @09:42AM (#31752747)
My alternative is to present the data including how long before the crash the system deactivated and not just report all of the incidents into one category. This requires nuance and judgement in reporting.

I'm not blaming Tesla or the NHTSA for this, I'm blaming the WP as their reporting on this lacks any information and seems rather to just paint the data in such a way to make Tesla look bad. There's no room for interpretation by the reader because no actual useful data is presented.

Edited to correct my naming of the article source.

Re:Teslas running Autopilot have been in 273 crashes in less... by jsight on Wednesday June 15, 2022 @10:40AM (#31753594)
Even Tesla uses 5 seconds and not 1 second. The Fortune article was misleading.
Re:Teslas running Autopilot have been in 273 crashes in less... by programmer_dude on Wednesday June 15, 2022 @09:27AM (#31752556)
Why? 10 seconds is not enough. It seems perfectly reasonable to assume Autopilot needs to do better here.
Re:Teslas running Autopilot have been in 273 crashes in less... by robertlagrant on Wednesday June 15, 2022 @09:35AM (#31752657)
I disagree. How could a system look much further ahead in a dynamic environment?
Re:Teslas running Autopilot have been in 273 crashes in less... by deschutes on Wednesday June 15, 2022 @09:43AM (#31752775)
This is exactly why level 2 systems will never be safe. The constraints set the human up to fail.
Re:Teslas running Autopilot have been in 273 crashes in less... by zozbot234 on Wednesday June 15, 2022 @10:11AM (#31753162)
"Level 2" is just lane centering + adaptive cruise control. There's nothing about this combination that "sets the driver up to fail". Some drivers like to pretend that the system is way smarter than it really is, but that's a case of "play stupid games, win stupid prizes". You can't fix that with changes on the system side.
Re:Teslas running Autopilot have been in 273 crashes in less... by giraffe_lady on Wednesday June 15, 2022 @09:42AM (#31752752)
If "as good as we can do" isn't good enough than it just isn't. If it can't offer enough time for a driver to reasonably take over then it can't meaningfully function in its intended role.

I'm not informed enough about this to say whether it falls under that threshold or even what that threshold is. But the limits being clear technical ones does not change the degree to which they are limits.

Re:Teslas running Autopilot have been in 273 crashes in less... by robertlagrant on Wednesday June 15, 2022 @04:52PM (#31759332)
What I mean is, can you imagine any system that can see 20s (say) ahead in terms of other people's driving? It's an eternity.
Re:Teslas running Autopilot have been in 273 crashes in less... by IdEntities on Wednesday June 15, 2022 @09:24AM (#31752527)
It does seem like there should be some happy medium between this and Tesla's policy of not counting it as an Autopilot crash if it disengages one second before impact.
Re:Teslas running Autopilot have been in 273 crashes in less... by foobarian on Wednesday June 15, 2022 @09:27AM (#31752561)
I guess at the end of the day I mostly care about the overall accident rate, AP or not. Since the premise is that this kind of car will be safer, you would expect that rate to be lower.
Re:Teslas running Autopilot have been in 273 crashes in less... by jsight on Wednesday June 15, 2022 @10:41AM (#31753606)
Tesla uses a 5 second threshold, not 1 second.