News for hackers. Stuff that matters.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by slg on Tuesday September 12, 2017 @02:25PM (#15229977)
I think Musk looks at it differently. There appear to be two fundamental truths about the current autopilot system. First off, the number of fatalities that have occurred with autopilot active compared to the amount of miles driven with autopilot active suggest that autopilot is safer than a human driver. Secondly, autopilot still is not flawless and it is possible for it to cause fatalities.

Some people feel the latter should be enough to stop allowing drivers to turn on autopilot. I am betting Musk feels that the former serves as a moral obligation to get the safety features of autopilot in as many cars as possible in order to save as many lives as possible. He is throwing the switch on the trolley tracks [1].

[1] - https://en.wikipedia.org/wiki/Trolley_problem

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Tuesday September 12, 2017 @02:38PM (#15230182)
"the number of fatalities that have occurred with autopilot active compared to the amount of miles driven with autopilot active suggest that autopilot is safer than a human driver."

Obviously you see how this deduction is subject to dozens of biases stemming from the fact that people turn on autopilot when the road conditions are safe to begin with. One would have to really carefully filter this data to avoid these biases, otherwise such conclusions are absolutely bogus.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by toomuchtodo on Tuesday September 12, 2017 @02:45PM (#15230300)
The 40% reduction in accident rate was the result of the NTHSA investigation: https://techcrunch.com/2017/01/19/nhtsas-full-final-investig...

"It’s essentially as good as result as Tesla can have hoped for from the U.S. traffic safety agency’s investigation, which took place over the last six months. Reuters reported earlier on Thursday that the investigation would not result in a recall of Tesla vehicles, but the full findings show that in fact, the federal regulatory body found plenty to praise while conducting its inquiry.

The investigation does conclude with a minor admonition that Tesla could perhaps be more specific about its system limitations in its driver-assist features, but acknowledges that all required information is present and available to drivers and vehicle owners."

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Tuesday September 12, 2017 @02:53PM (#15230413)
I know this report. This does not deal with the bias problem however. Obviously it reduced the number of accidents in good road conditions where the autopilot works and is primarily used (much like auto-stop feature did and BLIS). Particularly after they introduced the driver monitoring (this report was conducted after that) - now in fact the driver using autopilot is likely more alert then one not using it.

But that does not indicate anything about conditions where autopilot should not be used in which it is gravely dangerous.

It is all about tail of the distribution, which why it is not so obvious.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by semiel on Tuesday September 12, 2017 @03:06PM (#15230666)
Why does it matter if it's dangerous if used incorrectly, if the majority of users use it correctly, and the overall effect is that fatalities go down?
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Tuesday September 12, 2017 @03:19PM (#15230920)
I don't think the argument here is whether technology features can improve safety. The core of the argument is (and always has been) over misleading marketing and naming (suggestive "autopilot"), which exactly encourages the misuse of the feature. When used correctly, with alert driver it can clearly be beneficial. But when misused e.g. by this poor young person who plowed into a truck, this feature could be deadly.

This has a long way to go for true "autonomy" and until then such marketing should be avoided and examples of misuse (which youtube is full of) should be explicitly discouraged and if possible penalized. Tesla should be more explicit and pro-active about it. This is my only point really.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by ScottBurson on Tuesday September 12, 2017 @05:34PM (#15233029)
40 years old is "young"? You must be as old as I am :-)
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Tuesday September 12, 2017 @05:53PM (#15233205)
I was thinking about the Chinese boy who hit the truck parked on the service lane, not the guy who decapitated himself in Florida. But either way, both were tragic.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by usrusr on Tuesday September 12, 2017 @03:33PM (#15231224)
Put "don't crash into things" in the manual and all accidents are incorrect use by definition? That's why it matters.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by yahna on Tuesday September 12, 2017 @04:19PM (#15232064)
uh, because if the effectiveness drops dramatically then you are literally going to be killing people.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by slg on Tuesday September 12, 2017 @03:11PM (#15230773)
>But that does not indicate anything about conditions where autopilot should not be used in which it is gravely dangerous.

Yes it does include those conditions because this specific accident occurred in conditions in which autopilot should not be used. That single fatality is the only one that autopilot has seen in close to one billion miles. That is an order of magnitude better than traditional fatality rates.

That leaves two possible scenarios. Either people are likely to use this system incorrectly, in which case many of those billion miles were used in poor conditions for the autopilot. Or few people are likely to use the system incorrectly, in which there is little to worry about since the autopilot system has never been involved in a reported fatality when used properly.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by YSFEJ4SWJUVU6 on Tuesday September 12, 2017 @04:15PM (#15231985)
There was another accident in China, in a controlled access divided highway where a Tesla failed to notice a maintenance vehicle moving slowly ahead on the side of the road, ended up rear-ending it and killing the driver.[1]

By the way, can you point me to statistics about “traditional fatality rates” at controlled access divided highway in conditions where the line markings are clearly visible? It's dishonest to compare apples to oranges, especially given that a Tesla can't or won't recognize one from the other.

[1] https://www.nytimes.com/2016/09/15/business/fatal-tesla-cras...

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Tuesday September 12, 2017 @04:04PM (#15231831)
How can autopilot be involved in a fatality when used correctly, when by very definition the correct use implies alert driver who is responsible for everything that happens?
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by slg on Tuesday September 12, 2017 @05:20PM (#15232871)
We have both used the term "involved" and not at fault. If autopilot is on when (or immediately before) a fatality occurs, that is being involved in a fatality. The driver may be at fault in those instances if they are not alert. Although it is also possible that a separate driver is at fault and both the autopilot and Tesla driver performed adequately. For example a second driver might rear end the Tesla driver and push the car into oncoming traffic.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by mcguire on Tuesday September 12, 2017 @03:14PM (#15230823)
That sounds like a comparison between autopilot miles and general driving miles. What would the comparison look like between autopilot miles and interstate highway miles?

Edit: nope, I was wrong. 1.3 to 0.8 airbag deployment crashes per million miles for Tesla cars before and after autopilot release.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by chc on Tuesday September 12, 2017 @03:30PM (#15231152)
This seems like trying to argue that brakes are bad because, while people normally use them at times when they should stop, it's also possible to use your brakes at times when you shouldn't stop.

The fact that something can be used used in a dumb manner is good to know so you can avoid doing so, but that doesn't negate the fact that cars are safer overall with it than without it.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by frgtpsswrdlame on Tuesday September 12, 2017 @03:42PM (#15231401)
Yes but if I asked you to prove brakes were safer you'd be able to do it pretty easily. The fact that no one has actually set out and done a study proving that autopilot is safer than human driving is disconcerting considering these vehicles are already being put on the road.

Seeing people abandoning the precautionary principle so they can latch onto an over-marketed, over-promised Muskian view of the future is sad. And in five or ten years we're all going to be looking back wondering what made us so dumb to think that computers could actually drive cars.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by Fricken on Tuesday September 12, 2017 @10:21PM (#15235012)
Toyota came out saying you'd have to gather 8.5 billion miles of driving data to make any claims with statistical certainty about the ability of any autonomous driving system to prevent fatalities (I've heard other outrageous numbers thrown out to this effect, though I don't recall them off the top of my head).

Though by the time you get to the 8 billionth mile the technology will have evolved, rendering the earlier data moot. So it will be pretty much impossible to do any sort of authoritative study on how safe this technology is until it is widespread, and mature.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by MarkMc on Tuesday September 12, 2017 @11:16PM (#15235224)
If a study could reliably demonstrate that autonomous vehicles have fewer collisions it would strongly hint that fatalities are also fewer.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by carlmr on Wednesday September 13, 2017 @04:40AM (#15236525)
Number of collisions and number of fatalities will not necessarily have the same proportions as for humans.

You could have a car that never gets into little collisions that often happen to human drivers because of carelessness, but are rarely deadly, but the same AI might have a faulty reasoning every once in a while leading it to accelerate to 200kph before running straight into a wall. This hypothetical AI would have very few collisions, but maybe still be much more deadly than a human.

Humans are the only data we currently have significant numbers of miles logged for. Any extrapolation to AI is meaningless.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by chc on Tuesday September 12, 2017 @04:16PM (#15231996)
After the first fatality while on Autopilot, the NHTSA did a study on whether Autopilot was inherently safe and whether it had any defects that needed to be addressed. It found that Teslas with Autopilot were substantially safer than Teslas without. I'd like to see a better study (since that one was mainly aimed at answering the question of whether Teslas with Autopilot should be recalled), but someone has looked into it at least.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by frgtpsswrdlame on Tuesday September 12, 2017 @04:39PM (#15232353)
That's not quite accurate, the NHTSA study was not designed, in any way, to compare human-driven miles and autopilot-driven miles for safety. The only thing it showed was that vehicles with TACC + Autosteer had less accidents than vehicles with just TACC. Whether TACC + Autosteer is safer than human drivers is up for debate.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by URSpider94 on Tuesday September 12, 2017 @08:59PM (#15234586)
True. However, it shows a very substantial decrease in accident rate in the population with Autopilot features, vs. the population without. Correlation, not causality. It could be that Model X drivers are inherently safer than Model S drivers (they would be in the latter set), or it could be that just having the features in the car makes drivers do better even without using them.

However, the inference that Autopilot reduces incidents per mile seems very likely to be true.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by patcheudor on Tuesday September 12, 2017 @04:21PM (#15232082)
The key point is that you can say things like, "per million miles, Tesla auto pilot use has resulted in X fewer fatalities", however, unless the data leading to that statement has been normalized against data representing the exact use case of Tesla auto pilot then it is false. The only way to say that Tesla autopilot is safer per million miles than a human is to base the figure on when the Tesla auto-pilot could be used. I'm not sure I've ever seen that data from Tesla. Who knows, maybe they have it and I've just not seen it. If they do, very cool. I would assume they could get the data by taking sensor readings from Tesla cars under human control in situations where auto-pilot could be used.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by chc on Tuesday September 12, 2017 @04:50PM (#15232502)
The NHTSA found a 40% safety improvement when comparing Teslas with Autopilot to Teslas without. I wouldn't put a huge amount of stock in the exact number, but because one group never uses Autopilot and the other offers a realistic view of when people actually do use Autopilot, it seems like enough to say "Yes, Autopilot makes cars safer in aggregate."
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by patcheudor on Tuesday September 12, 2017 @05:40PM (#15233097)
The data is suspect at best and should require a third party evaluation. I'm speculating that the reason for that 40% safety improvement is more a result of the difference between where autopilot can and cannot be used. People with autopilot equipped Tesla vehicles get the option because they likely drive more highway miles where it can be used mile after mile. Those who don't, likely don't and may be in statistically more dangerous driving situations like short commutes over high speed roads. When I commuted to the office, I'd pull out of my 25 MPH subdivision road and immediately accelerate to 65-70 MPH onto the highway and proceed to drive two miles. There's no reason for autopilot in those conditions so I wouldn't purchase the package, but yet making a left-hand turn onto a five lane highway where cars are regularly traveling at high speed is one of the more dangerous things you can do while driving for which if I got hit in a side impact could easily be killed and because of the location on a highway, would be counted as a highway fatality.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by overcyn on Tuesday September 12, 2017 @07:49PM (#15234126)
> The data is suspect at best and should require a third party evaluation.

And the NHTSA doesn't count as a third party?

> I'm speculating that the reason for that 40% safety improvement is more a result of the difference between where autopilot can and cannot be used.

To say that tesla owners without autopilot tend to drive in situations with 40% more likelihood of accidents than those with autopilot, sounds like a massive stretch without data of your own.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by URSpider94 on Tuesday September 12, 2017 @09:36PM (#15234778)
You are making an incorrect assumption. When Tesla released their original Autopilot, it was a no-charge SW update for all cars equipped with the necessary hardware (which was all cars built within the previous xx months). Thus, the drivers with Autopilot capability were driving the same commute in non-Autopilot capable cars the day before. There was no customer selection based on perceived utility of Autopilot.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by chc on Tuesday September 12, 2017 @09:19PM (#15234680)
I think you misunderstand the data. This isn't "people who opted into Autopilot vs. people who opted out" — the no-Autopilot group is people whose Teslas were made before Autopilot was introduced.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by felippee on Wednesday September 13, 2017 @01:09PM (#15240303)
And therefore obviously this is not an unbiased control group. Perhaps the more recent teslas have slightly better/less used brakes? Have they controlled for that? There are countless ways in which such conclusions can be flawed.

Statistics is really tricky, even with very large samples at recent presidential election had shown that beyond any doubt.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by carlmr on Wednesday September 13, 2017 @04:43AM (#15236540)
How many fatal collisions did they use in this dataset? This can't be a serious assessment.
Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by dmix on Tuesday September 12, 2017 @04:41PM (#15232374)
With the same logic if people use it when road conditions are safer then they are simply using it as intended.

The design can help prevent people from using it when it's not appropriate or have mechanism to keep them alert and focused.

That is all NTSB seems to be saying here... they aren't calling into question the idea of highway driving assist systems, which are (already) showing potential to significantly make highway driving safer - the time when people are driving at the highest speeds.

No system will be perfect from preemptive testing either, it really does take real world mass adoption to detect some uncommon flaws unfortunately... Tesla is going to bear the brunt of this fact. You simply can't simulate every human (irrational) behaviour nor can you simulate every environment it will be used in.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by URSpider94 on Tuesday September 12, 2017 @08:49PM (#15234523)
Note, the original NHTSA report compares accidents per mile traveled in Tesla vehicles with and without autopilot, and notes that vehicles WITH autopilot have 40% fewer accidents than those without.

This seems like very clean data, as it doesn't actually consider how often autopilot is turned on, and it's over a fairly large sample of drivers, locales and miles driven.

This is just correlation, not causality, but the effect is too big to be by chance.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by dwaltrip on Tuesday September 12, 2017 @09:58PM (#15234875)
The comment you are replying to is suggesting that the miles driven with autopilot may have been inherently safer miles, e.g. autopilot was more likely to be turned during the safer parts of a drive.

If true, this would be an unfortunate example of selection bias.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by URSpider94 on Wednesday September 13, 2017 @01:10AM (#15235721)
You are missing the point. The report doesn't compare miles driven with and without autopilot. It compares ALL miles driven in cars with Autopilot function, whether it is turned on or not, vs. cars without Autopilot function.

To boot, these are, for the most part, the same cars before and after, since Tesla shipped cars for almost a year with the Autopilot hardware built in but not activated, then activated it for all cars at virtually the same time via an OTA. Before that date, any miles clocked show up in the "no autopilot" column, the next day they show up in the "with Autopilot" column.

To further flog an expired equine, the study showed a 40% reduction in airbag actuations per million miles driven across all miles driven in cars with vs. without Autopilot function, not comparing only miles where Autopilot was turned on.

There are certainly possibilities for this data to be skewed or biased, but it's definitely not a comparison of safe Autopilot miles vs. unsafe manual miles.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by rohit2412 on Tuesday September 12, 2017 @04:47PM (#15232471)
> suggest that autopilot is safer than a human driver.

This is what is misleading in my opinion. The study says that Tesla's assistive technology works, that is they assist humans to make driving safer. All driving assistance technologies satisfy this.

In other words

Autopilot + human is better than a human.

Then why is the furore about Tesla? Because they named it autopilot and call it safer than a human. To say autopilot is safer than a human seems to imply that autopilot alone reply be better than a human driver.

Maybe you're smart enough to see this, but as is evident, many believe that autopilot alone is better than a human driver.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by maxerickson on Tuesday September 12, 2017 @03:33PM (#15231223)
There's nothing controversial about front crash avoidance being beneficial, especially with auto braking. As a feature it is more and more widely deployed, probably becoming standard in the next few years.

It would be interesting to see how often autobraking is key and how often the rest of the autopilot improves safety.

Re:NTSB: Tesla’s Autopilot UX a “major role” in fatal Model ... by Shivetya on Tuesday September 12, 2017 @04:50PM (#15232501)
but most safety devices are explicitly for when conditions are not their best and sadly Autopilot doesn't function in those bad conditions. Its a fair weather driver assistant.

His moral obligation is to admit its limitations instead of grand standing on what it might do one day and dancing around with selected statistics.

the simple fact is, it failed and will continue to do so. they have made some technology choices they may not be able to surmount not matter how much noise they generate or their sycophants generate.

the promise of level 4 and 5 autonomous driving is so great that we cannot afford to have it damaged in the public eye