News for hackers. Stuff that matters.
Re:A Tragic Loss by BinaryIdiot on Thursday June 30, 2016 @04:46PM (#12011514)
I mean I understand Tesla has to make a statement here and I understand they want to ensure everyone that it's not really their fault but to title a post "A Tragic Loss" and then spend the majority of the post discussing all of your car's safety features and how it wasn't your fault just seems tone deaf and distasteful to me.

Maybe they had to do it for legal reasons I don't know (I'm certainly not a lawyer) and I'd love to own a Tesla but couldn't they have worded this a little more sympathetic and a little less lawyer?

Re:A Tragic Loss by loceng on Thursday June 30, 2016 @04:51PM (#12011569)
I feel 'A Tragic Loss' sets the tone for the remaining highly technical overview, instead of the technical breakdown seeming tone-deaf, it added tone until getting to the concluding paragraph.

Unfortunately, fortunately, Tesla is having to educate people and being very clear to not allow room for panic and unwarranted fear mongering.

I would say it is as to the point as it can be, and that it is heartfelt.

Re:A Tragic Loss by mevile on Thursday June 30, 2016 @04:55PM (#12011613)
In addition it had important information for how other Tesla drivers can use the auto-pilot feature more safely. The article combines condolences and helpful safety information to prevent this kind of thing from happening again. Also, you don't see GM making a blog post every time someone passes away in a car they make.
Re:A Tragic Loss by morsch on Thursday June 30, 2016 @05:09PM (#12011748)
Then again, GM sells more vehicles in a week than Tesla has sold in its entire history.
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @05:29PM (#12011915)
This.

Notice how quick they are to bring up "this is the first fatality in 130 million miles", but AFAICT, traffic fatalities in the US occur at a frequency of around 10 per billion miles [1], which is the same.

So even though this is just one data point, it's spot on the current average for fatality frequency in normal cars.

Furthermore, to gather enough statistics to be able to say with confidence "semi-autonomous Teslas are/aren't safer than normal cars", Tesla either needs to increase their sales volume by several orders of magnitude, or we'll have to wait for ten years.

[1] https://en.wikipedia.org/wiki/List_of_motor_vehicle_deaths_i...

Re:A Tragic Loss by iraphael on Thursday June 30, 2016 @05:41PM (#12012001)
Is there a statistical difference in accident rate between high and low income populations? If so, do we know what the fatality/miles rate is in the group that would be able to afford a tesla? When I read the blog post, I couldn't help but think that while tesla's rate might be smaller than the national average, it is also not a fair comparison to draw conclusions from.
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @05:52PM (#12012080)
IDK about statistical difference, but the mechanical difference between a brand new high-end full-size car and a twenty year old Honda Civic is going to be massive. Just look at the downward slope of that curve of fatalities per billion miles in each year. Also remember that those numbers are averages over the entire car population in each year, so most cars in the 2015 data are quite a bit older than 2015.

If we had data for the "high end modern full-size car" category, it would most definitely be lower than 10 fatalities per billion miles.

Re:A Tragic Loss by mozumder on Thursday June 30, 2016 @06:54PM (#12012487)
The IIHS compares car model fatality rates: http://www.iihs.org/iihs/topics/driver-death-rates

If you want to do the numbers to compare the Tesla to other cars, where they measure driver fatalities per million registered years, do this:

130,000,000 miles / 12,000 average miles per year per car = 10,833 years.

That's 10,833 registered years for the Model S.

The IIHS site normalizes to deaths per million registered years, so multiply that number by 92.3, and since we have one death so far, the Tesla Model S is now at 92.3 driver deaths per million registered car years.

Let's compare to other car models:

  Ford Taurus 2WD: 20 deaths
  Hyundai AccentL: 86 deaths
  Lexus LS 460 2WD: 18 deaths
  Acura TL 2WD: 5 deaths
  Audi A4 4WD: 0 deaths (yes, a bunch of car models had zero driver deaths)
  And average for ALL 2011 vehicles: 28 deaths.
So, right now, it looks like the Tesla Model S is about 4x deadlier than the average car when using Autopilot, and about 10-20x deadlier than the safest cars.
Re:A Tragic Loss by tr1ck5t3r on Thursday June 30, 2016 @07:49PM (#12012808)
When these automated cars can complete a journey __without__ handing back to the human, only then can those journey miles be added to the miles driven under autopilot claim. Until such time, consider all automated cars a considerable risk to other road users.
Re:A Tragic Loss by barefootcoder on Friday July 01, 2016 @01:53AM (#12014107)
How are you defining automated? No truly autonomous cars are available yet, so they're all some form of driver assist. How are these a risk to other road users, and at which point do they become a risk and not a safety benefit?

Auto-pilot is semi-autonomous... I gather you consider that a risk...

What about Subaru EyeSight? It can autonomously brake. I can drive for hours on the freeway without ever hitting the brake nor gas, even in stop and go traffic. It has warned me multiple times of a sudden slowdown just as I noticed it. It hasn't yet saved me from anything, but if any of those circumstances I'd been distracted (even for a legit reason) it could have. It once warned me of a motorcycle in my path on a very dark night when the dim tail-light of the motorcycle was overwhelmed by the much brighter tail-lights of the cars to its left and right. I would have seen it soon enough, but the car saw it first. Is that a risk to other road-users? Yet, it's automated by some definition.

What about various other manufacturer's lane keeping features? That automation to some degree.

What about ABS? Stability control? Again... automation to some degree.

All of these have their detractors, yet I think statistics clearly show an improvement with each level of driver assist.

Re:A Tragic Loss by mthoms on Thursday June 30, 2016 @07:44PM (#12012775)
>So, right now, it looks like the Tesla Model S is about 4x deadlier than the average car when using Autopilot, and about 10-20x deadlier than the safest cars.

How you can draw such a conclusion from a singular data point? That's beyond ridiculous.

Re:A Tragic Loss by amscanne on Thursday June 30, 2016 @09:40PM (#12013296)
Seems as valid (and invalid) as the implied conclusion here:

> This is the first known fatality in just over 130 million miles where Autopilot was activated. Among all vehicles in the US, there is a fatality every 94 million miles. Worldwide, there is a fatality approximately every 60 million miles.

Re:A Tragic Loss by mthoms on Friday July 01, 2016 @12:20AM (#12013852)
Fair enough. I think the framing matters a bit though.

"4 Times Deadlier!" certainly comes across as sensationalist based on such flimsy data (never mind that the real figure is actually 3.2 and the parent chose to round up rather than down to serve his/her purpose).

Whereas Tesla's statement comes across more as a statement of fact (albiet quite self-serving.. no question about that).

Re:A Tragic Loss by jfoster on Thursday June 30, 2016 @10:01PM (#12013388)
The 130 million miles is not Model S overall, but Model S with autopilot engaged. It's also only the first 130 million miles, so the sample size is currently 1. This will be much more interesting to look at in 5 years, and at the moment it tells us nothing about Model S.
[dead]
Re:A Tragic Loss by zaroth on Thursday June 30, 2016 @10:12PM (#12013441)
.
Re:A Tragic Loss by saulrh on Friday July 01, 2016 @01:59AM (#12014123)
To the people downvoting the parent of this comment: yeah, I should have put something like [deleted] in there instead of just hacking in random characters. You can stop now. It's no longer useful.
Re:A Tragic Loss by saulrh on Thursday June 30, 2016 @10:44PM (#12013572)
[deleted]
Re:A Tragic Loss by zaroth on Thursday June 30, 2016 @11:13PM (#12013661)
(Can only delete comments that do not have replies)
Re:A Tragic Loss by saulrh on Thursday June 30, 2016 @11:18PM (#12013673)
Fair enough. I'd looked at the thumbnails, which generally didn't have hands on the wheel. I'll delete my comment if I can.
Re:A Tragic Loss by xiphias on Thursday June 30, 2016 @06:06PM (#12012201)
Having the same fatality statistic was not enough for Google to bring autonomous driving into production. Many people think that it should be at least an order of magnitude safer than manual driving
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @06:13PM (#12012248)
Sure. The problem with this is statistics: you need to have your autonomous cars travel at least 100 billion miles before you can confidently say they're an order of magnitude safer.

A normal car drives about 100 000 miles in 10 years. You then need one million autonomous cars driving around for a decade before you even know whether they're safer!

Re:A Tragic Loss by ringwalt on Friday July 01, 2016 @09:50AM (#12015978)
You don't need an equal sample size to determine if autonomous cars are safer. But if you're comparing to all the cars on the road today, you need quality data that matches the distribution of cars today. Google isn't going to prove that autonomous cars are safer if they only test in Palo Alto in ideal weather conditions.
Re:A Tragic Loss by jgalt212 on Thursday June 30, 2016 @06:37PM (#12012390)
That's very true, but if you know your product well enough, and you perform well conducted experiments, you can come up with a good estimate for this without actually having your cars travel 100 billion miles.
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @06:58PM (#12012509)
Sure. The main issue with that is the unknown unknowns. In hypothetical cars an order of magnitude safer than today, we're talking about events so rare that a single (hypothetical) accident which kills all 7 passengers due to the Tesla misinterpreting an obscure Hungarian road sign meaning "bridge out ahead" will significantly influence your safety statistics.
Re:A Tragic Loss by xiphias on Thursday June 30, 2016 @07:25PM (#12012678)
There are enough youtube videos with people falling asleep in Tesla on the highway and a Tesla switching lanes and almost causing a frontal crash. These are known problems.

Maybe a billion miles are needed for a fatal crash, but for small mistakes it's much less.

Re:A Tragic Loss by protomyth on Thursday June 30, 2016 @11:42PM (#12013735)
> A normal car drives about 100 000 miles in 10 years.

Can you give a source for that number as it seems a bit low given warranty numbers.

Re:A Tragic Loss by weaksauce on Friday July 01, 2016 @12:15AM (#12013835)
my insurance estimates the average driven per year is around 12k miles so 100000 miles in 10 years is about right or a little low.
Re:A Tragic Loss by gshulegaard on Thursday June 30, 2016 @06:11PM (#12012232)
Your statistics seems to be at odds with the statistics quoted in their post:

"Among all vehicles in the US, there is a fatality every 94 million miles. Worldwide, there is a fatality approximately every 60 million miles."

Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @06:14PM (#12012254)
1/94 million is very close to 10/1000 million, which is what I said.
Re:A Tragic Loss by gshulegaard on Thursday June 30, 2016 @06:24PM (#12012314)
Close is not the same and neither is the same as 1/134 million. Of course I have no idea if the differences are statistically significant, and it's likely impossible to tell given the lack of data on Tesla autopilot at the moment (new).
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @06:27PM (#12012339)
Well of course it's not statistically significant, 1/134 is based on a single data point. At this level of confidence, all these numbers are equal. If this was the first fatality in 1000 million miles, it might be an indication of higher safety. Might.
Re:A Tragic Loss by Dr_tldr on Thursday June 30, 2016 @10:36PM (#12013541)
Yeah, but that's not how people's emotions usually work.

Although US foreign policy and intelligence decisions were more or less directly responsible for 9/11, you don't lecture people at Ground Zero about the dangers of blowback and not being aware of your government's activities.

There's no such thing as "condolences, but...", and Elon Musk has shown a pattern of this kind of tone-deafness before. Not to say he's not brilliant and not to say autonomous cars won't ultimately save many lives, just that he should either listen to his PR department if he overruled them, or fire his PR department if they did this without him.

Re:A Tragic Loss by copperred on Friday July 01, 2016 @09:14AM (#12015728)
"There's no such thing as "condolences, but...", and Elon Musk has shown a pattern of this kind of tone-deafness before. Not to say he's not brilliant and not to say autonomous cars won't ultimately save many lives, just that he should either listen to his PR department if he overruled them, or fire his PR department if they did this without him."

Excellent, Doc. Further to the point about these statements and Musk's leadership: not too long ago Tesla would include the fact that nobody has been killed in a Tesla in their public statements. I found it completely inappropriate since we all knew it was just a matter of time, sadly. Again they play with fire, as another death with autopilot will really wreck their statistics.

Re:A Tragic Loss by dmix on Thursday June 30, 2016 @05:02PM (#12011686)
And regardless this was primarily an after-the-fact technical analysis with relevant information to other Tesla owners, the primary purpose was not a formal announcement of a death. The news typically handles that role.
Re:A Tragic Loss by rasz_pl on Thursday June 30, 2016 @08:58PM (#12013113)
> auto-pilot feature

there is no such feature, there is a MobilEye _lane following_ system Tesla repackaged under Autopilot(TM) brand.

Say it out loud - lane following. Mercedes sold this same tech almost 10 years ago, difference is Tesla felt pressure and started believing their own marketing lies about autonomous driving.

Re:A Tragic Loss by ams6110 on Thursday June 30, 2016 @09:00PM (#12013124)
They call it autopilot. Words mean things. That word creates an impression that it is more capable than it really is.
Re:A Tragic Loss by ec109685 on Friday July 01, 2016 @02:43AM (#12014266)
The hardware might be the same but the compute has evolved.
Re:A Tragic Loss by sliverstorm on Thursday June 30, 2016 @06:46PM (#12012439)
GM's cars don't have autopilot driving their passengers into a semi (that I know of)
Re:A Tragic Loss by ams6110 on Thursday June 30, 2016 @08:59PM (#12013116)
I had posted the same comment before I saw this one (I deleted mine).

I would assume that the higher-end GM cars do have an automatic braking collision avoidance system by now, since that's a pretty standard feature above a certain price point. And I would assume it's not foolproof either, but at least it doesn't lead the driver to think he can take his hands off the wheel and not pay attention to what's happening on the road.

Re:A Tragic Loss by viraptor on Friday July 01, 2016 @12:11AM (#12013823)
> at least it doesn't lead the driver to think he can take his hands off the wheel and not pay attention

Tesla reiterates every time and makes you confirm you understand that this is not the case. If the driver did it, that's completely on them being irresponsible.

Re:A Tragic Loss by fucking_tragedy on Friday July 01, 2016 @01:25AM (#12014043)
It's called Autopilot™.
Re:A Tragic Loss by manicdee on Friday July 01, 2016 @02:24AM (#12014203)
The autopilot in planes works the same way: pilot is strongly recommended to keep hands on the controls, autopilot will release control if any conditions fall outside the autopilot's functional envelope.
Re:A Tragic Loss by fucking_tragedy on Friday July 01, 2016 @11:50AM (#12017123)
Pilots are trained professionals in the field where autopilot is relevant, consumers are not.
Re:A Tragic Loss by manicdee on Monday July 11, 2016 @12:47AM (#12068956)
and even though they are highly trained they still keep their attention on the plane's operation.

And pilots still make mistakes when adjusting to a context where the autopilot has unexpectedly handed control back to the humans.

Re:A Tragic Loss by lttlrck on Friday July 01, 2016 @09:33AM (#12015863)
They should not be using a blog post to convey critical safety information to their customers.
Re:A Tragic Loss by ringwalt on Friday July 01, 2016 @09:44AM (#12015936)
There's a warning that makes it clear that you need to maintain your full attention on the road, when you enable Autopilot and every single time you take your hands off the wheel. If anything, giving users specific scenarios where Autopilot may fail would take away from that fact, and make it seem like there are other cases where it's ok to take your eyes off the road.
Re:A Tragic Loss by Shivetya on Thursday June 30, 2016 @07:07PM (#12012569)
All that matters is, did the technology fail. I don't care about crash rates in other cars, if the impact had been different, the only fact that matters in this case is, did the tech fail. If so then is it safe to leave on or should it be disabled across the board until it cannot fail this scenario again.

one failure and they will take a minor publicity and money hit, two and its going to devastating

Re:A Tragic Loss by cloakandswagger on Thursday June 30, 2016 @10:10PM (#12013433)
Whether it performed as designed or not really isn't relevant. The salient point here is Tesla's promotion of an "auto-pilot" system that encourages users to take their attention off of the road and put too much faith in a glorified lane-following system.

Now, this is pure speculation, but I really can't imagine running into the side of an 18-wheeler crossing the highway unless A) I was traveling at a reckless speed (unlikely given that "auto-pilot" was on) or B) I wasn't paying attention to the road.

Re:A Tragic Loss by iofj on Friday July 01, 2016 @01:37AM (#12014074)
For one thing, it lookslike the car kept driving after the crash, hit 2 fences and a pole, then tried to get back on the road before it shut down. Sounds like pretty big screwup.

https://img.washingtonpost.com/blogs/the-switch/files/2016/0...

Re:A Tragic Loss by informatimago on Friday July 01, 2016 @04:51AM (#12014670)
Well again, the Tesla autopilot is not a google car AI pilot system.

IMO, human (customers') expectations require more than a mere autopilot.

Re:A Tragic Loss by angusb on Thursday June 30, 2016 @05:06PM (#12011713)
It's not just about Tesla though.

They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

Self driving tech is poised to save many many lives. So from a utilitarian perspective, it's probably justified to take extraordinary measures to make sure reactionary media and public whim doesn't kill it off, however uncomfortable that might seem in the short term.

Whilst this case is incredibly sad (and I don't want to downplay that in any way), if you're trying to minimise the overall amount of fatal crashes, exonerating the tech is the priority (if it is truly not at fault).

Re:A Tragic Loss by vkou on Thursday June 30, 2016 @05:24PM (#12011862)
They could defend the public's perception of autonomous vehicles in general by not rushing to market a beta that is less technically capable then other autonomous systems being worked on by their competitors.
Re:A Tragic Loss by angusb on Thursday June 30, 2016 @05:32PM (#12011930)
Are you saying that just based on the fact that they've been developing it for less time than Google, or is there a more in depth case for that somewhere? I would be very interested to read about that if there is.
Re:A Tragic Loss by vkou on Thursday June 30, 2016 @05:37PM (#12011976)
1. Tesla makes it clear that Autopilot is a beta.

2. From the rest of this thread, it sounds like their long-range cameras/radar has very limited FOV.

Re:A Tragic Loss by bdamm on Thursday June 30, 2016 @05:56PM (#12012116)
The "white truck against the bright sky" seems to imply that the exposure depth and dynamic range of the camera may also have played a role.
Re:A Tragic Loss by a3n on Thursday June 30, 2016 @05:30PM (#12011921)
> It's not just about Tesla though.

> They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

They could have done that in two separate posts. This was tone deaf at best.

Re:A Tragic Loss by dragontamer on Thursday June 30, 2016 @05:45PM (#12012025)
> They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

Why? Why not just build the cars people want? (including cars that people want but don't realize they want yet)

There shouldn't be a political agenda associated with engineering. Build what is needed. Build what people want. Build what people will need. But never "defend my reputation and the reputation of this device that I'm making"

EDIT: I mean, I get why Public Relations are important and so forth. So Tesla is certainly free to do what they want here. But lets not pretend that this carefully crafted "condolence" piece that has come out roughly one and a half months late is anything but damage control for this company.

Re:A Tragic Loss by ars on Thursday June 30, 2016 @06:02PM (#12012166)
> Self driving tech is poised to save many many lives.

The computer would have to be 99.99999% reliable to do that.

The accident rate is around 74 per 100 million miles (and fatalities is 1.13).

It's unclear exactly how to turn that into a percentage, but no matter how you do it it's quite high.

Say an accident takes 5 minutes, and people drive 30 miles/hour. Then that works out to 99.999% for humans. If you use the numbers for fatalities then it's 99.99999%.

I.e. 99.99999% of the time, as whole across all [US] humans, people drive in a way that does not cause a fatality.

That's the bar computers have to cross in order to save any lives at all.

Re:A Tragic Loss by emitstop on Thursday June 30, 2016 @07:00PM (#12012513)
This is the first fatality collision after 130 million miles of tesla's autopilot, so it's already above that bar.

Additionally, 92 people are killed in fatal car accidents in the US every day. So it's not as though this is some uncommon occurrence that autonomous vehicles would be unlikely to improve.

Re:A Tragic Loss by ars on Thursday June 30, 2016 @07:47PM (#12012794)
> This is the first fatality collision after 130 million miles of tesla's autopilot, so it's already above that bar.

It most definitely is not above that bar! The autopilot is combined with a human operating the car.

How many accidents were avoided by the human rather than the autopilot?

I suspect a ton of accidents (i.e. the autopilot has a high error rate).

How many did the autopilot avoid that the human would not have? Probably not that many, if any.

> Additionally, 92 people are killed in fatal car accidents in the US every day. So it's not as though this is some uncommon occurrence that autonomous vehicles would be unlikely to improve.

Do the math.

I did.

0.00001% seems pretty uncommon to me. There is a lot of driving in the US, so even that low of a number is visible, but it's still a low number.

Remember every single computer must be all but perfect to reduce the error rate.

Have you ever seen a computer to be that good? At even something as simple as not crashing? Never mind driving a car.

Re:A Tragic Loss by emitstop on Friday July 01, 2016 @02:25PM (#12018513)
92 people per day isn't "uncommon". It might be statistically improbable, but that's not what uncommon means. It's a regular, daily occurrence for 92 real human lives every day.
Re:A Tragic Loss by ars on Friday July 01, 2016 @02:59PM (#12018791)
Uncommon for the computer (or human) driving the car.

You have to understand the magnitude of the perfection needed to have any hope of implementing it.

Tell me: Before you read my message, would you have assumed at a computer that is 99% perfect, or 99.9% perfect, would be better than a human?

I can tell you, that until I did the math, I thought so myself.

But 99.99999% is 10,000 better! If the computer was 99.9% perfect you would have almost 1 million fatalities per year (assuming things scale linearly, which I'm sure they wouldn't, probably most of the time driving is easy and 99.9% would still not get into an accident).

> It's a regular, daily occurrence for 92 real human lives every day.

I know. (Although you said that badly: it's not a daily occurrence for those people. But I get your emotion.)

But a computer will not solve this problem, not for a long time. We simply are not able to make a computer that is that good.

Let's see if we can make a web browser that is that good before we try to make a driving computer that good.

It also puts human drivers in a new light. I was of the camp that people are terrible, horrible drivers that kill all the time.

But actually humans are nearly perfect at driving, it's just there are so very very many people driving, so even a tiny cumulative error shows up.

Re:A Tragic Loss by ec109685 on Friday July 01, 2016 @02:50AM (#12014299)
"How many did the autopilot avoid that the human would not have? Probably not that many, if any."

Or probably it avoided 100,000 accidents!

Unfortunately, we are both just guessing.

So please keep your math out of this.

Re:A Tragic Loss by ars on Friday July 01, 2016 @09:57AM (#12016029)
> Unfortunately, we are both just guessing.

Except I am not guessing. That's the point of math.

The autopilot plus a human, only did slightly better than a human alone. That means the autopilot did nothing, since slightly better is well within the range of normal for a human alone.

> So please keep your math out of this.

What a strange reply. Why keep math out of this?

Are you hoping that this will be real if you ignore all evidence to the contrary?

Right now the evidence is in: Computer assisted cars don't do anything helpful to the accident rate. This bodes poorly for self driving cars, and since the error rate they have to hit is so low, it's really not looking good.

I personally don't expect self driving cars to ever be used on regular streets. Only on computer-exclusive roads, specially marked for them.

Re:A Tragic Loss by CaptSpify on Thursday June 30, 2016 @05:28PM (#12011900)
I can already hear a lot of people that I know: "See! I told you them automagic cars were the devil!"

I personally can't wait for fully self-driving cars, but it's going to be a big PR battle in the US

Re:A Tragic Loss by YeGoblynQueenne on Thursday June 30, 2016 @06:48PM (#12012454)
>> Self driving tech is poised to save many many lives.

Based on what?

Re:A Tragic Loss by pacificmint on Thursday June 30, 2016 @07:19PM (#12012653)
> Based on what?

Human drivers are very bad. We kill over 32,000 people a year (and that's a 60 year low, just a few years ago it was over 40,000).

So if self driving cars are just a little better than humans, they will save many lives. If they are a lot better than us, they will save many more.

Re:A Tragic Loss by takeda on Thursday June 30, 2016 @08:04PM (#12012906)
Human programmers are even worse we make 15-50 bugs per 1000 lines of code.

Also don't forget that while each of us is somewhat unique in terms of driving, the cars are not, so a bug in a car's software can amplify issues even further.

There are issues also how cars will behave when they will have to interact with other self driving cars. Those problems are already difficult when writing distributed applications and with cars we don't have luxury of just letting things crash together until things improve.

Re:A Tragic Loss by ceejayoz on Thursday June 30, 2016 @08:26PM (#12012998)
> Human programmers are even worse we make 15-50 bugs per 1000 lines of code.

Only when that's deemed acceptable.

http://www.fastcompany.com/28121/they-write-right-stuff

> But how much work the software does is not what makes it remarkable. What makes it remarkable is how well the software works. This software never crashes. It never needs to be re-booted. This software is bug-free. It is perfect, as perfect as human beings have achieved. Consider these stats : the last three versions of the program — each 420,000 lines long-had just one error each. The last 11 versions of this software had a total of 17 errors. Commercial programs of equivalent complexity would have 5,000 errors.

Re:A Tragic Loss by vacri on Thursday June 30, 2016 @07:48PM (#12012803)
If they are just a little worse than humans, they will cost many lives. If they are a lot worse than us, they will cost many more.
Re:A Tragic Loss by ars on Friday July 01, 2016 @03:03PM (#12018833)
> if self driving cars are just a little better than humans

You say that so glibly. Have you ever done the math? I did, I posted it here:

https://news.ycombinator.com/item?id=12012166

Summary: The computer would have to be better than 99.99999% perfect to save any lives.

Re:A Tragic Loss by YeGoblynQueenne on Thursday June 30, 2016 @07:57PM (#12012869)
>> if self driving cars are (...)

That's a hypothetical. You say autonomous cars are "poised" to save many lives -not even avoid many deaths, actively "save".

That's very strong language to use based on an "if" that nobody yet knows the answer to with any certainty.

That is, unless you are privy to some information that the rest of us are not? Are you?

What is it that you base your assertion on? Do you base it on anything or is it just a pretty turn of phrase you thought sounded cool?

Re:A Tragic Loss by Nadya on Thursday June 30, 2016 @08:09PM (#12012928)
Not who you are questioning.

There are already videos of assisted-driving cars avoiding accidents which likely would have been fatal. We already know they can potentially save lives. It's something we already accept for flying. Autopilot in planes has resulted in deaths of crew and passengers. So we have precedent in at least one mode of transportation.

Drivers get T-boned or rear end other people all the time. Those are two scenarios where driver-assist could have applied the brakes and actively saving lives for drivers inattentiveness. You'll also find no shortage of Liveleak clips of people being killed by drivers who failed to see them and brake in time. Many being scenarios that Google's self-driving cars have the technology to avoid.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:36AM (#12021960)
>> There are already videos of assisted-driving cars avoiding accidents

I'm not concerend about assisted driving. I'm concerned about fully autonomous cars being handed complete control in real-world situations.

I'm not just "concerned" about them- they scare the hell out of me.

>> Many being scenarios that Google's self-driving cars have the technology to avoid.

What Google says it programs its cars to do, what it really programs its cars to do and what its cars can really do are all separate things.

The problem is that the current technology level is nowhere near advanced enough to allow fully autonomous vehicles to operate safely. There is a huge number of situations that those cars aren't programmed for, that they can't be programmed for, because those situations are completely unforseeable.

Machine learning has a huge problem with data sparsness. You may train a learner in petabytes and petabytes of data collected from the real world and still miss the vast majority of events that may occur.

That is why, like I say elsewhere, machine learning-based AI makes utterly ludicrous mistakes that humans would never do, even in difficult situations were they can't be expected to perform with 0% error. I've used a few metaphors- here's another one: a human would never mistake a truck for a cucumber. A machine learning algorithm, might.

And what's worse, there's no way to prevent this sort of mistake, or even correct it, because most of the time the models built by such algorithms are simply too complex to be processed by humans in the way a hand-crafted system would be (and goddess knows how hard those can be to process).

Re:A Tragic Loss by brokenmachine on Thursday June 30, 2016 @10:03PM (#12013405)
Planes don't have to deal with semi-trailers or wildlife appearing suddenly in their path regularly either.

Autopilot in a plane doesn't have to deal with obstacles besides the odd mountain here and there.

So I'd say that in many (most?) ways it's easier and safer to autopilot a plane than a car, and as you say, even planes with autopilot have failed.

Re:A Tragic Loss by protomyth on Thursday June 30, 2016 @11:48PM (#12013752)
> Planes don't have to deal with semi-trailers or wildlife appearing suddenly in their path regularly either

Planes most certainly do have to deal with wildlife (e.g. birds) appearing suddenly in their path regularly.

Re:A Tragic Loss by abduhl on Friday July 01, 2016 @12:12AM (#12013825)
This is a ridiculous statement. Are you seriously saying that birds regularly fly at over 30000 ft? Or are you trying to imply that autopilot during landing/takeoff actively tracks birds and tries to avoid them?

In other words, the plane autopilot doesn't "deal" with wildlife at all unless you count running into it. Which is apparently what Tesla autopilot does as well.

Re:A Tragic Loss by protomyth on Friday July 01, 2016 @12:25AM (#12013863)
I am saying that planes use auto pilot (e.g. Terrain-following radar and Autoland) have to deal with birds and yes they hit them.
Re:A Tragic Loss by Fricken on Thursday June 30, 2016 @09:45PM (#12013324)
You're being extremely pedantic. Machines are getting better. Humans aren't.
Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:12AM (#12021922)
Update: hold the press. Someone above posted a link to this wikipedia article:

https://en.wikipedia.org/wiki/List_of_motor_vehicle_deaths_i...

From which I quote:

The number of deaths – and deaths relative to the total population – have declined over the last two decades. From 1979 to 2005, the number of deaths per year decreased 14.97% while the number of deaths per capita decreased by 35.46%.

So at least the rate of fatalities is decreasing. I won't claim I know whether that's because humans get better at driving, carse get safer, traffic regulations get safer, or any other factor, but the point is roads are getting safer already and without any autonomous vehicles on them.

[Original bit:] Again- based on what? Why do you say that? What is even your measure of humans getting "better"? Better at what? Better drivers? Better cognitive systems? Better what?

Re:A Tragic Loss by pacificmint on Saturday July 02, 2016 @02:08AM (#12021577)
> You say autonomous cars are "poised" to save many lives

I said no such thing, you are putting words in my mouth.

What I said is that the baseline for traffic deaths is quite high, and if (or when) autonomous cars are even a little better than humans, then less lives will be lost.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:08AM (#12021916)
>> I said no such thing, you are putting words in my mouth.

I was replying to someone else and you jumped in. You can hold the accusations of putting stuff in places, thank you.

>> What I said is that the baseline for traffic deaths is quite high, and if (or when) autonomous cars are even a little better than humans, then less lives will be lost.

And I said that autonomous cars being better than humans is just a hypothetical.

I'll add that we have no evidence that it's the case. Computers are better at humans at tasks that require fast and accurate retrieval, or computation, but they'll not just magically become better than humans at driving. Somebody has to program them to do that.

So who is going to do that? Do you know how to do that? Do you know anyone who knows how to do that?

The theory is that we'll put enough (real or virtual) cars in enough training situations that they'll learn to drive on their own, but that approach has serious limitations, not least the fact that in the real world there may be an infinite number of situations that a learner will never encounter during training. In any case, with any other cognitive task that we train computers to carry out they end up making completely ridiculous mistakes, which in the case of driving will cost lives.

Until we have a way to develop systems that understand their surroundings, autonomous cars being better drivers than humans is just a dangerous fantasy.

Re:A Tragic Loss by droopyEyelids on Thursday June 30, 2016 @07:51PM (#12012822)
You have to make a comparison if you want to pass a judgement that something is "bad". Bad compared to what?
Re:A Tragic Loss by pacificmint on Saturday July 02, 2016 @02:04AM (#12021568)
> Bad compared to what?

Bad compared to pretty much every other form of transportation that humans employ.

Re:A Tragic Loss by Fricken on Thursday June 30, 2016 @09:35PM (#12013274)
94% of fatal accidents are due to human error, and preventable if you remove impairment, inattention, and poor judgement from the equation.
Re:A Tragic Loss by snowwrestler on Thursday June 30, 2016 @10:30PM (#12013520)
Ok but what about the limitations of technology?

Yes, self-driving cars will save lives if we assume that the self-driving technology is superior to humans in every way. That's almost a tautology though.

Self-driving cars don't get bored, but they don't seem to see white tractor trailers either. Technology has different shortcomings than people do. Whether tech shortcomings result in fewer lives lost than human shortcomings remains to be seen.

It's astounding to me that HN stories about self-driving cars sit right next to stories about iPhones and anti-virus software, and tone of the comments are diametrically opposed. If you read the comments on self-driving car stories, you'd think that technology can do everything better than people. If you read the comments on stories about iPhones and anti-virus, you'd think that everything has terrible bugs, vulnerabilities, and shortcomings.

Re:A Tragic Loss by lkbm on Friday July 01, 2016 @12:52AM (#12013949)
> but they don't seem to see white tractor trailers either

Isn't Tesla using pure vision? Google also uses lidar, which fixes the problem. EDIT: Looks like I'm wrong and Tesla uses radar.

> Technology has different shortcomings than people do. Whether tech shortcomings result in fewer lives lost than human shortcomings remains to be seen.

Technology also gets better. Ten years ago, people were as bad at driving as they are today. Ten years from now, they'll be as bad as they are today.

Now compare self driving cars ten years ago to self driving cars today. And ten years from now.

> If you read the comments on self-driving car stories, you'd think that technology can do everything better than people. If you read the comments on stories about iPhones and anti-virus, you'd think that everything has terrible bugs, vulnerabilities, and shortcomings.

Those aren't contradictory.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:21AM (#12021942)
>> 94% of fatal accidents are due to human error

I assume you just pulled that out of thin air but even if you hadn't, it is completely meaningless. We have nothing to compare human performance against. Humans have been driving for more than a century. What are you going to compare that to?

As to how preventable accidents are- sure, if you remove factors like the ones you say, you'll reduce accidents, but humans suffer from those cognitive impairments on top of our extremely well-tuned cognitive apparatus. Computers have nothing of the sort. They may not get distracted, but they're rubbish at doing the thinking that keeps humans safe on the road the vast majority of the time (given that the vast majority of drivers don't get killed in accidents).

To put it plainly, if you put a brick on the gas pedal and lock the wheel, you'll reduce the amount of accidents caused by cogntivie impairments like inattention and poor judgement- but you won't reduce the overall rate of accidents.

In other words, if you hand control to a system that doesn't sleep on the wheel but can also not tell a puddle from a boulder, you will increase risks rather than reducing them.

Re:A Tragic Loss by Analemma_ on Thursday June 30, 2016 @04:50PM (#12011552)
I agree. I'm starting to get really weirded out by Tesla's immediate "not our fault!" blog posts every time a Tesla is involved in any kind of accident. I could see the necessity the first few times back when it was new technology to a lot of people (and Top Gear had it in for them), but with it happening over and over it seems whiny and a bit callous. How long to they plan to keep doing this?
Re:A Tragic Loss by dangrossman on Thursday June 30, 2016 @04:52PM (#12011581)
> How long to they plan to keep doing this?

So long as every Tesla accident makes the homepage of CNBC, unlike the millions that occur in other makers' vehicles.

Tesla puts out an immediate PR, and the breaking news that went up on all the financial sites included quotes from it nearly as fast.

http://www.cnbc.com/2016/06/30/us-regulators-investigating-t...

Re:A Tragic Loss by prodmerc on Thursday June 30, 2016 @04:56PM (#12011631)
Yeah no kidding, thousands of people die every year in Fords and no one gives a shit, 1 guy dies in a Tesla and "these cars are unsafe, run for your lives, hide yo kids and yo wife, sell your stock, return your car!". I fucking hate modern media.
Re:A Tragic Loss by malz on Thursday June 30, 2016 @07:18PM (#12012647)
It seems newsworthy that the world's first robotic car, specifically designed to see and react to road conditions, drives into the side of a truck.
Re:A Tragic Loss by M4v3R on Friday July 01, 2016 @05:17AM (#12014748)
It was the other way around - the truck drove into the side of Tesla, which didn't react because it didn't saw the truck with its cameras because of combination of brightly lit sky and truck white color.
Re:A Tragic Loss by semi-extrinsic on Thursday June 30, 2016 @05:39PM (#12011992)
Ford sells 6-7 million cars each year, so there's going to be close to 100 million Fords driving around globally. There's a little over 100 000 Teslas. So since there is 1000x as many Fords, and assuming every Ford is just as safe as a Tesla, you quite literally get thousands of fatalities a year.
Re:A Tragic Loss by stcredzero on Thursday June 30, 2016 @05:51PM (#12012076)
assuming every Ford is just as safe as a Tesla, you quite literally get thousands of fatalities a year.

Which is about right.

Re:A Tragic Loss by Twirrim on Thursday June 30, 2016 @07:13PM (#12012605)
According to wikipedia there were 32,675 fatalities in 2014. https://en.wikipedia.org/wiki/List_of_motor_vehicle_deaths_i..., around 10 fatalities per 100,000 population.
Re:A Tragic Loss by protomyth on Thursday June 30, 2016 @11:55PM (#12013770)
The CDC data with comparison to other ways people die in the US is at http://www.cdc.gov/nchs/fastats/leading-causes-of-death.htm

Table 28 of http://www.cdc.gov/nchs/data/hus/hus15.pdf#019 is relevant to this discussion

Re:A Tragic Loss by mozumder on Thursday June 30, 2016 @06:24PM (#12012317)
There are entire car models that have had zero driver deaths: http://www.freep.com/story/news/nation/2015/01/29/study-chan...

The Tesla Model S will now never be one of them, and in fact, is now among average for fatality rates that includes motorcycles, drunks, and other dangerous factors. It's now not even among the class of luxury cars that have very low driver deaths.

Right now self-driving cars are far too dangerous for public use.

Re:A Tragic Loss by sliverstorm on Thursday June 30, 2016 @06:50PM (#12012462)
Wow, there's a lot of factors at play there I'm sure but the engineering teams behind those models should feel very proud indeed.
Re:A Tragic Loss by therestisgone on Friday July 01, 2016 @08:12AM (#12015376)
>The Tesla Model S will now never be one of them

Which version? There is 60, 60D, 70, 70D, 75, 75D, 80, 80D, 85, 85D, 90 and 90D so which one are you talking about? Tesla calls their cars Model S the same way Apple calls their laptops Macbook.

Re:A Tragic Loss by kmonsen on Thursday June 30, 2016 @07:05PM (#12012556)
Since I have not seen any of these, can you actually point to large media outlets saying these things?
Re:A Tragic Loss by refulgentis on Thursday June 30, 2016 @05:38PM (#12011980)
Did anyone actually say any of those things? Or anything coming close to those things? Or did you just invent a strawman to beat up on the media?
Re:A Tragic Loss by fucking_tragedy on Saturday July 02, 2016 @03:08PM (#12023487)
Look at a comparable example with software related car malfunctions. Toyota's unintended acceleration problem made headlines and made it before a judge.

It seems fair to me.

Re:A Tragic Loss by jblow on Thursday June 30, 2016 @04:53PM (#12011589)
It is because, if Tesla allows it to happen, the media will attack them incessantly over these things because they smell a story (and because a lot of vested interests are willing to pay for PR). If you don't defend yourself in that kind of situation, you die.
Re:A Tragic Loss by prodmerc on Thursday June 30, 2016 @04:58PM (#12011643)
"This guy died in a Tesla - you won't believe what happens next!"
Re:A Tragic Loss by IBM on Thursday June 30, 2016 @05:01PM (#12011674)
Yeah the thing that rubbed me the wrong way was how they responded to the NYT review about cold weather performance. I've been highly skeptical about Elon and Tesla ever since.
Re:A Tragic Loss by lkbm on Friday July 01, 2016 @12:56AM (#12013965)
Didn't they respond by pointing out that the claims made in the review were false? Was there more follow-up to that story that I missed?
Re:A Tragic Loss by talmand on Thursday June 30, 2016 @04:55PM (#12011612)
As long as media continues to blame their new cars for clickbait articles and until they are treated the same as any other car manufacturer that's not blamed for every incident involving their vehicles.
Re:A Tragic Loss by toomuchtodo on Thursday June 30, 2016 @04:52PM (#12011580)
As long as emotions drive short term investors, which influences the stock price, which is extremely important for their success and expansion plans.

Already down $6/share in after hours trading.

Re:A Tragic Loss by kordless on Thursday June 30, 2016 @04:57PM (#12011636)
How long are people like you going to keep speaking dissonance for others every time a Black Swan happens?
Re:A Tragic Loss by npizzolato on Thursday June 30, 2016 @05:29PM (#12011910)
I half expected the final paragraph offering condolences to end with "but remember, this really wasn't Tesla's fault!" The third paragraph reads like Tesla is trying to wash their hands as much as possible. "Remember, he clicked all these buttons. He knew what he was getting into!"
Re:A Tragic Loss by jsprogrammer on Thursday June 30, 2016 @07:11PM (#12012594)
It really makes you consider why you would even want such an autopilot. From the description in this eulogy, it sounds like you must work even harder with autopilot on than if you were driving manually. Not only do you need to have the same alertness as manual driving, you also have to be ready to take over at any moment and try to detect if the autopilot has made any mistakes that might guillotine you, or worse.
Re:A Tragic Loss by Animats on Thursday June 30, 2016 @06:11PM (#12012234)
Yes. Last time, their excuse was "but the driver should have known that in firmware revision 6.2 and later, tapping the brake disables automatic braking".

This time, there's an interesting question. Did Tesla remotely access the crash data after the crash? Did they alter any data? Is that verifiable? The NTSB will probably explore that issue. The crash data record in an airbag controller becomes read-only when the airbag fires.

Re:A Tragic Loss by alxndr on Tuesday July 05, 2016 @11:53PM (#12041103)
Gives a new meaning to semver's term "breaking changes".
Re:A Tragic Loss by snuxoll on Thursday June 30, 2016 @04:54PM (#12011609)
Press Releases like this are for investors and media outlets, not for general consumers. Of course they are going to focus on damage control, because if they didn't focus on the safety features of autopilot and the hands-on requirement some media outlet would contort the situation and say "What safety features does this car to prevent an accident like this in the future? Is this technology actually ready to be used on our roads?".

I think they did a fine job of handling this, and with the high visibility of this incident due to the use of autopilot they really had no other option.

Re:A Tragic Loss by emp_zealoth on Thursday June 30, 2016 @05:55PM (#12012104)
I would not call a sentence in a manual a "requirement" A requirement would be when the autopilot didn't work unless one has at least one hand on the steering wheel. (Just like other manufactures do that) Tesla knows people are not going to use autopilot hands-on (especially after the novelty wears off)
Re:A Tragic Loss by icodestuff on Thursday June 30, 2016 @06:46PM (#12012435)
That's exactly the requirement the Model S has. It starts beeping at you and gradually brings the vehicle to a stop if you take your hands off the wheel.
Re:A Tragic Loss by Vik1ng on Thursday June 30, 2016 @05:22PM (#12011849)
Reminds me of their complaint blog post why the German government initiative is capped at 60k where it seems like half the point was to advertise a new lease deal.

https://www.teslamotors.com/de_DE/blog/teslas-antwort-auf-da...

Re:A Tragic Loss by padmanabhan01 on Thursday June 30, 2016 @08:11PM (#12012935)
>couldn't they have worded this a little more sympathetic and a little less lawyer?

Sure, if all the lawyers will promise not to take some statement out of context and sue them over that.. As long as such lawyers exist and that's the way the legal system works this is what can be expected out of statements from companies..

Re:A Tragic Loss by wpietri on Thursday June 30, 2016 @05:26PM (#12011884)
Yeah, I had the same issue with the writing. I think it would have gone much better if the meat of the concluding paragraph came first, possibly with a matching paragraph at the bottom.

Personally, I would have used a more neutral title, led with sympathies for the family, and then gone into the technical detail.

Re:A Tragic Loss by gavinpc on Thursday June 30, 2016 @04:59PM (#12011656)
I was even left with the sense that the tragedy actually felt by the writer was not so much the death of "a friend," as the fact of a blemish on the near-perfect safety record that Tesla has made part of their brand's cachet.
Re:A Tragic Loss by maxxxxx on Thursday June 30, 2016 @05:45PM (#12012031)
They definitely sound very defensive to me.
Re:A Tragic Loss by catbird on Thursday June 30, 2016 @04:52PM (#12011585)
Yes this is in really poor taste. I'm sure it's very comforting to the deceased's family to know that safety features could have saved their life, had the angle of impact been different.
Re:A Tragic Loss by prawn on Thursday June 30, 2016 @07:48PM (#12012798)
IMO, they should've had their explanatory intro, then the paragraph they closed with, then a gap, and then the technical explanation. As it was, it read like hand-washing to me. Especially when you openly call it AutoPilot but require hands on the wheel at all time.

If their detectors don't see a white car against a bright background, that's obviously a serious problem.

Re:A Tragic Loss by gohrt on Thursday June 30, 2016 @04:51PM (#12011568)
They could have titled it "Tesla Safety" -- which is what the article is about, and opened with an acknowledgement of the tragedy, instead of the tacky bait-and-switch headline.
Re:A Tragic Loss by JustSomeNobody on Thursday June 30, 2016 @04:57PM (#12011640)
Did they really have to paint us a picture of what happened? They could have left out some details and still made their point.

Edit: Given the down votes, I guess people really want the mental picture. Sad.