News for hackers. Stuff that matters.
Re:A Tragic Loss by angusb on Thursday June 30, 2016 @05:06PM (#12011713)
It's not just about Tesla though.

They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

Self driving tech is poised to save many many lives. So from a utilitarian perspective, it's probably justified to take extraordinary measures to make sure reactionary media and public whim doesn't kill it off, however uncomfortable that might seem in the short term.

Whilst this case is incredibly sad (and I don't want to downplay that in any way), if you're trying to minimise the overall amount of fatal crashes, exonerating the tech is the priority (if it is truly not at fault).

Re:A Tragic Loss by vkou on Thursday June 30, 2016 @05:24PM (#12011862)
They could defend the public's perception of autonomous vehicles in general by not rushing to market a beta that is less technically capable then other autonomous systems being worked on by their competitors.
Re:A Tragic Loss by angusb on Thursday June 30, 2016 @05:32PM (#12011930)
Are you saying that just based on the fact that they've been developing it for less time than Google, or is there a more in depth case for that somewhere? I would be very interested to read about that if there is.
Re:A Tragic Loss by vkou on Thursday June 30, 2016 @05:37PM (#12011976)
1. Tesla makes it clear that Autopilot is a beta.

2. From the rest of this thread, it sounds like their long-range cameras/radar has very limited FOV.

Re:A Tragic Loss by bdamm on Thursday June 30, 2016 @05:56PM (#12012116)
The "white truck against the bright sky" seems to imply that the exposure depth and dynamic range of the camera may also have played a role.
Re:A Tragic Loss by a3n on Thursday June 30, 2016 @05:30PM (#12011921)
> It's not just about Tesla though.

> They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

They could have done that in two separate posts. This was tone deaf at best.

Re:A Tragic Loss by dragontamer on Thursday June 30, 2016 @05:45PM (#12012025)
> They have to defend autopilot not only to protect the brand but to protect the public's perception of autonomous vehicles in general.

Why? Why not just build the cars people want? (including cars that people want but don't realize they want yet)

There shouldn't be a political agenda associated with engineering. Build what is needed. Build what people want. Build what people will need. But never "defend my reputation and the reputation of this device that I'm making"

EDIT: I mean, I get why Public Relations are important and so forth. So Tesla is certainly free to do what they want here. But lets not pretend that this carefully crafted "condolence" piece that has come out roughly one and a half months late is anything but damage control for this company.

Re:A Tragic Loss by ars on Thursday June 30, 2016 @06:02PM (#12012166)
> Self driving tech is poised to save many many lives.

The computer would have to be 99.99999% reliable to do that.

The accident rate is around 74 per 100 million miles (and fatalities is 1.13).

It's unclear exactly how to turn that into a percentage, but no matter how you do it it's quite high.

Say an accident takes 5 minutes, and people drive 30 miles/hour. Then that works out to 99.999% for humans. If you use the numbers for fatalities then it's 99.99999%.

I.e. 99.99999% of the time, as whole across all [US] humans, people drive in a way that does not cause a fatality.

That's the bar computers have to cross in order to save any lives at all.

Re:A Tragic Loss by emitstop on Thursday June 30, 2016 @07:00PM (#12012513)
This is the first fatality collision after 130 million miles of tesla's autopilot, so it's already above that bar.

Additionally, 92 people are killed in fatal car accidents in the US every day. So it's not as though this is some uncommon occurrence that autonomous vehicles would be unlikely to improve.

Re:A Tragic Loss by ars on Thursday June 30, 2016 @07:47PM (#12012794)
> This is the first fatality collision after 130 million miles of tesla's autopilot, so it's already above that bar.

It most definitely is not above that bar! The autopilot is combined with a human operating the car.

How many accidents were avoided by the human rather than the autopilot?

I suspect a ton of accidents (i.e. the autopilot has a high error rate).

How many did the autopilot avoid that the human would not have? Probably not that many, if any.

> Additionally, 92 people are killed in fatal car accidents in the US every day. So it's not as though this is some uncommon occurrence that autonomous vehicles would be unlikely to improve.

Do the math.

I did.

0.00001% seems pretty uncommon to me. There is a lot of driving in the US, so even that low of a number is visible, but it's still a low number.

Remember every single computer must be all but perfect to reduce the error rate.

Have you ever seen a computer to be that good? At even something as simple as not crashing? Never mind driving a car.

Re:A Tragic Loss by emitstop on Friday July 01, 2016 @02:25PM (#12018513)
92 people per day isn't "uncommon". It might be statistically improbable, but that's not what uncommon means. It's a regular, daily occurrence for 92 real human lives every day.
Re:A Tragic Loss by ars on Friday July 01, 2016 @02:59PM (#12018791)
Uncommon for the computer (or human) driving the car.

You have to understand the magnitude of the perfection needed to have any hope of implementing it.

Tell me: Before you read my message, would you have assumed at a computer that is 99% perfect, or 99.9% perfect, would be better than a human?

I can tell you, that until I did the math, I thought so myself.

But 99.99999% is 10,000 better! If the computer was 99.9% perfect you would have almost 1 million fatalities per year (assuming things scale linearly, which I'm sure they wouldn't, probably most of the time driving is easy and 99.9% would still not get into an accident).

> It's a regular, daily occurrence for 92 real human lives every day.

I know. (Although you said that badly: it's not a daily occurrence for those people. But I get your emotion.)

But a computer will not solve this problem, not for a long time. We simply are not able to make a computer that is that good.

Let's see if we can make a web browser that is that good before we try to make a driving computer that good.

It also puts human drivers in a new light. I was of the camp that people are terrible, horrible drivers that kill all the time.

But actually humans are nearly perfect at driving, it's just there are so very very many people driving, so even a tiny cumulative error shows up.

Re:A Tragic Loss by ec109685 on Friday July 01, 2016 @02:50AM (#12014299)
"How many did the autopilot avoid that the human would not have? Probably not that many, if any."

Or probably it avoided 100,000 accidents!

Unfortunately, we are both just guessing.

So please keep your math out of this.

Re:A Tragic Loss by ars on Friday July 01, 2016 @09:57AM (#12016029)
> Unfortunately, we are both just guessing.

Except I am not guessing. That's the point of math.

The autopilot plus a human, only did slightly better than a human alone. That means the autopilot did nothing, since slightly better is well within the range of normal for a human alone.

> So please keep your math out of this.

What a strange reply. Why keep math out of this?

Are you hoping that this will be real if you ignore all evidence to the contrary?

Right now the evidence is in: Computer assisted cars don't do anything helpful to the accident rate. This bodes poorly for self driving cars, and since the error rate they have to hit is so low, it's really not looking good.

I personally don't expect self driving cars to ever be used on regular streets. Only on computer-exclusive roads, specially marked for them.

Re:A Tragic Loss by CaptSpify on Thursday June 30, 2016 @05:28PM (#12011900)
I can already hear a lot of people that I know: "See! I told you them automagic cars were the devil!"

I personally can't wait for fully self-driving cars, but it's going to be a big PR battle in the US

Re:A Tragic Loss by YeGoblynQueenne on Thursday June 30, 2016 @06:48PM (#12012454)
>> Self driving tech is poised to save many many lives.

Based on what?

Re:A Tragic Loss by pacificmint on Thursday June 30, 2016 @07:19PM (#12012653)
> Based on what?

Human drivers are very bad. We kill over 32,000 people a year (and that's a 60 year low, just a few years ago it was over 40,000).

So if self driving cars are just a little better than humans, they will save many lives. If they are a lot better than us, they will save many more.

Re:A Tragic Loss by takeda on Thursday June 30, 2016 @08:04PM (#12012906)
Human programmers are even worse we make 15-50 bugs per 1000 lines of code.

Also don't forget that while each of us is somewhat unique in terms of driving, the cars are not, so a bug in a car's software can amplify issues even further.

There are issues also how cars will behave when they will have to interact with other self driving cars. Those problems are already difficult when writing distributed applications and with cars we don't have luxury of just letting things crash together until things improve.

Re:A Tragic Loss by ceejayoz on Thursday June 30, 2016 @08:26PM (#12012998)
> Human programmers are even worse we make 15-50 bugs per 1000 lines of code.

Only when that's deemed acceptable.

http://www.fastcompany.com/28121/they-write-right-stuff

> But how much work the software does is not what makes it remarkable. What makes it remarkable is how well the software works. This software never crashes. It never needs to be re-booted. This software is bug-free. It is perfect, as perfect as human beings have achieved. Consider these stats : the last three versions of the program — each 420,000 lines long-had just one error each. The last 11 versions of this software had a total of 17 errors. Commercial programs of equivalent complexity would have 5,000 errors.

Re:A Tragic Loss by vacri on Thursday June 30, 2016 @07:48PM (#12012803)
If they are just a little worse than humans, they will cost many lives. If they are a lot worse than us, they will cost many more.
Re:A Tragic Loss by ars on Friday July 01, 2016 @03:03PM (#12018833)
> if self driving cars are just a little better than humans

You say that so glibly. Have you ever done the math? I did, I posted it here:

https://news.ycombinator.com/item?id=12012166

Summary: The computer would have to be better than 99.99999% perfect to save any lives.

Re:A Tragic Loss by YeGoblynQueenne on Thursday June 30, 2016 @07:57PM (#12012869)
>> if self driving cars are (...)

That's a hypothetical. You say autonomous cars are "poised" to save many lives -not even avoid many deaths, actively "save".

That's very strong language to use based on an "if" that nobody yet knows the answer to with any certainty.

That is, unless you are privy to some information that the rest of us are not? Are you?

What is it that you base your assertion on? Do you base it on anything or is it just a pretty turn of phrase you thought sounded cool?

Re:A Tragic Loss by Nadya on Thursday June 30, 2016 @08:09PM (#12012928)
Not who you are questioning.

There are already videos of assisted-driving cars avoiding accidents which likely would have been fatal. We already know they can potentially save lives. It's something we already accept for flying. Autopilot in planes has resulted in deaths of crew and passengers. So we have precedent in at least one mode of transportation.

Drivers get T-boned or rear end other people all the time. Those are two scenarios where driver-assist could have applied the brakes and actively saving lives for drivers inattentiveness. You'll also find no shortage of Liveleak clips of people being killed by drivers who failed to see them and brake in time. Many being scenarios that Google's self-driving cars have the technology to avoid.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:36AM (#12021960)
>> There are already videos of assisted-driving cars avoiding accidents

I'm not concerend about assisted driving. I'm concerned about fully autonomous cars being handed complete control in real-world situations.

I'm not just "concerned" about them- they scare the hell out of me.

>> Many being scenarios that Google's self-driving cars have the technology to avoid.

What Google says it programs its cars to do, what it really programs its cars to do and what its cars can really do are all separate things.

The problem is that the current technology level is nowhere near advanced enough to allow fully autonomous vehicles to operate safely. There is a huge number of situations that those cars aren't programmed for, that they can't be programmed for, because those situations are completely unforseeable.

Machine learning has a huge problem with data sparsness. You may train a learner in petabytes and petabytes of data collected from the real world and still miss the vast majority of events that may occur.

That is why, like I say elsewhere, machine learning-based AI makes utterly ludicrous mistakes that humans would never do, even in difficult situations were they can't be expected to perform with 0% error. I've used a few metaphors- here's another one: a human would never mistake a truck for a cucumber. A machine learning algorithm, might.

And what's worse, there's no way to prevent this sort of mistake, or even correct it, because most of the time the models built by such algorithms are simply too complex to be processed by humans in the way a hand-crafted system would be (and goddess knows how hard those can be to process).

Re:A Tragic Loss by brokenmachine on Thursday June 30, 2016 @10:03PM (#12013405)
Planes don't have to deal with semi-trailers or wildlife appearing suddenly in their path regularly either.

Autopilot in a plane doesn't have to deal with obstacles besides the odd mountain here and there.

So I'd say that in many (most?) ways it's easier and safer to autopilot a plane than a car, and as you say, even planes with autopilot have failed.

Re:A Tragic Loss by protomyth on Thursday June 30, 2016 @11:48PM (#12013752)
> Planes don't have to deal with semi-trailers or wildlife appearing suddenly in their path regularly either

Planes most certainly do have to deal with wildlife (e.g. birds) appearing suddenly in their path regularly.

Re:A Tragic Loss by abduhl on Friday July 01, 2016 @12:12AM (#12013825)
This is a ridiculous statement. Are you seriously saying that birds regularly fly at over 30000 ft? Or are you trying to imply that autopilot during landing/takeoff actively tracks birds and tries to avoid them?

In other words, the plane autopilot doesn't "deal" with wildlife at all unless you count running into it. Which is apparently what Tesla autopilot does as well.

Re:A Tragic Loss by protomyth on Friday July 01, 2016 @12:25AM (#12013863)
I am saying that planes use auto pilot (e.g. Terrain-following radar and Autoland) have to deal with birds and yes they hit them.
Re:A Tragic Loss by Fricken on Thursday June 30, 2016 @09:45PM (#12013324)
You're being extremely pedantic. Machines are getting better. Humans aren't.
Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:12AM (#12021922)
Update: hold the press. Someone above posted a link to this wikipedia article:

https://en.wikipedia.org/wiki/List_of_motor_vehicle_deaths_i...

From which I quote:

The number of deaths – and deaths relative to the total population – have declined over the last two decades. From 1979 to 2005, the number of deaths per year decreased 14.97% while the number of deaths per capita decreased by 35.46%.

So at least the rate of fatalities is decreasing. I won't claim I know whether that's because humans get better at driving, carse get safer, traffic regulations get safer, or any other factor, but the point is roads are getting safer already and without any autonomous vehicles on them.

[Original bit:] Again- based on what? Why do you say that? What is even your measure of humans getting "better"? Better at what? Better drivers? Better cognitive systems? Better what?

Re:A Tragic Loss by pacificmint on Saturday July 02, 2016 @02:08AM (#12021577)
> You say autonomous cars are "poised" to save many lives

I said no such thing, you are putting words in my mouth.

What I said is that the baseline for traffic deaths is quite high, and if (or when) autonomous cars are even a little better than humans, then less lives will be lost.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:08AM (#12021916)
>> I said no such thing, you are putting words in my mouth.

I was replying to someone else and you jumped in. You can hold the accusations of putting stuff in places, thank you.

>> What I said is that the baseline for traffic deaths is quite high, and if (or when) autonomous cars are even a little better than humans, then less lives will be lost.

And I said that autonomous cars being better than humans is just a hypothetical.

I'll add that we have no evidence that it's the case. Computers are better at humans at tasks that require fast and accurate retrieval, or computation, but they'll not just magically become better than humans at driving. Somebody has to program them to do that.

So who is going to do that? Do you know how to do that? Do you know anyone who knows how to do that?

The theory is that we'll put enough (real or virtual) cars in enough training situations that they'll learn to drive on their own, but that approach has serious limitations, not least the fact that in the real world there may be an infinite number of situations that a learner will never encounter during training. In any case, with any other cognitive task that we train computers to carry out they end up making completely ridiculous mistakes, which in the case of driving will cost lives.

Until we have a way to develop systems that understand their surroundings, autonomous cars being better drivers than humans is just a dangerous fantasy.

Re:A Tragic Loss by droopyEyelids on Thursday June 30, 2016 @07:51PM (#12012822)
You have to make a comparison if you want to pass a judgement that something is "bad". Bad compared to what?
Re:A Tragic Loss by pacificmint on Saturday July 02, 2016 @02:04AM (#12021568)
> Bad compared to what?

Bad compared to pretty much every other form of transportation that humans employ.

Re:A Tragic Loss by Fricken on Thursday June 30, 2016 @09:35PM (#12013274)
94% of fatal accidents are due to human error, and preventable if you remove impairment, inattention, and poor judgement from the equation.
Re:A Tragic Loss by snowwrestler on Thursday June 30, 2016 @10:30PM (#12013520)
Ok but what about the limitations of technology?

Yes, self-driving cars will save lives if we assume that the self-driving technology is superior to humans in every way. That's almost a tautology though.

Self-driving cars don't get bored, but they don't seem to see white tractor trailers either. Technology has different shortcomings than people do. Whether tech shortcomings result in fewer lives lost than human shortcomings remains to be seen.

It's astounding to me that HN stories about self-driving cars sit right next to stories about iPhones and anti-virus software, and tone of the comments are diametrically opposed. If you read the comments on self-driving car stories, you'd think that technology can do everything better than people. If you read the comments on stories about iPhones and anti-virus, you'd think that everything has terrible bugs, vulnerabilities, and shortcomings.

Re:A Tragic Loss by lkbm on Friday July 01, 2016 @12:52AM (#12013949)
> but they don't seem to see white tractor trailers either

Isn't Tesla using pure vision? Google also uses lidar, which fixes the problem. EDIT: Looks like I'm wrong and Tesla uses radar.

> Technology has different shortcomings than people do. Whether tech shortcomings result in fewer lives lost than human shortcomings remains to be seen.

Technology also gets better. Ten years ago, people were as bad at driving as they are today. Ten years from now, they'll be as bad as they are today.

Now compare self driving cars ten years ago to self driving cars today. And ten years from now.

> If you read the comments on self-driving car stories, you'd think that technology can do everything better than people. If you read the comments on stories about iPhones and anti-virus, you'd think that everything has terrible bugs, vulnerabilities, and shortcomings.

Those aren't contradictory.

Re:A Tragic Loss by YeGoblynQueenne on Saturday July 02, 2016 @05:21AM (#12021942)
>> 94% of fatal accidents are due to human error

I assume you just pulled that out of thin air but even if you hadn't, it is completely meaningless. We have nothing to compare human performance against. Humans have been driving for more than a century. What are you going to compare that to?

As to how preventable accidents are- sure, if you remove factors like the ones you say, you'll reduce accidents, but humans suffer from those cognitive impairments on top of our extremely well-tuned cognitive apparatus. Computers have nothing of the sort. They may not get distracted, but they're rubbish at doing the thinking that keeps humans safe on the road the vast majority of the time (given that the vast majority of drivers don't get killed in accidents).

To put it plainly, if you put a brick on the gas pedal and lock the wheel, you'll reduce the amount of accidents caused by cogntivie impairments like inattention and poor judgement- but you won't reduce the overall rate of accidents.

In other words, if you hand control to a system that doesn't sleep on the wheel but can also not tell a puddle from a boulder, you will increase risks rather than reducing them.