The whole thing gets interesting when you look at the judicial side of it: Who is responsible in the case of an accident? The car manufacturer (if it was a software failure)? Then even one accident triggered by it is too much.
The idea that 'even one accident is too many' is a joke when you consider how many accidents there are with human drivers, and yet we accept them willingly. If there are 30,000 deaths per year from human driven accidents, then surely the real answer to how many accidents by computer driven cars is acceptable should have an upper bound of 29,999, right? Why isn't it acceptable if it saves even one human life, rather than being unacceptable if it costs one?
Unfortunately, we as a group don't tend to be very logical, and love to spread blame, so I am afraid we'll take a long time to start saving lives. The data on the self-driven cars on the road is pretty overwhelming that they are safer than human drivers, but unfortunately there will be those (as in this thread) who believe that is true of everyone but themselves.
Its going to be a long road to acceptance.
But there's two problems here:
1) We won't be replacing all the cars overnight. The problem comes with the interaction between terrible human drivers doing wildly unpredictable, insane things and the inflexible, unadaptable automated cars.
And
2) I'm not comfortable with dying or being injured due to a software error regardless of whether its likelihood is higher or lower. The roads are far more dangerous than the air, and this is why I'm uncomfortable with the whole concept of automated cars on the road and I'm not uncomfortable with autopilot in planes.
Those behaviors are easily improved upon by software. Dealing with lane changes is something software is likely to be vastly better at, because they can point sensors in all directions -- I only have one set of eyes.
Furthermore, a lot of horrific accidents are because of bizarre unexpected things that the human does not react to in a timely fashion precisely they are so far out of the normal scope of traffic flow.
For example, what if a car coming the other direction drifts in front of you on a rainy night? This is an unfortunately common and very lethal kind of accident in rural areas. It will take you 1 to 3 seconds to interpret the scenarios and react appropriately. (You only get 3-4 seconds before your are killed.) A computer can instantly recognize that car 100 yards away is maneuvering in a potentially lethal manner and begin slowing down right now. That buys more time for everyone.
Engineering solutions are a tiny part of getting this stuff to market.
There are only so many things bad human drivers can do, the physics is pretty limiting. It isn't like they can teleport in front of another car. Even the craziest things like opposing traffic jumping the median into oncoming traffic isn't all that crazy, it isn't conceptually different from a deer jumping in front of a car.
I'm not comfortable with dying or being injured due to a software error regardless of whether its likelihood is higher or lower.
Hard to argue with that.
I was thinking about your assertion that it's easy to solve, and why exactly I disagree with it so strongly on a base level. What am I basing this belief on?
And I figured it out. Driving games.
The AI in driving games like Gran Turismo has had more work than Google or any other company has done on theirs. And not only that, the AI in driving games has perfect information of the physics involved and the environment around them.
And those AIs are still fucking terrible when interacting with human players. Pack of AI driving around? Just fine. Add a human driver to the mix and it turns into a disaster.
This is why I am very concerned about automated driving in the real world alongside human drivers.
As for driving games, those have a different set of requirements and incentives. Driving poorly isn't necessarily a bad thing from the position of game play.
It would be at least as difficult, or less so (but not more so) to program AI to interact with human drivers with the primary goal being safety, not speed and exhilaration.
Why on earth is dying due to a software error worse than dying due to a human error if you can chose one or the other, and the chance of a software error is lower?
Eventually - not this year, maybe not this decade, but eventually - technology will be better than human drivers. How many lives, then, would you be willing to sacrifice, on the grounds that human error is somehow better than (less frequent) machine error? Six? Sixty? Six hundred? Six thousand? Since 1985, nine hundred thousand people have died in car crashes in the US alone. That's more than the entire population of San Francisco. Think about that. Nine hundred thousand people. Nine hundred thousand corpses. If technology can prevent that, I'd say we have a moral duty to not only develop it, but to do so as fast as possible, before too many more people die early, violent deaths.
If you're into robocars you can do a lot worse than checking out his robocar page: http://www.templetons.com/brad/robocars/
Yes if we had an automated car ready to replace everyone's normal car, we'd start saving tons of lives tomorrow and I'd be a monster for opposing it. But that's not reality, that's not what we're talking about.
And what I'm saying is, I'm uncomfortable and see problems ahead. And I seem to be totally alone in this, which is amazing to me.
There's no ensuring either of:
a) It will react to everything that it needs to react to / not react to things that it shouldn't.
b) It will react in the proper way when it does react.
This is the problem.
Like I said if it were all automated drivers on the road, I think we'd have a really amazing safety record. But the problem is that with human drivers and automated drivers on the road, the human drivers are going to do all kinds of stupid shit, and how much of it will be reacted to properly? I don't know.
It seems to me most people on HN significantly underestimate the complexity of solving this problem of automated drivers alongside human ones.
Plus, I am also uncomfortable with training human drivers to just trust the computer and pay no attention to what's going on around them. I think that's the worst outcome of automated drivers.
If you have a 3-dimensional model, with a finite number of axes to move upon, any movement towards the vehicle from another vehicle, no matter what it is, can be enumerated and mathematically modeled.
Once that has been done, it is a matter of programming the autonomous car's probabilistic response to the oncoming collision.
You think that most people significantly underestimate the complexity of solving this problem - I'd argue that, no, figuring out how to maintain satellites in orbit is more difficult than modeling every possible 3-dimension interaction between two, four, or 20 different cars.
No matter what kind of "stupid shit" human drivers do, there's only so much "stupid shit" they can actually perform. It can all be modeled mathematically on a 3-dimensional plane, and thus programmed for.
Is it a complex problem? Yes, assuredly. But your comments are approaching it with what seems to be mild hysteria - it's a basic engineering problem, and all you need to do is model it out. The math is there. It's solid. And I trust math more than I trust human drivers.
Computer - Can see 360 degrees, 100% of the time - Can read the movement of obstacles in real-time, with very accurate estimate of each surrounding vehicle's speed - Can run 100s of simulations per second to estimate the odds of an impact - Can react almost-instantly with correct inputs to the brake and steering based upon real-time instant of surface conditions
Human - Can react within .7 seconds with correct inputs to the brake and steering based upon real-time instant of surface conditions in ideal conditions - Can see ~180 degrees, with significant focal-point limitations - Can guess other vehicles reactions based upon experience
Which do you think will have a better reliability rating in many typical driving scenarios?
I'm not saying which way I lean on this. :)
Will bugs happen eventually? Yes, then they'll be patched. New bugs will be found, but every accident that happens will make the cars safer. Each error improves how safe they are, and since they're currently safer than humans based on accident statistics, I'm more than happy to see something that's already safer get even more safe over time.
Some kind of Android for autonomous cars would be quite nice I guess.
But what about Latin or Asian messes of countries? Say Rome, Buenos Aires, Lima, Hanoi or Bangkok? Lots of motorcycle and bycicle and human traffic (and in the case of my native Montevideo, horse-drawn carriages!).
Driving in some of those countries is more psychology and playing chicken than anything else (and yes, accident rates are apalling)
I said people are terrible drivers. I think likely a fleet of all automated cars will be safer than a fleet of human drivers.
The problem comes in the interaction between automated drivers and human drivers. Among other things.
Edit: To put it another way, a computer that avoids common-case crash scenarios most of the time outweighs humans avoiding edge-case scenarios sometimes.
Still, I believe autonomous cars can be made better than human drivers.
But as long as humans are driving cars, solving the issue of having an automated car driving alongside them is a non-trivial task which people seem to be underestimating.
> I think this is a terrible, terrible idea and misuse of technology
What a bizarre attitude you have there. What possible rationalisation could you have for this extreme, arbitrary prejudice?
An autonomous vehicle kills a dozen people in a freak accident. Newspapers scream bloody murder. A panel of independent investigators determines a chain of causes. The Immediate bug gets fixed, and the inadequacies in the testing methodology is remedied. We all get to live a tinny bit safer ever after.
1. Autonomous cars shouldn't really be impacted by density. You can only make a highway so dense...there's one-four lanes, and it's like minesweeper. You can be surrounded by six cars at a time, maximum (two on either side, one above and one behind). Density might increase the likelihood of an accident just because there's more objects in motion, but an individual autonomous car would theoretically account for this.
2) The entire point of an autonomous car is for drivers to not need to react to anything at all. So...I'm not sure what this has to do with risk. Maybe the drivers of non-autonomous cars wouldn't be safe...but that's the same situation as today. Autonomous car drivers could read a magazine in the middle of an accident. Who cares?
3) Again, my above comment, this doesn't seem relevant.
I think you're being a bit hysterical, to be honest. It's a problem of math. You can model every possible interaction between the cars on a 3-dimensional plane with a finite number of axes. It might be complex, but we can program every single possible interaction and collision - and that's the first step to programming collision response.
Basically, the takeaway is, I don't think there's a model of car interaction that isn't improved by having an autonomous car, even if only one car out of the two is autonomous. And I'm pretty sure this scales.
I am very dubious about other people's driving skills, I tend to assume everyone else on the road is out to kill me and will do the dumbest thing possible at any given moment.
But even so, I am also an experienced software developer, and I know that software is only as good as the author(s). Bugs happen. It's inevitable. And I don't want to die or be injured because of software errors. I'd rather it be human error.
Now you might say to this, "Planes fly on auto pilot constantly. Every time you fly you're basically in the hands of software." And this would be true. But my response to that is:
1) The air is much less densely packed than the roads and highways.
2) In the air, even though you are traveling much, much faster than in a car, the pilots have more time to react to a problem than a driver in a car.
3) The pilots are highly trained, experienced and hopefully alert. Drivers in automated cars will be complacent and texting on their phones.
I think this is a terrible, terrible idea and misuse of technology, despite the fact that humans are shitty drivers. I think it's only going to exacerbate the problem, not improve it.