News for hackers. Stuff that matters.
Re:Self-driving vehicles against human drivers: Equal safety... by 11thEarlOfMar on Wednesday December 30, 2020 @11:11AM (#25582866)
If it's a subjective matter tied to perception of risk rather than actual, statistical risk, such perception can be swayed.

The challenge remains that people will be killed in accidents involving autonomous control. And we anticipate that the number of people killed will be fewer, hence 'saving lives'. However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents. There will be cases where a court determines that the autonomous system was the cause. Families of those killed will want justice, while those separately saved by autonomous systems may never be heard from in the same case.

I expect that in the end it will come down to a business decision, and that decision will be informed by an actuarial exercise: Will profits and insurance be able to cover the costs of defending and settling such cases. Who knows, maybe the threshold is crossed at 5x safer.

Re:Self-driving vehicles against human drivers: Equal safety... by HALtheWise on Wednesday December 30, 2020 @12:24PM (#25583601)
It strikes me that a useful analogy here is the adoption of automatic elevators in buildings. In some ways, it's amazing that pretty much everyone in industrialized countries is OK with being locked in a windowless box controlled entirely by a computer, hanging over a hundreds of foot deep shaft, and in fact many people were terrified of that when Elevator operators were first replaced with computers. Some places even had operators employed to simply stand there and push the buttons to provide confidence that an trained expert was there, even though they didn't actually contribute to safety. Eventually, autonomous elevators got common enough that people will look at you really funny if you're not willing to ride in one, even though they are still responsible for ~20-30 deaths per year.
Re:Self-driving vehicles against human drivers: Equal safety... by ggreer on Wednesday December 30, 2020 @02:35PM (#25585122)
Can you provide more info about people being terrified of automatic elevators? I searched around and everything I found seems to cite one NPR article from 2015.[1] The interviewee's book is out of print and costs $100[2], so that's where that trail stops. If public sentiment against automatic elevators was as strong as described, it seems like there would be more historical evidence available. It's easier for me to find articles disparaging self-checkout systems than for automated elevators. I realize the change in elevators happened long ago, making articles harder to find, but you'd think at least one of them would have gotten digitized and indexed.

1. https://www.npr.org/2015/07/31/427990392/remembering-when-dr...

2. https://www.amazon.com/Ascending-Rooms-Express-Elevators-Pas...

Re:Self-driving vehicles against human drivers: Equal safety... by HALtheWise on Wednesday December 30, 2020 @05:27PM (#25586951)
I just spent some time digging, but finding original sources from the ~1950s is really hard without a NYTimes subscription.

These sorts of things look like promising primary sources, but I can't access the full text. https://www.nytimes.com/1949/01/12/archives/city-gets-elevat... https://www.nytimes.com/1949/02/03/archives/tenants-want-a-d... https://www.nytimes.com/1928/11/11/archives/elevator-law-cha...

Re:Self-driving vehicles against human drivers: Equal safety... by SomewhatLikely on Wednesday December 30, 2020 @07:03PM (#25587895)
I have a subscription. The first two seem to be more about tenants feeling that an operator raises the quality of life. The third one talks of several deaths of children. Apparently in these cases there was a gap of 8 to ten inches between the car doors and the landing doors which accidentally trapped the children and then the car was requested from someone on another level. An ordinance had been proposed to require operators, but opposition claims that rules requiring doors to be flush will prevent such cases.

So this would likely be in the category of cases that would probably never happen with a manual operator. Two solutions were proposed: keep manual operators, or improve the safety of the automatic system.

Re:Self-driving vehicles against human drivers: Equal safety... by tialaramex on Thursday December 31, 2020 @01:14AM (#25590078)
> Two solutions were proposed: keep manual operators, or improve the safety of the automatic system.

After Southall [1] the drivers union felt the correct approach was to double man trains. It is surely not a coincidence this would also have meant more members and thus more power and income for the union.

That accident would have been prevented by ATP (fitted to the train but disabled because the driver had not been trained) or AWS (fitted to all British trains but disabled by the driver due to a fault).

The ATP system would have braked to a halt to avoid entering an occupied track section. AWS would have audibly alerted the driver to the signals (showing a Preliminary Caution, an ordinary Caution and then Danger) and if the driver did not react, braked to a halt. With neither it appears the driver simply did not see the signals because they weren't looking and so did not react until far too late.

The correct fix of course is to require trains to have working AWS/ ATP and use it. Operating trains with more humans is a worthwhile work around to get a faulty train back to a repair yard as empty stock, but makes no sense in passenger service.

[1] https://en.wikipedia.org/wiki/Southall_rail_crash

Re:Self-driving vehicles against human drivers: Equal safety... by Guthur on Wednesday December 30, 2020 @08:01PM (#25588337)
The analogy with elevators largely doesn't work. In the main the only individuals at risk from an elevator accident are those that chose to enter the elevator, this is vastly different for automotive accidents where the individuals affecting by the autonomous car are not those that chose to use one.
Re:Self-driving vehicles against human drivers: Equal safety... by aeternum on Wednesday December 30, 2020 @08:14PM (#25588418)
If anything, that should be more of an argument for autonomous cars being allowed once they reach only 1x of the safety of human-driven-vehicles.

Almost by definition, more pedestrians will die if we wait for the 4-5x safety threshold proposed in the article.

Re:Self-driving vehicles against human drivers: Equal safety... by studius on Wednesday December 30, 2020 @09:04PM (#25588757)
The 4-5x is based on statistics of a sample with a high ratio of human drivers to autonomous drivers, if done on the road today.

Autonomous won't be known to be N times as safe as human driving until there are sufficient autonomous cars on the road and the varying ratios of autonomous to human drivers have been at equilibrium for a some sufficient amount of time to gather sufficient data to compare to human driving safety statistics.

So- 4-5x times is a lie. It could be much more dangerous with only autonomous drivers or much less dangerous. They don't know yet.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @09:47PM (#25589048)
> So- 4-5x times is a lie. It could be much more dangerous with only autonomous drivers or much less dangerous. They don't know yet.

"could be"? Statistics? Aren't these studies asking about theoretical cars that are by definition a certain amount safer?

Re:Self-driving vehicles against human drivers: Equal safety... by studius on Wednesday December 30, 2020 @10:02PM (#25589131)
e.g. "This autonomous car is 4-5x safer than your human-driven car."

When people hear numbers like that, they may assume it's based on sufficient data and is true, even if it's theory.

But how could it be true or acceptable, given that we're only just starting to have more autonomous vehicles on the road, and the safety could be dependent on the ratio of autonomous vehicles to human drivers?

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:09PM (#25589168)
Are you talking about the study, or people claiming that about real cars? The study would need to have a wide variety of safety numbers, and all the cars are theoretical. If 4-5x lines up with a claim about a real car, it's probably a coincidence. Saying there's not enough data about real cars has no bearing on this research at all, unless the abstract is wildly misleading.

You replied to someone talking about waiting for autonomous cars to be 4-5x as safe. That means they are waiting for a car to meet that threshold with correct statistics. You can't call out nonexistent statistics as being a lie!

Re:Self-driving vehicles against human drivers: Equal safety... by studius on Wednesday December 30, 2020 @10:16PM (#25589212)
We have safety statistics on real cars with a minority of autonomous vehicles on the road.

What we don't have are adequate safety statistics on autonomous cars on the road with each other and human drivers at various ratios of autonomous cars to human-driven cars.

If a study were to be able to propose safety numbers based on the various ratios and various autonomous cars and systems, then that would be adequate, given the theories behind those numbers are well-founded.

If you were to say, "This is how it is: given that the ratio of autonomous cars to human-driven cars isn't changing and we expect it to stay the same, we can see that the autonomous cars are 4-5x safer," then I'd not call it a lie.

But 4-5x safer without qualifications shows a gross misunderstanding of the importance of the effect of the ratio of autonomous drivers to human drivers; the variation in environment and expected behavior could influence greater or decreased safety, leading false assumption.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:42PM (#25589349)
It would be easy to do a comparison with different ratios, though, so you shouldn't preemptively assume incompetence.

And it seems pretty unlikely that increasing the number of autonomous cars will make them signficantly less safe, and that's the only result that would be a problem. Mild fluctuations don't matter on a scale as coarse as "4-5x", and an improvement would be good.

Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @06:50AM (#25591836)
Do you think that increasing the number of autonomous cars will linearly decrease the number of accidents to a certain point? Don’t you think that increasing their number will increase the chances of meeting with really bad human drivers and we simply don’t have sufficient info on whether those ‘meetings’ are less or more deadly than with a human driver - and those are the cause of a significant chunk of accidents. And by intuition I doubt that today’s AI could react better than a competent human driver to someone cutting in front of it, and the like. Simply because we are better at reading high-level patterns in others’ driving. Reaction time is not the only metric that matters.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Thursday December 31, 2020 @11:11AM (#25593929)
> Do you think that increasing the number of autonomous cars will linearly decrease the number of accidents to a certain point? Don’t you think that increasing their number will increase the chances of meeting with really bad human drivers and we simply don’t have sufficient info on whether those ‘meetings’ are less or more deadly than with a human driver - and those are the cause of a significant chunk of accidents.

There's a difference between the risk changing, versus merely going from insufficient data to sufficient data.

When you have an extremely small data pool, it's also quite possible that one or two meetings with a really bad driver will give you a misleadingly bad impression of autonomous cars.

But I'll put it this way. Once we've seen either 10 billion miles or 100 fatalities from a particular tier of self-driving, we'll have a very solid idea of how dangerous it is. Getting that much data only requires a tenth of a percent of cars in the US for three years. (And if they're particularly dangerous we can easily abort the test early.)

> And by intuition I doubt that today’s AI could react better than a competent human driver to someone cutting in front of it, and the like. Simply because we are better at reading high-level patterns in others’ driving. Reaction time is not the only metric that matters.

If someone's dangerously cutting people off there probably isn't much to read in their patterns. Being cut off seems to me like one of the situations that is most about reaction time and least about thinking.

Re:Self-driving vehicles against human drivers: Equal safety... by floatingatoll on Wednesday December 30, 2020 @08:33PM (#25588547)
While "those unable to stairs up to floor XYZ" can be proven to be a statistically smaller subgroup than "all possible elevator riders", this argument may not hold much water. If you're a wheelchair user or other less-abled person, and your choice is between stairs and an elevator of any sort, you weren't really given much of a choice in that matter.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @06:42AM (#25591783)
I know it’s an analogy, but elevators are dead-simple concepts with many fail-safety mechanisms independent of the controlling ‘program’. Self-driving cars are ridiculously complicated black-box program with at most software fail-safes that are itself more complicated than one can reason about so the only thing remaining is empirical testing in real-world situations. And every single bugfix have to be retested substantially as it can just as easily make something else worse - and I don’t feel confident about today’s “self-driving” cars
Re:Self-driving vehicles against human drivers: Equal safety... by dekervin on Wednesday December 30, 2020 @12:46PM (#25583864)
there is some kind of implied machine capability that a layman assign to a computer. If a task is culturally ( through movies , series, ... ) though to be within that implied capability people will be comfortable. ( cf automatic trains, ... )
Re:Self-driving vehicles against human drivers: Equal safety... by RcouF1uZ4gsC on Wednesday December 30, 2020 @05:49PM (#25587194)
The difference with elevators is that the safety systems are actually in large parts independent of the control. Since the Otis safety elevator, you could go so far as to cut the elevator cord and it would still be ok.

With self-driving cars, you don't have those type of backup safety systems.

Re:Self-driving vehicles against human drivers: Equal safety... by a_t48 on Wednesday December 30, 2020 @06:33PM (#25587627)
You don't have those sorts of systems for regular human drivers, either. If a human driver passes out (diabetic episode, heart attack, drunkeness), you are just as SOL. With a self driving system there's various levels of redundancy you can put in, up to some sort of dead man's switch on an embedded controller that slams the brakes (or maybe just a gentle stop in combination with existing ADAS) if all of the "higher level" systems stop responding.
Re:Self-driving vehicles against human drivers: Equal safety... by paulryanrogers on Wednesday December 30, 2020 @07:03PM (#25587891)
It's true that's a similar problem with humans. Yet when it occurs to the same person often they may face restrictions on their driving privileges.

When AI goes bad it could impact whole fleets simultaneously. And for all the many ways we know software can unintentionally go bad the liability can be a rabbit hole.

Re:Self-driving vehicles against human drivers: Equal safety... by ageofwant on Wednesday December 30, 2020 @07:39PM (#25588169)
That seems very unlikely. 'AI' driving systems are subjected to millions of hours of simulated driving. A very good human driver will have a few thousand hours of experience after decades of driving.
Re:Self-driving vehicles against human drivers: Equal safety... by chrisco255 on Wednesday December 30, 2020 @08:23PM (#25588472)
Has your computer or phone ever glitched? Have you ever suffered a Malware attack? Every single way that computers are vulnerable, machine driven systems are vulnerable. We just saw the SolarWinds hack that was installed through malicious software updates. That could happen in an autonomous driving system as well.

Humans are still far better at dealing with unforeseen circumstances than computers. An AI is trained on a dataset and can overfit for certain parameters.

Re:Self-driving vehicles against human drivers: Equal safety... by ageofwant on Wednesday December 30, 2020 @09:18PM (#25588861)
Releasing unverified AV code would breach most every 'duty of care' legislation in existence. Releasing it in a way that compromises thousands of systems at a time would be the same. These are devops issues not capability.

An AV system needs to pass the driving test your 16 year old sister passed, that's it.

Re:Self-driving vehicles against human drivers: Equal safety... by chrisco255 on Wednesday December 30, 2020 @10:32PM (#25589306)
That has already happened with network security software (SolarWinds) used at the highest levels of government including the Pentagon, White House, Congress, and most of the Fortune 500. There is no reason to believe that a massive AI driving system could not be hacked in a similar way through a malicious exploit or update. In fact, adversial AI could be used to dupe these tests and achieve the effect. If 50 million cars on the road were using one particular software suite, this is a vector of attack that has to be considered. It is not an impossibility and you cannot hand wave it away.
Re:Self-driving vehicles against human drivers: Equal safety... by itchyouch on Wednesday December 30, 2020 @10:14PM (#25589196)
The current L2 system developed by Comma.ai simulates the model and changes in CI on every commit from what I can tell.
Re:Self-driving vehicles against human drivers: Equal safety... by josefx on Wednesday December 30, 2020 @08:33PM (#25588550)
The average human driver doesn't need millions of pictures of a stop sign to identify one either. Training current AIs sucks and the results need to be verified because they can be flacky, the current research really doesn't come close to match an organism that spend millions of years evolving the ability to move in a complex 3D world.
Re:Self-driving vehicles against human drivers: Equal safety... by ageofwant on Wednesday December 30, 2020 @09:26PM (#25588918)
The AV problem is not as intractable as you imagine. Driving a car is not the same as dating a girl.
Re:Self-driving vehicles against human drivers: Equal safety... by paulryanrogers on Wednesday December 30, 2020 @07:46PM (#25588214)
Which seems unlikely?

Do AI drivers face the same variety of conditions as humans? Or is it millions of hours on near [perfect] roads in a temperate climate?

Re:Self-driving vehicles against human drivers: Equal safety... by tsimionescu on Thursday December 31, 2020 @01:54AM (#25590266)
You can't compare the times, because AI and humans "learn" in vastly different ways, at vastly different rates.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @06:56AM (#25591867)
Can an AI system learn on the fly (that would negate the testing done by the way)? Because I’m fairly sure other than sensor input “normalization”, they can’t and humans can.
Re:Self-driving vehicles against human drivers: Equal safety... by tomp on Wednesday December 30, 2020 @06:57PM (#25587838)
It's in a human's interest to not kill him/herself.

The interests aren't aligned at all with self-driving cars. Do you think any executives, engineers or salespeople will go to jail if anyone dies? Think again.

Re:Self-driving vehicles against human drivers: Equal safety... by Fricken on Wednesday December 30, 2020 @07:17PM (#25587995)
Humans typically aren't interested in killing themselves, but their judgement can also be pretty bad. 40% of traffic fatalities involve impaired driving. In 2018 Distracted driving was attributed to 2,800 fatalities.

Uber ATG's fatal pedestrian collision was the beginning of the end for the program. Uber CEO Travis Kalanick was pushed out of the company, the program has been shuttered, and one of the top engineers, Anthony Levandowski, is in jail (although Levandowski was not implicated in the accident, he's also not invulnerable).

Re:Self-driving vehicles against human drivers: Equal safety... by morelisp on Wednesday December 30, 2020 @08:24PM (#25588477)
You think Kalanick was pushed out because of the one self-driving crash, and not the sexual harassment scandals, theft of medical records, or threats to journalists?

(Of course it wasn't any of those - it was because the self-driving program wasn't anywhere close to working even ignoring all the safety problems. You can do all those things - the only thing you can't do is waste investor money.)

Re:Self-driving vehicles against human drivers: Equal safety... by Fricken on Wednesday December 30, 2020 @08:38PM (#25588580)
Travis autonomy would take a couple years. He spent some absurd sum acquiring the talent for ATG and gave them unrealistic deadlines. The program was a shit show. A pedestrian was killed, the program was stopped, Investor money was lost. While this is not the only factor leading to Kalanick's ousting, it was a big one.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @09:29PM (#25588933)
The problem isn't total system failure, it's mistakes.

A mistake in a car can cause a crash. A mistake in an elevator can't cause a crash.

Re:Self-driving vehicles against human drivers: Equal safety... by hypertele-Xii on Wednesday December 30, 2020 @06:53PM (#25587806)
The problem is, what if the higher level systems are responding, but are confused by the data they see? We'd have to have redundant decision-making like in the space industry - two of each computer and sensor that have to agree on the result, otherwise safety systems stop the vehicle.
Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Wednesday December 30, 2020 @08:45PM (#25588638)
We're going to end up at the trolley problem again. "Should I do action X and kill 3 or do action Y and maybe kill 2?"
Re:Self-driving vehicles against human drivers: Equal safety... by LinuxBender on Thursday December 31, 2020 @10:34AM (#25593544)
This was the scenario in the depressing flashbacks in the movie iRobot. [1] A cop, truck driver and a passenger car with a little girl were pinned together under water in a lake. The NS4 (robot) passing by saw the accident and calculated the cop would have the highest probability for survival and rescued him and not the child, giving him PTSD.

I am morbidly curious how much from that movie will play out with cars and other machinery as things evolve. I am also curious if we will learn any lessons ahead of time or if like city traffic lights, {n} number of people have to die before it becomes a financially viable discussion.

[1] - https://www.youtube.com/watch?v=_MFGx8d1zl0

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:14PM (#25589197)
Don't waste too much time on that. These are cars. They can just brake, it's good enough.
Re:Self-driving vehicles against human drivers: Equal safety... by troupe on Wednesday December 30, 2020 @10:56PM (#25589425)
If a self driving car hits a school bus at high speed (despite braking), I'm pretty sure a lawyer will make a case that it could have avoided the school bus by driving up on the side walk which may or may not have had people on it.

I get your point, but I think it is probably more correct for people who are making a split second decision rather than for a car where the decision has already been made in code and someone (or some company) has to take responsibility for why it was made that way.

Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:02AM (#25591894)
Today’s AIs are happy to correctly identify which lane they should be on - counting how many people are on a given vehicle is so way out of scope that there is no point continuing.
Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Thursday December 31, 2020 @02:03PM (#25595886)
This is a strawman.

If the option is available to avoid collision with another car and it brakes instead, colliding and killing someone else, that will be a lawsuit and that lawsuit will easily win.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Thursday December 31, 2020 @12:19AM (#25589845)
You'll have lawyers willing to make a case against you even if you make a provably perfect choice.

And the real issue is whatever got you into that situation, not the split second choice you make.

Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Wednesday December 30, 2020 @10:16PM (#25589211)
Let me know when we reach the point that autonomous cars can bend the laws of physics too, that would truly be a hoot!
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:31PM (#25589298)
I think you deeply misunderstood me.

I'm not saying that braking is magic and solves all problems. I'm saying that braking is morally sufficient in the real world. If hitting something is unavoidable, you can hit whatever is directly in front of you while braking as hard as possible. It's good enough.

Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Thursday December 31, 2020 @10:16AM (#25593387)
That's good enough for a human.

Not for a machine which you can file a lawsuit over and say "it had a decision that it can actually make and chose to kill my son." See how that changes things? It's no longer "an accident."

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Thursday December 31, 2020 @11:12AM (#25593939)
Eh. You can say the exact same thing about a human.

Apply the reasonable person standard. Are they going to do any better? Probably not.

Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Thursday December 31, 2020 @02:02PM (#25595872)
No you can't. Humans don't have near the reaction time as these self driving cars do. They can process much more than we can, and they never get distracted, like we do.

If a self driving car kills someone and it had the choice/option to do something else then we have a problem that needs dealt with. This isn't a human being or human error.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Thursday December 31, 2020 @03:37PM (#25596841)
Humans can panic and decide to swerve, and it only takes them a fraction of a second longer than it takes a self-driving car. Someone willing to argue that the car had a choice and made the wrong one could just as easily argue that the human had a choice and made the wrong one.

You might personally think that oh, the machine is being rational and intentional, that's different from a human. But a lot of people will treat a human the exact same way. That split second panic is judged as if they had all the time in the world to consider the optimal choice.

The legal system already has and handles this type of lawsuit.

Re:Self-driving vehicles against human drivers: Equal safety... by a_t48 on Wednesday December 30, 2020 @08:47PM (#25588650)
There's nothing stopping someone from making a self driving car with two compute systems and multiple types of sensors with overlapping FoVs. In fact, you can usually see on most self driving cars - a minimum of two roof mounted LIDAR (which share FoV in front and back) and various cameras.
Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Wednesday December 30, 2020 @08:43PM (#25588623)
I don't think a self driving car that has to make rapid decisions in quickly changing circumstances with tons of moving parts outside of its control is comparable to a specific use case with much fewer variables like an elevator.
Re:Self-driving vehicles against human drivers: Equal safety... by RhodesianHunter on Wednesday December 30, 2020 @09:20PM (#25588877)
Why not? The relative complexity of an automatic elevator at the time considering their level of tech was probably comparable to the complexity of an autonomous vehicle today.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @06:54AM (#25591852)
Lol. At the level of tech? We are barely better than a lego mindstorm that goes forward until something is not closer than x centimeters.. (with a bit of sarcasm)

An autonomous car can’t really exit a parking building (I’m not really sure what are they called, but those multi-level parking thingies) because it would require them to understand signs and the like and those may often be missing.

Re:Self-driving vehicles against human drivers: Equal safety... by RhodesianHunter on Thursday December 31, 2020 @07:18PM (#25598973)
I rode around Vegas in an automated car at reinvent last year. It understood signs just fine.

they have thousands and thousands of miles of autonomous driving across California and Nevada.

Re:Self-driving vehicles against human drivers: Equal safety... by porknubbins on Wednesday December 30, 2020 @11:26AM (#25583008)
Somehow the idea of a computer error killing me seems way worse than at least having a chance to save myself, since I’m a very cautious driver (though unlikely safer than average by 5x) . Self driving cars need to get to airline level safety where crashes are a rare thing and most people don’t think twice about giving up control to the pilots/auto pilot. If that takes expensive Lidar thats what we should use. I can’t imagine ever feeling good about trusting my life to a computer vision algorithm.
Re:Self-driving vehicles against human drivers: Equal safety... by colechristensen on Wednesday December 30, 2020 @11:49AM (#25583235)
A computer error is going to be scarier by far.

When a human kills someone with a car it is almost always in a way we can empathize. When you’re around cars you have pretty good mental models for the humans that drive them and how the car will behave.

When you’re around human piloted cars you can look at the driver and get a pretty good idea of intent. You can tell if the driver sees you, you can tell what their mental state is, if they’re paying attention, what they intend to do. You can sum up a person with a glance, this is the power of evolution, we’re really good at figuring things out about other living things.

Crossing the street in front of a car is a leap of faith, not troubling at all when there’s a human there, but a robot? There’s no body posture, no gestures, no facial expressions, nothing to go on. There’s a computer in control of a powerful heavy machine that you’re just expected to trust.

Robot cars don’t make human mistakes, they make alien mistakes like running down kids on the sidewalk in broad daylight, things which don’t make any sense at all that make people feel like they aren’t anywhere safe.

It won’t take but a couple of cute kids killed in a surprising matter to shut down the whole autonomous experiment.

Re:Self-driving vehicles against human drivers: Equal safety... by twoWhlsGud on Wednesday December 30, 2020 @06:38PM (#25587669)
From experience I can say that's it's pretty disturbing when a human driver breaks your model, too. And this happens more often than I'd like - I was second in a set of pedestrians about to cross the street (two lane arterial with a 25mph limit - heavily used by both cars and peds - at a cross walk I use several times a week) - the guy in front of me and I both judged that the driver was looking in our direction (it was dark admittedly but street is well-lit) and the car slowed in a fashion that led us to think it was going to stop.

The fellow in front of me steps in front of the car which suddenly accelerates and hits him knocking him down. Immediately before impact it decelerates and comes to a stop.

The fellow ended more shaken up than anything else, but it was a very near thing and a reminder that it's precisely that assumption of the predictability of human drivers that fails in many crash situations.

In other words, your judgement that you understand what other drivers are going to do is more fragile than you imagine.

Re:Self-driving vehicles against human drivers: Equal safety... by itchyouch on Wednesday December 30, 2020 @10:19PM (#25589230)
It seems that most of the radar systems today in cars (in the US) are pretty adept at detecting pedestrians reliably and engaging the automatic emergency braking system to at least minimize the potential for harm.

On my 2018 Lexus, AEB won't come to a complete stop, but it will definitely slow from say 40mph to 20mph, so hitting a pedestrian at 20 hopefully has a much better outcome than hitting them at 40+.

Re:Self-driving vehicles against human drivers: Equal safety... by dado3212 on Wednesday December 30, 2020 @11:59AM (#25583336)
> Crossing the street in front of a car is a leap of faith, not troubling at all when there’s a human there, but a robot? There’s no body posture, no gestures, no facial expressions, nothing to go on. There’s a computer in control of a powerful heavy machine that you’re just expected to trust.

This is something that's very solvable though. Robot cars should and almost definitely will have a way to communicate to pedestrians. I agree with the general point though around a greater possibility of very out of the norm mistakes.

Re:Self-driving vehicles against human drivers: Equal safety... by wool_gather on Wednesday December 30, 2020 @12:38PM (#25583757)
There's an opportunity for them to communicate better with pedestrians than the average human driver. Drivers tend to assume that their intent to stop or not to stop is obvious and don't bother with a clear signal like flashing their lights or waving visibly.

From the pedestrian's perspective, it can be hard to see the driver at all (small movements of the hand can be invisible in sun glare; direction of gaze likewise), and also hard to tell what they're doing. Just because they're slowing somewhat as they approach doesn't mean they see you or intend to stop.

Re:Self-driving vehicles against human drivers: Equal safety... by throwaway201103 on Wednesday December 30, 2020 @07:28PM (#25588077)
One could imagine a standardized set of signals on the front of the car. Red = stopped/stopping. Yellow = about to start moving; Green = moving and continuing. Something like that.
Re:Self-driving vehicles against human drivers: Equal safety... by jfim on Wednesday December 30, 2020 @03:15PM (#25585558)
Drive AI (now acquired by Apple I believe) used to have LED matrix displays that communicated that way with other road users. I recall seeing them say things like "waiting for you to cross" or "driving autonomously" with an icon.
Re:Self-driving vehicles against human drivers: Equal safety... by Fricken on Wednesday December 30, 2020 @07:19PM (#25588006)
They really just needed a pair of animated eyes.
Re:Self-driving vehicles against human drivers: Equal safety... by kevin_thibedeau on Wednesday December 30, 2020 @08:56PM (#25588708)
White parka crossing a snow covered road. Will the AI make the right decision?
Re:Self-driving vehicles against human drivers: Equal safety... by beat on Wednesday December 30, 2020 @12:16PM (#25583520)
When a human kills someone with a car because they're drunk, or texting, I don't have much empathy for them.

I read a statistic long ago - don't know how true it is, but it feels truthy - that half of all traffic fatalities happen between 9pm and 3am on friday and saturday nights. The fact that autonomous systems will never be intoxicated, distracted, or emotional makes me feel much safer.

Re:Self-driving vehicles against human drivers: Equal safety... by YeGoblynQueenne on Wednesday December 30, 2020 @02:29PM (#25585057)
A brick tied to the gas pedal will also never be intoxicated. It takes more than inability for intoxication to make a system that can drive a car safely.
Re:Self-driving vehicles against human drivers: Equal safety... by staunch on Wednesday December 30, 2020 @12:27PM (#25583640)
That stat seems to be very untruthy. Fatal crashes seem to be distributed much more evenly than I would've guessed.

https://injuryfacts.nsc.org/motor-vehicle/overview/crashes-b...

Re:Self-driving vehicles against human drivers: Equal safety... by beat on Wednesday December 30, 2020 @12:42PM (#25583809)
Maybe not 50%, but there's certainly a strong bias in that data toward friday/saturday nights. Since the data resets at midnight rather than on bar hours, look at the difference in midnight-4am data on saturday and sunday mornings, vs the rest of the week.
Re:Self-driving vehicles against human drivers: Equal safety... by throwaway0a5e on Wednesday December 30, 2020 @07:07PM (#25587933)
Those are also the only nights when people are out at all. People who have to be at work on weekday mornings aren't driving home from visiting their parents late on a Tuesday night, they're doing it late on a Saturday night. Yeah, it probably is alcohol but there's a lot of confounding factors.
Re:Self-driving vehicles against human drivers: Equal safety... by throwaway201103 on Wednesday December 30, 2020 @07:34PM (#25588117)
Indeed. A drunk driver alone on the road isn't really a danger to anyone but himself.
Re:Self-driving vehicles against human drivers: Equal safety... by ealexhudson on Wednesday December 30, 2020 @12:29PM (#25583653)
It only makes me feel safer if those systems are substantially safer than humans.

If the systems are broadly as safe as humans _including_ a significant set who are drunk / high / distracted, that feels subjectively much less safe even though the statistical number of accidents is the same.

Re:Self-driving vehicles against human drivers: Equal safety... by beat on Wednesday December 30, 2020 @12:37PM (#25583753)
Oh, I concur. I want it measured against skilled, sober, attentive drivers, not "bad" drivers.
Re:Self-driving vehicles against human drivers: Equal safety... by ageofwant on Wednesday December 30, 2020 @08:11PM (#25588400)
Everybody drives better than the average, until they get distracted or tired. A AV driver that passes the standardised driving test 1M times in a row is good for me.
Re:Self-driving vehicles against human drivers: Equal safety... by hypertele-Xii on Wednesday December 30, 2020 @06:58PM (#25587851)
Well, now we've transferred the responsibility: Now the programmers of the car's AI must never be intoxicated, distracted, or emotional while creating it. Also, the business people managing the programmers must not be greedy, callous, or incompetent, which is a tough sell.
Re:Self-driving vehicles against human drivers: Equal safety... by ageofwant on Wednesday December 30, 2020 @07:52PM (#25588265)
So we need AI driver certification then. Just like we have with people. If the AI can past the, perhaps 5x human capability test, its licensed to drive, just like the 16 year old teenager driving his new truck on the highway behind you with his four buddies scolling coors.
Re:Self-driving vehicles against human drivers: Equal safety... by beat on Wednesday December 30, 2020 @12:47PM (#25583878)
The one time I was hit by a car as a pedestrian was a driver who wasn't paying attention. He was making a perfectly legal left turn at a green light, except for the pedestrians in the way (me and my girlfriend).

The danger with an autonomous vehicle is it not seeing you. The danger with a driver is not noticing you.

Re:Self-driving vehicles against human drivers: Equal safety... by itchyouch on Wednesday December 30, 2020 @10:24PM (#25589254)
I'd think that with the radar systems in place today, vehicles would have far greater reliability in "seeing" you.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:16AM (#25591964)
But that doesn’t require self-driving, but a commonly implemented emergency brake in a ‘normal’ car.
Re:Self-driving vehicles against human drivers: Equal safety... by ridgeguy on Wednesday December 30, 2020 @07:41PM (#25588184)
> Robot cars don’t make human mistakes, they make alien mistakes like running down kids on the sidewalk in broad daylight, things which don’t make any sense at all that make people feel like they aren’t anywhere safe.

This expresses well the perceived difference between catastrophic human and machine errors.

I have two cars, a ’99 4Runner and a Tesla Model S.

When driving my S, I’m at an involuntary elevated state of alertness compared to my 4Runner. I think it’s discomfort at driving a car that might suddenly kill me through failure modes that I can’t possibly anticipate.

While I think my S’s technology is much more likely to result in my safe travel than my dumb iron 4Runner, my subconscious maintains a different assessment.

I expect this dichotomy in perceived risk is generational and will disappear after a decade or two of lower accident rates in autonomous vehicles compared to human drivers.

Re:Self-driving vehicles against human drivers: Equal safety... by itchyouch on Wednesday December 30, 2020 @10:28PM (#25589279)
I outfitted my car with Comma's openpilot and I can concur with that my experience is similar with the additional effect that overall, my driving quality of life is significantly improved.

I can tell that I already have an inordinate amount of trust in the system several weeks in on boring highway driving.

Re:Self-driving vehicles against human drivers: Equal safety... by mcot2 on Wednesday December 30, 2020 @12:05PM (#25583395)
We can eventually make AI do any of that better than a human by a long shot.

We tend to overestimate the power of the human brain. There is a lot we don’t know yet, but we shouldn’t treat it as magic and unsolvable by AI.

Re:Self-driving vehicles against human drivers: Equal safety... by panta on Wednesday December 30, 2020 @01:06PM (#25584154)
There is no evidence that AI can reach the level of skill and safety of a human driver. I’m not saying that it’s not possible, only there is no reason to be sure of the contrary. IMHO we are extremely far.
Re:Self-driving vehicles against human drivers: Equal safety... by mcot2 on Wednesday December 30, 2020 @02:04PM (#25584811)
And IMHO we are extremely close. There is lots of evidence that AI can be much _better_ than a human driver, although currently on things like well mapped highway driving with clear conditions. Whats going on now is just making that general purpose for all different types of enviornments.
Re:Self-driving vehicles against human drivers: Equal safety... by mcguire on Wednesday December 30, 2020 @06:02PM (#25587331)
Out of curiosity, do you have a specific source for,

"There is lots of evidence that AI can be much _better_ than a human driver, although currently on things like well mapped highway driving with clear conditions."

The only thing I know about is claims from Tesla, comparing Autopilot (in "well mapped highway driving with clear conditions") versus general human drivers (and which, as I recall, had some further sketchiness).

Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:18AM (#25591981)
They can easily surpass humans in really specified problems like looking at millions of cells and identifying which is likely cancerous. Today’s AIs are pretty bad at complex problems where each subproblem would require a specific AI and then some logical thinking on top measuring each results’ to each other. And driving in non-trivial circumstances is definitely in the latter category
Re:Self-driving vehicles against human drivers: Equal safety... by rtx on Wednesday December 30, 2020 @10:49PM (#25589387)
Without special infra, we are atleast 50 years away.
Re:Self-driving vehicles against human drivers: Equal safety... by glandium on Wednesday December 30, 2020 @09:08PM (#25588787)
> well mapped highway driving with clear conditions

and perfectly visible unambiguous markings. The bar is rather low.

Re:Self-driving vehicles against human drivers: Equal safety... by asiachick on Wednesday December 30, 2020 @12:11PM (#25583466)
Honda did an experiment where they added LCD's to the headlights to give the car expressive eyes to communicate to people outside the car.

Also while it is scary to us and it will take a while there are already self driven vehicles we just take for granted like elevators and driverless trams/trains. Sure they are much easier to make but they weren't trusted at first.

Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Wednesday December 30, 2020 @08:52PM (#25588679)
This comparison is just not a good one.

Trains are on a track, the scenario never really changes. The variables are low. Just like in an elevator, which is largely a mechanical device anyway. There is no real decision making.

Re:Self-driving vehicles against human drivers: Equal safety... by bwat49 on Wednesday December 30, 2020 @01:07PM (#25584168)
and here I was about to make a joke about adding emoticons to the front of self driving cars
Re:Self-driving vehicles against human drivers: Equal safety... by throwaway201103 on Wednesday December 30, 2020 @07:36PM (#25588136)
No need for anything so corny. Just need some standardized signaling. We already have it for brake lights and turn indicators.
Re:Self-driving vehicles against human drivers: Equal safety... by dkobran on Wednesday December 30, 2020 @01:49PM (#25584655)
> When a human kills someone with a car it is almost always in a way we can empathize

Nonsense. You can empathize with someone texting and killing someone?

This whole post reads like an attempt to appeal to people’s emotional attachment to human drivers coupled with fearmongering about robots.

You are placing far too much emphasis one our ability to “read” other drivers intent and the impact this has on automobile accident fatalities. Many accidents occur without any chance to see the offending driver e.g. accidents at night, someone switching lanes when you are in their blind spot, a drunk driver suddenly doing something erratic, etc. Moreover, this so-called advantage of human drivers is statistically meaningless unless you believe that the number of deaths due to automobile accidents is at an acceptable level and that it cannot be improved with technology, in this case, AV. I certainly don’t believe that. In the not too distant future, I believe this position will be laughable. Through adoption of autonomous vehicles, many predict we will drastically cut the number of fatalities. Will there be issues along the road? Most certainly. But as long as the overall number is falling by a significant amount, we simply cannot justify our love affair with humans “being in control”. We’ve proven to be perennially distracted, we have terrible reaction times, we have extremely narrow vision, we panic in situations instead of remaining calm, etc. and yes, these faults do lead to the deaths of children. These are not theoretical deaths like the robot scare tactic examples, these are actual deaths from human drivers.

Re:Self-driving vehicles against human drivers: Equal safety... by ksk on Wednesday December 30, 2020 @02:43PM (#25585183)
>Through adoption of autonomous vehicles, many predict we will drastically cut the number of fatalities.

Who are these many people, and why should we believe their predictions?

> We’ve proven to be perennially distracted, we have terrible reaction times, we have extremely narrow vision, we panic in situations instead of remaining calm, etc. and yes, these faults do lead to the deaths of children.

We've also proven that all software has bugs, and developers keep introducing new bugs in every single release. There is no reason to think that self-driving car software will be any different. Whats worse is that when software is updated, these bugs will now be pushed out to tens of thousands of cars - instantly.

Bit much to call someones position nonsense when they're just skeptical of obvious stuff :)

Re:Self-driving vehicles against human drivers: Equal safety... by dkobran on Wednesday December 30, 2020 @03:23PM (#25585638)
I was referring the absurdity of empathizing with drivers who kill people while texting, drunk, etc. (hence the quotation). What part of that statement do you agree with?

But I’ll go further and double down and say the entire post is nonsense. Why? Because the author’s skepticism doesn’t extend to the human factor. The position is not an accurate representation of the facts i.e what causes accidents (humans) and the known data around AVs today. If AV risk is so obvious as you claim then why does the enormous amount of data show that AVs are involved in the less accidents and lead to less fatalities than cars operated by humans on a mile per mile basis? And how is the negligent human driver not obvious as a source of automobile fatalities? The notion that we are safe because we can read humans is not substantiated by anything. Maybe you believe this number of fatalities is acceptable or the best we can do but I certainly don’t. There will be flaws in autonomous vehicles, no doubt. But will there be a net reduction in automobile related fatalities as a result? Like anyone else, I can’t predict the future. But to paint a rosy picture about how our ability to read other drivers is somehow safer relative to AVs is nonsense. It just is. The data doesn’t support this argument. And separately, if we’re talking about will happen in the future, the notion that humans will ultimately prevail over AVs because for safety reasons seems preposterous. We can debate the “when” in terms of AVs but debating the “if” seems pretty out of touch with the way society has progressed with respect to our willingness to depend on technology.

Re:Self-driving vehicles against human drivers: Equal safety... by ksk on Wednesday December 30, 2020 @05:53PM (#25587251)
>Because the author’s skepticism doesn’t extend to the human factor.

And your over-enthusiasm for AV doesn't extend to the human factor. We all have our own blinders ;)

>The notion that we are safe because we can read humans is not substantiated by anything.

That is your own misinterpretation. I did not read the comment that way.

>If AV risk is so obvious as you claim then why does the enormous amount of data show that AVs are involved in the less accidents and lead to less fatalities than cars operated by humans on a mile per mile basis?

What you mean when you say AV, is actually "AV + Human". We're running controlled experiments, limiting the unknowns, and we're mandating a human be present - because the current AV technology sucks.

> We can debate the “when” in terms of AVs but debating the “if” seems pretty out of touch with the way society has progressed with respect to our willingness to depend on technology.

People used to say that about flying cars 40 years ago.

Re:Self-driving vehicles against human drivers: Equal safety... by wnkrshm on Wednesday December 30, 2020 @08:29PM (#25588519)
A future where AVs exist that can replace human drivers is a future where so many requirements and drivers for personal mobility have changed as well: due to the possibility of replacing a human performing a highly complex task in situ.

That future may not even want or need cars.

The other, more realistic future is one where human-level AVs are always just out of reach. Where causes of accidents are just as intransparent as with human drivers, we're all a little bit safer but a patch can cause catastrophic divergent behavior due to the innate non-linearity of the problem.

That future may not want or need cars either but it may not even be considered.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @09:38PM (#25588989)
> The other, more realistic future is one where human-level AVs are always just out of reach.

That sounds pretty unlikely to me. "just out of reach" is a very narrow band, and to be stuck there despite decades of improvements would be pretty strange. I think there are only two likely outcomes for the next 50 to 100 years: either we don't even get particularly close, or we'll slowly but surely surpass the median human driver.

Re:Self-driving vehicles against human drivers: Equal safety... by ksk on Thursday December 31, 2020 @01:13PM (#25595284)
>That future may not even want or need cars.

Agreed, 100%. Instead of AV, we could focus on remote presence and other tech to make cars and/or daily commute unnecessary.

Re:Self-driving vehicles against human drivers: Equal safety... by henrikschroder on Wednesday December 30, 2020 @11:12PM (#25589501)
> Robot cars don’t make human mistakes, they make alien mistakes like running down kids on the sidewalk in broad daylight, things which don’t make any sense at all that make people feel like they aren’t anywhere safe.

This.

It doesn't matter if autonomous cars are objectively safer, 5x, 10x, 100x, doesn't matter. They have to be subjectively safer, which is part PR problem, UI problem, and part human stubbornness problem.

Re:Self-driving vehicles against human drivers: Equal safety... by tuatoru on Wednesday December 30, 2020 @01:33PM (#25584478)
> When you’re around human piloted cars you can look at the driver and get a pretty good idea of intent. You can tell if the driver sees you ...

This is a key area of driving that has been completely overlooked in AVs so far - giving feedback to other non-car road users.

Not hard on the face of it (excuse the pun).

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Wednesday December 30, 2020 @01:19PM (#25584327)
> It won’t take but a couple of cute kids killed in a surprising matter to shut down the whole autonomous experiment.

That is sacrificing the counterfactual children that wouldn't have been killed if the bad human driver had been replaced by an average autonomous car.

Re:Self-driving vehicles against human drivers: Equal safety... by ntsplnkv2 on Wednesday December 30, 2020 @08:53PM (#25588687)
Society isn't without emotion.

As much as we engineers want to look at numbers and say "see, safer!" That does little to help people who have had deaths, or the visceral impact that death can have.

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Sunday January 03, 2021 @02:34PM (#25624415)
You also end up reducing the number of people who are impacted by death or who have to feel those emotions. Yes, in the process of touching the system you also end up shuffling around who gets affected but in the end it's just part of the process of affecting fewer people.
Re:Self-driving vehicles against human drivers: Equal safety... by Chyzwar on Wednesday December 30, 2020 @01:15PM (#25584285)
Once self-driving is better we need to do is to create moral rules for AI.

There is a car controlled by computer. Pedestrian (child) abruptly enter into road from behind cover. The Computer knows that with current speed it is impossible to stop. Its other choices is to drive into the sidewalk killing an old lady, drive into the opposite lane risking the life of a car owner and people in another car.

A Human driver can decide on instinct, usually protecting themselves. The Computer needs to have an algorithm that decide who will live and who dies.

Re:Self-driving vehicles against human drivers: Equal safety... by glandium on Wednesday December 30, 2020 @09:19PM (#25588870)
Why is it always about running to the sidewalk or the other lane? There's also the option to reduce speed as much as possible, aka break hard, that a computer can do a) earlier than a human would b) much harder than a human would. Yes, the people in the car might take a lot of negative Gs. But that's also an option. The car might still hit the kid, but the difference could be some broken bones, or with chance, bruises, vs. death.
Re:Self-driving vehicles against human drivers: Equal safety... by jjav on Thursday December 31, 2020 @04:22AM (#25591041)
> There's also the option to reduce speed as much as possible, aka break hard, that a computer can do a) earlier than a human would b) much harder than a human would.

a) A computer can initiate braking a small fraction of a second faster than a human, which is great but not such a huge difference in braking distance.

b) A computer cannot brake any harder than a human, certainly not "much harder". The max deceleration rate is traction-limited, which any remotely modern car (last ~25 years) can easily sustain with an untrained driver thanks to modern ABS.

(As a side hobby I instruct in car control and accident avoidance clinics. Blindly braking hard is not often the best answer.)

Re:Self-driving vehicles against human drivers: Equal safety... by glandium on Thursday December 31, 2020 @04:44AM (#25591171)
Most people don't actually hit the brakes as hard as they could or should.
Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Wednesday December 30, 2020 @01:19PM (#25584338)
> The Computer knows that with current speed it is impossible to stop.

Then the car was going too fast. Full stop. The rest of your scenario is irrelevant.

Re:Self-driving vehicles against human drivers: Equal safety... by throwaway0a5e on Wednesday December 30, 2020 @07:15PM (#25587976)
>Then the car was going too fast. Full stop. The rest of your scenario is irrelevant.

How can you possibly say that with a straight face?

There will be situations where a car is going a perfectly fine speed for the situation and then the situation changes in a way the car cannot have seen, known about, or anticipated resulting in a crash. This happens all the time with human drivers. It will happen with AI drivers too.

Furthermore, we don't subject anything else that moves to this burden, why would we do so for cars (AI or otherwise)?

Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Wednesday December 30, 2020 @09:41PM (#25589004)
> There will be situations where a car is going a perfectly fine speed for the situation and then the situation changes in a way the car cannot have seen, known about, or anticipated resulting in a crash.

The parent's situation was not one of those. This was a situation where "Pedestrian (child) abruptly enter into road from behind cover." and there's an old lady on the sidewalk. In other words, there's a situation with limited visibility, limited room to maneuver (since the only other option is to go up on the sidewalk) and pedestrians present (the child may not be known but the old lady was). If you're in that situation and you're going too fast that you can't stop on a dime, you were not going a "perfectly fine speed for the situation".

Re:Self-driving vehicles against human drivers: Equal safety... by Chyzwar on Sunday January 03, 2021 @03:41PM (#25625027)
In European cities you will often see pedestrians walking 1m from cars driving 50-70 km/h. Human drivers can take this risk, AI to be useful needs to handle it well.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @09:52PM (#25589067)
If 95% of human drivers do something, then you can't just call it "irrelevant" because you think it's wrong to do.

And humans don't go past parked cars on a street at 5mph.

Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Thursday December 31, 2020 @12:31AM (#25589894)
20mph is slow enough to essentially ensure collisions aren't fatal.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Thursday December 31, 2020 @01:33AM (#25590154)
But they still get hit. And the first paper in google suggests that 5% are still going to die. That's pretty far from sure.
Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Thursday December 31, 2020 @09:12AM (#25592811)
My reference shows 1% at 30km/h. But even 1% is too high. But luckily you also usually get a chance to scrub off some speed through braking. Braking follows a square law, so driving a little bit slower gains a massive difference in stopping distances.
Re:Self-driving vehicles against human drivers: Equal safety... by closeparen on Wednesday December 30, 2020 @09:22PM (#25588891)
When you already believe that cars should not exist, it’s not much of a stretch to say that cars which do exist should be limited to less than a walking pace anywhere pedestrians might be present.

There’s a thing about the car companies having essentially stolen public space from the everyone else when they made it incumbent on pedestrians to watch out for cars, and a desire to reverse this.

Of course this would pretty much invalidate them as a transportation mechanism, but that’s the point.

Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @09:56PM (#25589095)
I think you could simultaneously have a better improvement for pedestrians and less impact on traffic by turning those parking spaces into sidewalks and greenery.
Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Wednesday December 30, 2020 @09:30PM (#25588944)
> Furthermore, we don't subject anything else that moves to this burden, why would we do so for cars (AI or otherwise)?

Yes we do. There are many jurisdictions where in a pedestrian-car collision, the car is presumed to be at fault unless the driver can prove otherwise.

Re:Self-driving vehicles against human drivers: Equal safety... by a_t48 on Wednesday December 30, 2020 @06:44PM (#25587729)
Have you as a human ever come into this situation?
Re:Self-driving vehicles against human drivers: Equal safety... by mankyd on Wednesday December 30, 2020 @11:42AM (#25583168)
While I don't disagree, I will note that most people don't think twice about giving up control to bus and taxi drivers.*

I think we trust humans to make a reasonable decision in a trolley-problem scenario (rightly or wrongly). Or rather, we trust the human we're in a vehicle with to value their own life, and thus our own, more than those outside of the vehicle in most scenarios.

I expect there is research to investigate this, though I wouldn't know where to begin looking.

*I've definitely had a few bad drivers, of course.

Re:Self-driving vehicles against human drivers: Equal safety... by xiphias2 on Wednesday December 30, 2020 @11:59AM (#25583337)
I always sit in the back of the taxi (just like what Waymo does), and that already significantly decreases my chances of dieing. And with bus it's again easily more than 5x safer than a car.
Re:Self-driving vehicles against human drivers: Equal safety... by nelgaard on Wednesday December 30, 2020 @12:26PM (#25583620)
Busses are generally much safer because they are bigger and heavier. Except in mountains. But I only encounter that on holidays and on holidays we take a lot more risks.

And I do think twice about taxis.

Re:Self-driving vehicles against human drivers: Equal safety... by wnkrshm on Wednesday December 30, 2020 @08:43PM (#25588622)
Bus vs. AV: AV rider dead, lots of injuries in the bus. That's conservation of energy and momentum.

Assuming some utilitaristic equation for minimizing total injury, an AV bus probably won't swerve, and probably won't brake significantly except if colliding with a heavy or fast vehicle.

Re:Self-driving vehicles against human drivers: Equal safety... by sliken on Wednesday December 30, 2020 @11:40AM (#25583142)
Problem is, 95% [1] of drivers think they are better than average.

[1] citation needed.

Re:Self-driving vehicles against human drivers: Equal safety... by senko on Wednesday December 30, 2020 @11:53AM (#25583279)
Happy to oblige: https://www.smithlawco.com/blog/2017/december/do-most-driver...

In summary: in a study done in 1980, 93% of Americans thought themselves better than an average driver.

Re:Self-driving vehicles against human drivers: Equal safety... by tjoff on Wednesday December 30, 2020 @12:02PM (#25583368)
And they are all correct.

Except for when they haven't slept, or aren't paying attention etc.

That is not a good baseline to compare self-driving cars against. That would be horrific.

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Wednesday December 30, 2020 @01:21PM (#25584359)
The average baseline involves a driver that is not paying attention or hasn't slept X% of the time. You cannot magically wave away all the bad days and pretend only the good humans are on the streets. The bad days happen, people die. The autonomous vehicle only has to do better than that. That's the whole point.
Re:Self-driving vehicles against human drivers: Equal safety... by tjoff on Wednesday December 30, 2020 @01:47PM (#25584635)
Statistically no. But you need to convince people - that is the point.

We are not rational. We do not respond well to a car running straight into a barrier or stand-still vehicle at 100 km/h without even attempting to brake (such as the failure modes that Tesla has demonstrated) even if it does well most of the time and has better statistics than an average human.

And further, as noted in the thread, a good part of driving is assessing other vehicles and vehicles behaving oddly (even if it is objectively better in isolation) is really bad and will increase the risk of collisions.

I think google have experienced this, that people do not respond well do the driving technique of their car since it doesn't behave as a human - not that it does anything wrong.

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Wednesday December 30, 2020 @01:51PM (#25584671)
Individuals may not act rationally but regulators and insurance companies with their birds-eye view will see the hard numbers and hopefully provide incentives aligned with the rational choice.
Re:Self-driving vehicles against human drivers: Equal safety... by amanaplanacanal on Thursday December 31, 2020 @10:08AM (#25593312)
Regulators at some point defer to voters. It’s going to matter much more what voters are led to believe than what the numbers say.
Re:Self-driving vehicles against human drivers: Equal safety... by tjoff on Wednesday December 30, 2020 @01:55PM (#25584714)
I hope not. I expect them to produce cars that are much better than the average human before setting them free on the road.

That is the rational choice given the human psyche.

We can barely even convince people that vaccines are good.

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Wednesday December 30, 2020 @01:57PM (#25584739)
Just as with vaccines waiting for better cars means letting more people die in the meantime. That is a grim hope.
Re:Self-driving vehicles against human drivers: Equal safety... by tjoff on Wednesday December 30, 2020 @02:29PM (#25585058)
If companies rush this (as Tesla and Uber already has!) too much the backlash will likely set back self-driving unnecessarily.

I believe a more careful approach will get broader adoption and likely save more lives.

Re:Self-driving vehicles against human drivers: Equal safety... by the8472 on Wednesday December 30, 2020 @02:53PM (#25585302)
I didn't suggest that the technology should be rushed and I agree that a careful approach can save more lives. But what constitutes "careful" matters here. For example if a city chooses to offer robotaxi discounts to people with bad driving records (before some cutoff date to avoid perverse incentives) then even an average taxi fleet could be a net-benefit even though the taxis do not perform better than the general population. And that's just in terms of lives saved, not counting the other benefits of having cheap transportation.
Re:Self-driving vehicles against human drivers: Equal safety... by nelgaard on Wednesday December 30, 2020 @12:09PM (#25583451)
Which says:

== Obviously, not everyone can be above average. Exactly half of all drivers have to be in the bottom half when it comes to driving skills and safety. ==

Maybe, but the bottom half is not necessary drivers worse than average.

I do not know how you would calculate "average". But there are people on the road that could pull down the average a lot. So that more than 50 percent are better than average.

Re:Self-driving vehicles against human drivers: Equal safety... by adwn on Wednesday December 30, 2020 @12:47PM (#25583880)
In colloquial speech, most people don't differentiate between "mean" and "median". My guess is that, in that kind of survey, the participants read or say "average" and implicitly mean "median" – and exactly 50 percent of drivers are better than the median, by definition.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:02PM (#25589128)
The problem with not differentiating clearly between mean and median, is that you look out at other drivers and calculate a mean, then you assume that the median is the same. With a sufficiently skewed distribution this will hugely inflate your numbers, even if you have a realistic perspective of your actual skill.
Re:Self-driving vehicles against human drivers: Equal safety... by Ajedi32 on Wednesday December 30, 2020 @12:04PM (#25583387)
Which could be true, assuming the median skill level of drivers is sufficiently higher than the average.
Re:Self-driving vehicles against human drivers: Equal safety... by gifnamething on Wednesday December 30, 2020 @12:22PM (#25583584)
Mean is an average, not the average. Mode is an average. Median is an average.
Re:Self-driving vehicles against human drivers: Equal safety... by Dylan16807 on Wednesday December 30, 2020 @10:03PM (#25589134)
> Mode is an average.

They sure do claim that to elementary school children. But using mode sounds absolutely insane to me. Does any field actually do that?

Maybe you could carefully bucket/smooth your data and then use the peak, but that's a far cry from taking raw numbers and looking at the most common.

Re:Self-driving vehicles against human drivers: Equal safety... by matt-attack on Wednesday December 30, 2020 @11:42AM (#25583161)
I feel the opposite. The one sensor that is guaranteed to have sufficient information to drive in all conditions is vision. That's obviously because humans drive exclusively with vision (and a single vantage point to boot - modulo mirrors).
Re:Self-driving vehicles against human drivers: Equal safety... by ghaff on Wednesday December 30, 2020 @12:17PM (#25583528)
>The one sensor that is guaranteed to have sufficient information to drive in all conditions is vision.

Minor nit but humans can't drive--certainly not safely--in all conditions. You can certainly get to a point in fog, blizzards, and even very heavy rain where you really would like to get off the road if possible. (Not always possible of course and in snow particularly, pulling off to the side of a highway isn't a great option.)

Re:Self-driving vehicles against human drivers: Equal safety... by wool_gather on Wednesday December 30, 2020 @12:48PM (#25583895)
Not a nit at all; the parent comment has the cart completely in front of the horse. Humans use vision (primarily) to drive because it's the only sense we have that's even close to being sufficient.

There are certainly other senses (lidar, ultrasound, radio signals) that robots could avail themselves of that would be helpful even in conditions where vision also worked.

Re:Self-driving vehicles against human drivers: Equal safety... by jschwartzi on Wednesday December 30, 2020 @11:57AM (#25583319)
Kind of. The difference between human vision and computer vision is that human vision is stereoscopic. We perceive depth in addition to color and shape. And that gives us the ability to perceive the 3-dimensional shape of an object, which lets us anticipate how it might move. A lot of CV algorithms operate on single images from a single camera, which makes it impossible to judge depth. In that case you'd have to use the size of an object as a proxy for its distance and speed, so you'd tend to misjudge how far things are from you and where they're going.

The nice thing about LIDAR is that you can gather that depth/shape information and with sufficient calibration map the shapes in the camera image to the depths in the LIDAR image. You can do the same thing with two cameras so I'm not sure why LIDAR would be preferred here.

Re:Self-driving vehicles against human drivers: Equal safety... by tjoff on Wednesday December 30, 2020 @12:09PM (#25583440)
We don't need two eyes to drive. And we don't need two eyes to gauge depth. Neither does a machine, but adding stereoscopic cameras is not hard.

The stereoscopic effect is very poor on driving distances, doesn't help us that much. Primarily we use clues form the environment to gauge distances. We also have to focus our eyes to the correct distance - that also tells us how far an object is.

Primarily we have had an insane amount of training to understand our world. An understanding that a self-driving car will never achieve unless singularity happens. It might not need that, but it will need other ways to compensate for it.

Re:Self-driving vehicles against human drivers: Equal safety... by sliken on Wednesday December 30, 2020 @01:28PM (#25584420)
Tesla as an example has 3 forward looking cameras, additionally a single moving camera can sense depth since differences between frames relates to the distance from the camera.

LIDAR has its advantages, like precise 3D positions under ideal conditions. However there are downsides as well. Cost is a big one, but that's becoming less of a issue over time. Another is sensitivity to rain, fog, blowing sand, etc.

A complicating factor is human driven cars will assume cars to act like they have human limitations. So higher speeds when humans can see well, and low speeds when humans can't.

Not sure Tesla's current sensors will do it, but seems like camera based systems are likely to be quite competitive with LIDAR. Maybe instead of 3 forward cameras, 6 or 8 so there's overlapping views (for stereoscopic vision), handling failures better, and allowing a narrower field of view at a higher zoom.

More range will be a huge help, that way an autonomous car can slow more gently when uncertain and drive more like a human. After all superhuman reflexes aren't much use if you get rear ended all the time.

Re:Self-driving vehicles against human drivers: Equal safety... by vagrantJin on Wednesday December 30, 2020 @02:20PM (#25584982)
> You can do the same thing with two cameras so I'm not sure why LIDAR would be preferred here.

I almost spilled my beer about to comment that a camera or two are equally if not more powerful than lidar. To me personally, Lidar feels like an incomplete solution to 3D mapping when high res images from a smartphone camera can provide so many more data points from different angles.

My thinking was vehicles should have an idea where other vehicles are without the need for comp viz. Like beacons saying "hey Im here." And we can try to calculate relative direction and distance. The vision bit should ideally come in to validate and confirm other things like road signs etc. Ideally we should add that data to mapping software andnthe car should know these things without "seeing it".

Re:Self-driving vehicles against human drivers: Equal safety... by yarcob on Wednesday December 30, 2020 @01:07PM (#25584165)
You can get 3D data from a single moving camera. The technique is called structure from motion and has been demonstrated to work well more than a decade ago.

The biggest problem with relying on visual data is that you get very noisy data. Poor lighting and reflective or glossy surfaces cause problems (I'm not sure what current state of the art is, it's been a few years since I looked at the research).

As far as I understand the big advantage of LIDAR is that you get nice and clean depth data and it's not so computationally expensive.

Re:Self-driving vehicles against human drivers: Equal safety... by beat on Wednesday December 30, 2020 @12:51PM (#25583941)
That's why one place I really want a driving assist is automatically backing out of spaces in parking lots. Visibility is terrible for the driver. You need to be paying close attention in multiple directions at once, you often don't have visibility at all when you need to start moving (like a larger vehicle parked next to you), and both pedestrians and other vehicles can appear out of nowhere, often moving in unexpected directions. It feels very unsafe.

Computer vision could be making those go-stop decisions for you, much more effectively than human drivers.

Heck, imagine a "smart" parking lot that tracks its available spaces and communicates with your car. You enter the parking lot and hand over control, and the car and lot work together to park you safely in the best available space.

Re:Self-driving vehicles against human drivers: Equal safety... by curryst on Wednesday December 30, 2020 @07:22PM (#25588039)
Some cars already have those. I've got a car from 2017 that has some kind of sensors wrapping all the way around the bumper. When I'm parked between two cars, it can detect a car roughly 15-20 feet away as soon as I get an inch or two of my bumper clear of the other cars.

It does lack any spatial indicators to the driver, though. It just plays a beep, but it doesn't seem to play the beep from the side of the car the danger is in, nor does it beep louder when they're closer. Still, it works remarkably well. Reliably detects pedestrians and vehicles (even while I'm moving, which is impressive, because it doesn't go off for parked cars when I start moving).

I think it's the Dodge ParkSense, but I bought the car used so there's a possibility it's something aftermarket.

It's saved my ass a number of times. I'm in jacked-up pickup truck country, so it is often impossible for me to see pedestrians about to walk behind me because of the lifted truck, and likewise the pedestrians can't see me until they're behind me.

Re:Self-driving vehicles against human drivers: Equal safety... by robocat on Wednesday December 30, 2020 @07:15PM (#25587977)
Wherever practical, I back into car parking spaces. That avoids many many scenarios, while marginally adding a few new issues.
Re:Self-driving vehicles against human drivers: Equal safety... by sokoloff on Wednesday December 30, 2020 @09:08PM (#25588789)
This practice is recommended by several safety programs. https://safestart.com/news/4-reasons-backing-parking-spaces-...
Re:Self-driving vehicles against human drivers: Equal safety... by bombcar on Wednesday December 30, 2020 @07:31PM (#25588101)
A similar calculus was what lead me to get a private pilot’s license instead of a motorbike - general aviation fatalities are something like 90% pilot error but 60% of motorbike fatalities are NOT the fault of the rider.
Re:Self-driving vehicles against human drivers: Equal safety... by toper-centage on Wednesday December 30, 2020 @05:23PM (#25586915)
Good point. But it doesn't matter how carefully you drive if the road is full of idiots and intoxicated drivers.
Re:Self-driving vehicles against human drivers: Equal safety... by thesuitonym on Wednesday December 30, 2020 @02:00PM (#25584766)
As cautious as you are, you still get distracted, focus on the wrong thing sometimes, and have blind spots. Computers don't.
Re:Self-driving vehicles against human drivers: Equal safety... by lemonspat on Wednesday December 30, 2020 @03:52PM (#25585964)
Computers might not get distracted, but have many other problems. And I assure you a computer can still focus on the wrong thing and have blind spots.

https://spectrum.ieee.org/cars-that-think/transportation/sen...

Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:31AM (#25592052)
And I would choose a fly over today’s state of the art computer vision systems because they are still better than the latter.
Re:Self-driving vehicles against human drivers: Equal safety... by jonplackett on Wednesday December 30, 2020 @09:01PM (#25588740)
To add to the ‘different set of accidents’ point - the accidents caused by autonomous cars will most likely also be harder to accept. They will be accidents that a human driver (at least with the benefit of hindsight) would appear unlikely to have caused.

Things like that Tesla driving straight into a wall and killing its driver. Or not seeing a van right in front of it because the sun was too bright. Things where a bit of common sense (not something AI excels at) might have avoided them.

On the flip side the lives saved will be based on having super human reaction times / situational awareness and will be things no person would have been able to do.

So maybe there’ll be a battle of public opinion (and PR!) weighing these things against each other.

Re:Self-driving vehicles against human drivers: Equal safety... by Retric on Wednesday December 30, 2020 @09:21PM (#25588886)
I think you’re going to find human caused deaths to be just as bizarre if you ever look into them. You might think people are generally ok drivers but when you’re looking at each fatality as the worst mistake per 1.5+ Million hours driven people are doing some truly dumb things.

On that time scale you can expect people to have fallen asleep at the wheel several times. They spent literally months looking at their phones rather than paying attention to the road etc. Because here’s the thing most accidents aren’t fatal, for every death you’re going to see a host of accidents that should have been avoided and tens if not hundreds of thousands of mistakes that could have resulted in a serious accident but didn’t.

Re:Self-driving vehicles against human drivers: Equal safety... by LeftHandPath on Wednesday December 30, 2020 @10:49PM (#25589395)
This is why it's important that the set of drivers killed in AI accidents will be different. The ones killed in accidents up to this point are the ones being reckless (and sometimes, the people they inevitably hit).

The ones killed in accidents involving self driving cars will include people who drove responsibly or even defensively in the past. They will also be among higher income earners for the first few years, while self-driving capabilities are still too expensive to be included in the average car.

Moreover, people like to think they're in the set that wouldn't get themselves killed by their own driving, regardless of how poorly they drive.

Re:Self-driving vehicles against human drivers: Equal safety... by DangitBobby on Thursday December 31, 2020 @12:06AM (#25589786)
People get killed by others' driving mistakes all the time.
Re:Self-driving vehicles against human drivers: Equal safety... by JeffL on Wednesday December 30, 2020 @10:44PM (#25589362)
I was driving on 280 once in clear weather and light traffic, and the car ahead of me suddenly swerved left, swerved right and went tumbling across all lanes and ended up upside down on the shoulder. It was a really bizarre thing to witness. And both people inside seemed mostly OK.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:05AM (#25591915)
But then we assume that autonomous cars will replace these bad drivers - which is a pretty unsubstantiated claim, and the same percentage of drivers still be this bad when autonomous cars are more popular - and we don’t have enough data to conclude that autonomous cars are better at dealing with these bad drivers than competent humans (and I assume this is not true as of yet)
Re:Self-driving vehicles against human drivers: Equal safety... by semi-extrinsic on Wednesday December 30, 2020 @09:20PM (#25588878)
No, if there are lives saved by self-driving cars, they will primarily be in instances where the driver was distracted/drunk/high. Thus any competent lawyer workin a case against a self-driving car company in the case where their car killed someone, will argue (rightly!) that those sane lives could also have been saved by less high-tech measures, such as AI detecting undesired human behaviour and putting the car in limp-home-mode or similar.

In that case you are saving the same lives and not causing any new fatalities, but it's not a super cool tech that will attract lots of investment. So the choice to implement self driving was ultimately putting profits over human lives.

Re:Self-driving vehicles against human drivers: Equal safety... by goshx on Wednesday December 30, 2020 @10:24PM (#25589253)
What you are looking for is a horse.
Re:Self-driving vehicles against human drivers: Equal safety... by troupe on Wednesday December 30, 2020 @10:48PM (#25589383)
I've never had my car intentionally try to kill me, but a horse has. :)
Re:Self-driving vehicles against human drivers: Equal safety... by shkkmo on Wednesday December 30, 2020 @09:29PM (#25588937)
I think detecting impaired and distracted drivers is a lot harder than you think and more high tech since you need that detection in addition to the ability to limp home.
Re:Self-driving vehicles against human drivers: Equal safety... by fiddlerwoaroof on Wednesday December 30, 2020 @09:39PM (#25588994)
There are very trivial situations where even current Teslas are safer than previous cars: while I wouldn’t trust my life to Autopilot, I’d rather drive next to a drunk driver using autopilot than one driving “manually”. Other simple things, like detecting excessive swerving and drifting out of the land, would be relatively straightforward signals to the car to maybe limit speed and encourage pulling over.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:08AM (#25591930)
Detection is pretty much where AIs excel so I doubt it would be a hard problem. And it could also just disable driving the car and that’s it, saving the same amount of people.
Re:Self-driving vehicles against human drivers: Equal safety... by Robotbeat on Thursday December 31, 2020 @12:12AM (#25589815)
There's actually a potential safety advantage from the public's irrational reaction to autonomous driving deaths (irrational if compared to their response to human driving driving deaths):

Autonomous driving deaths will be much more scrutinized. In the press, by regulators, by competitors, by the companies involved. There's likely to be a lot more data involved. The scrutiny may ironically increase as it becomes safer, maybe becoming a lot like plane crashes, in fact, where each one is scrutinized by groups of experts and fixes are put in place to prevent that kind of thing from happening.

The safer it is, the rarer and more novel the fatalities are and therefore the more resources will be spent on fixing the safety issues.

That is, if autonomous driving is allowed. If it's not allowed because overall irrational fear of autonomous driving, then that feedback cycle can't happen.

So the paranoia isn't necessarily a bad thing as long as it doesn't cause paralysis.

Re:Self-driving vehicles against human drivers: Equal safety... by troupe on Wednesday December 30, 2020 @10:46PM (#25589373)
It isn't just a perception issue. It is going to depend on how we assign blame. Today if a human causes an accident that kills someone, the family can sue the human and get some from their insurance company, but most insurance policies have a relatively low limit on what they will pay. As far as the individual goes, the median net worth of someone in the US is less than $100,000. You can sue, but there really isn't that much money to get.

However, with self-driving vehicles, if you sue the manufacture of the vehicle, they have significantly deeper pockets. This is going to effectively keep us stuck in the place where no matter how good self driving cars become, the responsibility remains with the driver.

Re:Self-driving vehicles against human drivers: Equal safety... by wffurr on Wednesday December 30, 2020 @11:26AM (#25583004)
>> The challenge remains that people will be killed in accidents involving autonomous control.

While that's almost certainly true (and depending on one's interpretation of autonomous is already true), some people already believe that zero deaths in transport is possible: https://visionzeronetwork.org/about/what-is-vision-zero/. If it's possible to hold human drivers to that standard, why not autonomous systems as well?

Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Wednesday December 30, 2020 @11:58AM (#25583324)
That was my original hope for self-driving cars. The easiest way to ensure that you don't kill anybody is to limit your speed to 20mph. At and below that speed a car-pedestrian collision is highly unlikely to result in a dead pedestrian. Also, at 20mph you can stop on a dime. So I imagined a large fleet of robot cars traveling at 20mph and normalizing that speed, forcing human drivers to slow down too.

But it turns out that self-driving vendors spend a lot of effort on "driving like a human", which includes driving faster than the speed limit and faster than vision zero would allow on shared streets & roads.

Re:Self-driving vehicles against human drivers: Equal safety... by ghaff on Wednesday December 30, 2020 @12:19PM (#25583553)
Which could be done today. The vast majority of people obviously don't consider that acceptable in general.
Re:Self-driving vehicles against human drivers: Equal safety... by riversflow on Wednesday December 30, 2020 @12:49PM (#25583915)
Well that’s a silly vision. I have a vision of immortality too. This is a textbook example perfect being the enemy of good. I don’t want to hold any system to the standard of zero fatalities, and further I think this is why “shoot for the moon and even if you miss you’ll land amongst the stars” is faulty. People waste an exorbitant amount of time and fossil fuels commuting in passenger vehicles. Anything that significantly changes that balance should be considered. Progress is progress and letting everybody use the time they used to spend commuting is certainly progress.
Re:Self-driving vehicles against human drivers: Equal safety... by bryanlarsen on Wednesday December 30, 2020 @01:18PM (#25584319)
You're mocking as silly a vision that some places have already achieved.

https://www.theguardian.com/world/2020/mar/16/how-helsinki-a...

Re:Self-driving vehicles against human drivers: Equal safety... by LoSboccacc on Wednesday December 30, 2020 @06:58PM (#25587852)
Putting low income brackets into mass transit isn't a great vision to have.

No wonder Norway had an uptick of suicides and drug related deaths in 2018

Re:Self-driving vehicles against human drivers: Equal safety... by wffurr on Wednesday December 30, 2020 @07:19PM (#25588004)
Clean, fast, efficient, reliable mass transit for everyone is such a totalitarian nightmare. It's just awful.
Re:Self-driving vehicles against human drivers: Equal safety... by LoSboccacc on Thursday December 31, 2020 @03:16AM (#25590680)
It is, you only haven't realized it yet.

there's zero chance mass transit can accommodate people's needs, even if you somehow solve the shopping issue with local markets and fixed item prices, the job<>house graph will always look like a fractal set of overlapping stars.

cars is one of the most important social equalizer of this and last century. it allows people from basically all social status to move themselves, their family and their belongings at any time in full autonomy, enabling them to find houses and jobs in the most economical and convenient places.

private cars win over public transit because it's a better product. the only way for public transit to compete is to mandate laws to make cars comparatively a worse product, which is fundamentally anticompetitive - once public transit become monopolistic, once the company owns a tract, they can abuse their position deciding pricing and timetables.

even in traffic, private cars offer a better experience: people are in their own space, under a roof from start to finish, with their preferred temperature and away from both obnoxious or influenced people.

forcing mass transit trough legislation will surely have some short term benefits, but also:

- more class divide between the richs, that will always be able to afford a car, and the poors who won't

- massive gentrification of well connected areas, while the poors get pushed out to where service is of less quality

- dependency of the poors to expensive third party services on any occasion they need to move themselves or their goods across a non serviced destination. rentals is not an option: rentals need a credit card, and guess who don't own one?

- dependency on public transit times. have an unusual work shift or need to visit parents? get prepared to wait in the open under the cold or rain. need to get your child out of school in a down hour because he's suddenly ill? too bad, transit only gives peak service at peak hours.

of course there's situation where mass transit gets convenient, like large cities where a significant percentage of the population shares the same source/destination points, at which point people will use it naturally on their own.

opposing private transit is going to destroy an important achievement of modern society, the car has been a great economical equalizer and still is. market, after all, need customer flexibility not to be captured. Safety is something to be solved with more safe cars and better technology all around.

it'd be like discovering tomorrow that soap pollutes: some will want to force everyone to smell, some will create a better soap.

Re:Self-driving vehicles against human drivers: Equal safety... by wffurr on Thursday December 31, 2020 @07:32AM (#25592062)
You glossed over the most important bit:

“of course there's situation where mass transit gets convenient, like large cities”

That’s where most people alive, and in the not too distant future, the vast majority.

You’re also leaving out all the downsides of cars: mass casualties, sedentary lifestyles, air and water pollution, reshaping urban forms to non-human scales.

When you live somewhere that hasn’t been exclusively designed for the car, you might realize that it’s perfectly possible to live a happy, healthy life without ever using one, or doing so only rarely through various rental schemes.

It’s also rich that you bring up poor people. Requiring car ownership, like much of the built infrastructure in the United States does, is a huge burden on the finances of the poor and working class.

You’re also forgetting that there’s options other than “jam everyone on a central star topology bus” for transportation: walking, bicycling, and various e-devices. All of which are much, much cheaper than cars and yet provide many of the benefits you tout.

Cars have their place and have been extremely useful for many, but our society has gone too far.

Re:Self-driving vehicles against human drivers: Equal safety... by LoSboccacc on Thursday December 31, 2020 @08:35AM (#25592508)
All of this completely ignores reality

You have a pretty well studied use case, London

All the poors were kicked out the inner city and commute for hours a day now

And just wait till they realise you can influence voting patterns by making it inconvenient to reach the polling places just by tweaking timetables, it'll make gerrymandering pale in comparison

Re:Self-driving vehicles against human drivers: Equal safety... by wffurr on Thursday December 31, 2020 @11:48AM (#25594289)
You must live in a parallel reality to mine. Sad.

It’s incredibly depressing that in the context of a discussion of transport safety, you seem to think we’re doomed to 30,000 dead a year from crashes alone, to say nothing of shortened poorer quality lives from obesity and lung disease, just because you claim the personal car is intrinsically superior to other modes of transport.

That’s a really dystopian vision of the future and thankfully disconnected from the reality in a lot of major cities which are taking steps to reclaim transportation systems from domination by the personal automobile.

Re:Self-driving vehicles against human drivers: Equal safety... by LoSboccacc on Thursday December 31, 2020 @12:43PM (#25594919)
> you seem to think we’re doomed to 30,000 dead a year from crashes alone

I even said:

> Safety is something to be solved with more safe cars and better technology all around.

but apparently you're filtering what you want to hear, so there's no discussion to be had here, especially since all the point so far are appeals to feeling without addressing the point made. I'm sorry that logic has failed you.

Re:Self-driving vehicles against human drivers: Equal safety... by riversflow on Thursday December 31, 2020 @06:45PM (#25598677)
>that’s where most people alive, and in the not too distant future, the vast majority.

Ironically enough, Covid is showing just how much people would rather not choose that destiny. In the US, inner city real estate has taken a hit while car-only rural/Exurbs property has seen a dramatic uptick. I take this to mean that, A. many people would like get away from the filth/homelessness/noise city, and B. many people would like to have space for creative activities that our litigious and ownership driven society deems only appropriate for private ownership. Space that makes urban landscapes take on “non-human scales” is just part of that equation. No way for everyone that wants one to have space for a nice garden, a gym or a painting studio or whatever in the confines of a city, ergo suburbs. As automation frees our time people are going to desire more space for creative activities not less. Having grown up in a more rural setting, you learn how to use the space afforded to you. Things like having a band, making/fixing things, keeping animals, growing plants, experimenting or really any physical project or collection, all require a considerable amount of space.

Which brings me to my next point, people choose to live in the city because it is convenient in our society, not by some law of attraction. Short of climate change laying waste to the environment, I expect people to actually move away from dense urban living long-term as automation becomes more dominant. Personally, I enjoy living in the city because it is convenient and I don’t partake in a lot of the activities that drive people toward wanting space, and honestly like the people I find there better, but find every city I’ve ever been to be extremely loud, absolutely filthy, and ugly as hell–architecture is only beautiful in contrast with how ugly the urban setting is. Amazon delivery alone has made rural life much more attractive.

And besides all this, there’s still the problem that the vast majority of the New World just isn’t as settled as the Old. While Europe was adapting cities to the modern era of transportation, we were bootstrapping a country into existence. You say, “our society has gone too far”, but out here in California, by modern society’s standards, we would need several lifetimes of radical change in order to come anywhere near such a goal through traditional means(e.g. public transit, dense urban housing). You are accurate in your appraisal that our cities are often designed around the car, but you can’t just wave a magic wand and fix the massive structural housing problems and lack of mass transit infrastructure. And this isn’t the 1970’s, infrastructure construction takes FOREVER and is ludicrously expensive, especially major infrastructure that will see lots of public use. Don’t forget about our stringent wildlife/environmental/worker protections, and accessibility/fire codes to further complicate, slow and add expense(not to say that these are universally bad). Moreover the state has spent the better part of the last 100 years actively fighting urbanization. Currently the average commute in California is 30 mins/20 miles each way[1], apparently twice that of Europe[2]. California also has 40 million people most of whom commute by car and an entrenched political establishment. To illustrate these points: San Francisco is working on adding an extension to its metro, a 1.7 mile addition with 4 stations, albeit a deep cut going through downtown, will take a decade to construct and will cost $1.5B, it’s expected to service 35k people per day(which, having lived along the proposed line for 2 years recently, seems awful high). Meanwhile all of the state’s urban centers and especially SF are compromised of legions of office buildings with only a smattering of apartment buildings. Instead of building up in the Bay Area, we paved over Antioch, some of the best farmland in the world, with ideal conditions for the difficult to grow Almond crop, to put in suburbs some 45 miles away from the City, and only decades later finally got around to running a single rail line out there. Meanwhile, we created a giant waterway to move some of the fresh water that flowed through that area 250 miles south to the desert so that we can grow almonds there instead. We did that right away, and the state is now planning on building a new pipeline and pumping station because the original waterway was allegedly causing environmental problems. I take the skeptical tone because they’ve never actually said that they plan to stop using the old waterway, only that it has problems that the new one won’t have. My point here being that a supposedly progressive state like California is ideologically incredibly far away from even considering moving away from the car. Meanwhile, another real human tragedy that we may be able to fix relatively quickly—that is 10’s of millions of people wasting ~250 hours a year driving a car to work, most likely in traffic. I see it as a great Good if we can automate driving to free up all that time, and setting the conversation up around a goal of 0 fatalities is incredibly callous of that cost of human life.

I’ve both been poor in the US and known and talked to many many poor people here. Car ownership is absolutely empowering, because while you see it as an unnecessary expense, most see it as a valuable tool. And a car is cheap if you consider it housing. It’s really difficult to compare being impoverished in the US vs Europe because of how little social safety net we give people here. All else being equal though, I’d rather be poor and be “burdened” by car ownership than live in a society that bars me from affording one as a poor person. In the former situation Im at least able to freely move to a more suitable location. A few key things a car provides: A car is a mobile comfort zone. Sick of your partner’s family(or your own?) or not feeling the office for lunch? sitting out in your car is way more peaceful than sitting on the curb. A car is also a mobile lock-box. Going grocery shopping? Pretty handy to be able to go to multiple stores on the same trip, not everyone likes making a trip to the store on the way home for a couple of things everyday. It’s also useful if you are poor to not be beholden to local prices, traveling a bit offers you the ability to shop around for deals. It’s also handy to have things with you(food and drink, cosmetics, clothes, tools)as in general when you are poor you can’t afford to make convenient purchases and generally need to be more prepared to strike at opportunity. Car ownership offers all kinds capabilities for odd jobs as well, now formalized with the gig-economy. Also, having had both a car and a bike in downtown SF, e-devices are not an alternative to cars, they are an alternative to a bike. I could mostly replace owning a bike with the rentals, not having to think about theft is nice. But a car operates in any conditions and lets me do a proper (Costco)grocery run, buy large things, buy things not available locally (Craigslist), deal with bed bugs(seriously saved our ass having a car there), go to nature, travel with a pet, and visit and transport friends and family.

Anyway thanks for the link about vision zero. I just fundamentally disagree with their core principle, ‘life and health can never be exchanged for other benefits within the society.’ —that’s literally what society is about, we exchange our life in the form of work for other benefits in the form of money. While I think this is a fine ideal, and I do believe that we should strive to raise the value of life above a dollar value, I certainly do on a personal level, I also think that we still live in a world of harsh limitations and that we should be conscious of the effect we have of those who we take from when we try to protect others. I found the traffic calming in London unthinkable and terrible, purposefully making the lives of every motorist miserable to decrease the risk of accidents seems like a Faustian bargain to me. You trade a shared social risk of injury for the guarantee of making a bunch of peoples lives harder, because if you make it sufficiently hard enough hopefully less people die. Even knowing my way around SF, driving around downtown with its traffic calming is a nightmare and easily one of the most high stress, anger inducing things I did when I lived there. Reading through visionzero’s policy agenda and action plan for SF feels so out of touch with the realities of driving in it. I did learn why the lights are such a mess in downtown though, unlike in most areas where they time the lights for motorists to go a certain speed, in SF they time them for pedestrians. This makes me extremely skeptical of the whole program, lights that aren’t timed for a speed limit drastically increase motorist propensity to speed in order to beat the next light. Taking a harder look at visionzero, I don’t see anything that informs their policy initiatives, and they actively state that “How data is used to communicate and evaluate progress toward goals should reflect the values of the overall strategy.” So I really don’t see why they are worth listening too, they don’t ever provide any sort of cross analysis either. No mention of how construction effects traffic in their 2019 SF report that I could see, ludicrous. No mentioning road rage or driver sentiment ever. Some moral crusade, lol. It seems more like it’s really some rich persons sick vision of zero cars, and the plan is to legislate torture into the driving experience to do it. Freedom of movement isn’t something poors should have.

[1] https://www.answerfinancial.com/insurance-center/which-state...

[2] https://www.sdworx.com/en/press/2018/2018-09-20-more-than-20...

Re:Self-driving vehicles against human drivers: Equal safety... by wffurr on Wednesday December 30, 2020 @03:18PM (#25585578)
If you read about Vision Zero and its methodology, you can see that it indeed celebrates incremental progress and indeed encourages simplest improvements first.

Before you dismiss something as silly, perhaps you could try understanding it some first.

Re:Self-driving vehicles against human drivers: Equal safety... by ehnto on Wednesday December 30, 2020 @10:31PM (#25589299)
> However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents.

That's an interesting insight into part of the problem, thanks for pointing it out.

Indeed in America if you ride a motorcycle but don't ride drunk, don't ride unlicensed, don't ride an unregistered bike, and do wear a helmet, you are orders of magnitude less likely to die because you are in a statistcally safer demographic of riders. Yet, any one of the riders in that safer demographic could still be one of the ones hit by a red light runner and killed without their blame. We would definitely feel that death more tragic and senseless.

Re:Self-driving vehicles against human drivers: Equal safety... by SoSoRoCoCo on Wednesday December 30, 2020 @12:18PM (#25583539)
> I expect that in the end it will come down to a business decision, and that decision will be informed by an actuarial exercise: Will profits and insurance be able to cover the costs of defending and settling such cases.

I'm seeing type of phrasing occur more and more. Once the defendant can be named in a legal action, we'll start seeing SDVs. IMHO, the worry isn't that they will kill, but that no one is to blame.

Although it will change the day to day narrative of a pedestrian. E.g., My thought process will change from this person might not see me, to, that car's AI might not see me. ... or even "Oh, its a Toyota, they kill more than Hyundai... stand back!" But now I'm just writing SciFi.

Re:Self-driving vehicles against human drivers: Equal safety... by dvfjsdhgfv on Wednesday December 30, 2020 @12:32PM (#25583690)
> But now I'm just writing SciFi.

I don't think so. Normally whenever I want to cross the street (as a pedestrian, but even more as a cyclist) and a car approaches I (unconsciously) examine its speed, and if it's higher than acceptable I try to make eye contact with the driver to make sure they see me and it's safe for me to go. How do I make contact with the AI of the car? More importantly, how do I get the cue I've been noticed?

Re:Self-driving vehicles against human drivers: Equal safety... by SoSoRoCoCo on Wednesday December 30, 2020 @03:06PM (#25585447)
> I try to make eye contact

That's a really good point. I forget how often when I'm walking, running, or biking I will try to make eye contact with a car to make sure we're aware of each other.

Now how do I do that with an AI?

More things we need to start thinking about!

Re:Self-driving vehicles against human drivers: Equal safety... by tintor on Wednesday December 30, 2020 @09:13PM (#25588829)
That can be solved. Standardized "I see you and I am yielding" signal on front of all self-driving cars.
Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:37AM (#25592087)
There is a person in front of me, and the signal is on. Does it see me or only that other person?
Re:Self-driving vehicles against human drivers: Equal safety... by foobarian on Wednesday December 30, 2020 @11:48AM (#25583226)
> However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents.

This is a really good point. I drive really conservatively and like to think I will never ever cause an accident let alone a fatal one. I think if this lever was taken away I would have a hard time accepting the automated driving a significant amount of time.

Re:Self-driving vehicles against human drivers: Equal safety... by throwaway2245 on Wednesday December 30, 2020 @12:13PM (#25583491)
> There will be cases where a court determines that the autonomous system was the cause.

At the moment, manufacturers almost totally escape blame for fatal accidents [involving human drivers] - it's understood societally and in the legal system that the human driver was the one at fault.

That isn't a totally accurate picture of the responsibility. The manufacturer provided a vehicle that included a risk of fatal accident. (Reducing this wrong and describing it as 'lives saved' feels uncomfortable to me)

With an autonomous system, blame for fatalities can no longer be placed on a human driver: and yet, there is still a failure of responsibility (maybe this will be a more accurate placement of blame)

Re:Self-driving vehicles against human drivers: Equal safety... by CuriousPerson23 on Wednesday December 30, 2020 @12:57PM (#25584038)
Hasn't there been only 1 fatal accident? If not, I can't imagine there have been >5, so seems unfair and misleading to make bold claims like that. I think the courts will rule, and if the system misunderstood something, the manufacturer will be at fault.
Re:Self-driving vehicles against human drivers: Equal safety... by tgv on Wednesday December 30, 2020 @11:33AM (#25583076)
Idk about risk: that is hard to establish. There are so many conditions in which an automatic pilot hasn't been tested. We don't even know the factors involved in estimating the risk: e.g., is it dependent on the human co-pilot? And self-driving cars may change the car usage patterns, exerting a contextual influence on the risk.

Then there's the question of responsibility. Who will be held responsible when the automatic pilot is driving? If it's the human, then a high risk of causing an accident will be unacceptable to many drivers.

Re:Self-driving vehicles against human drivers: Equal safety... by BurningFrog on Wednesday December 30, 2020 @06:30PM (#25587601)
Obviously the car manufacturer will be liable when a fault in their product kills people.

And that is as it should be. The costs will be baked into the price of the vehicle. This aligns incentives. The manufacturer wants to pay as little as possible, and the owner will want to be safe.

With the car recording video and other data, determining what actually happened should be simple and reliable.

Note that the car owner no longer pays any insurance in this system.

Re:Self-driving vehicles against human drivers: Equal safety... by foobar1962 on Wednesday December 30, 2020 @06:39PM (#25587675)
Smart manufacturers will cover this risk with third-party insurers, for some period of time: probably the vehicle warranty period. After that, it will be on the owner to renew.

If I was one of these insurers, I'd be insisting the vehicles were maintained to an extremely high level of roadworthiness by mechanics that licensed or certified. Home DIY would be forbidden, as would any modification to the hardware or software. Think something like happens now for aircraft.

Re:Self-driving vehicles against human drivers: Equal safety... by sokoloff on Wednesday December 30, 2020 @09:19PM (#25588872)
I do all of my automobile maintenance (except for replacing tires) and I do a fair amount of the routine, preventative maintenance on my airplane (which is permitted for part 91 operated aircraft).

I doubt that lack of roadworthiness on DIY-maintained automobiles is a significant contributor to fatal and serious collisions. I also think most DIY-maintained cars are just as well-maintained as their same-year counterparts that only see dealerships (sometimes more as the DIY is likely to be an enthusiast and unlikely to be deterred by cost pressures relating to the $130/hr service rate).

Re:Self-driving vehicles against human drivers: Equal safety... by ghaff on Wednesday December 30, 2020 @06:56PM (#25587834)
It's reasonable to expect that the first generation or so of fully autonomous vehicles will be rented out and must adhere to a manufacturer-mandated update and service program or they can't be driven. You won't own them.
Re:Self-driving vehicles against human drivers: Equal safety... by foobar1962 on Thursday December 31, 2020 @07:40PM (#25599209)
Ah, that's an interesting option. The car remains the property of the manufacturer who can control modifications and maintenance.
Re:Self-driving vehicles against human drivers: Equal safety... by BurningFrog on Wednesday December 30, 2020 @08:07PM (#25588370)
> After that, it will be on the owner to renew

No one will pay to take responsibility for someone else's software bugs. That deal won't sell a single car.

Re:Self-driving vehicles against human drivers: Equal safety... by throwaway0a5e on Wednesday December 30, 2020 @07:00PM (#25587867)
You're gonna get instantly undercut by the insurers that can accurately price the risk rather than insist their customers jump through hoops.
Re:Self-driving vehicles against human drivers: Equal safety... by ysavir on Wednesday December 30, 2020 @06:41PM (#25587701)
> Obviously the car manufacturer will be liable when a fault in their product kills people

But how will that be proven? We can't exactly pop the lid off the driving algorithm and say "ahh, there's the problem. Time to take it to court".

Re:Self-driving vehicles against human drivers: Equal safety... by tintor on Wednesday December 30, 2020 @09:10PM (#25588804)
It is software, of course you can (with access to source code and its tools). Car will record all of its sensor data, and we'll be able to analyze its decisions.
Re:Self-driving vehicles against human drivers: Equal safety... by BurningFrog on Wednesday December 30, 2020 @08:03PM (#25588352)
You can't pop the skull bone of a human driver and peek into their brain either.

The way to determine the guilt of a driver, human or electronic, is through their actions.

Re:Self-driving vehicles against human drivers: Equal safety... by gambiting on Wednesday December 30, 2020 @06:48PM (#25587768)
I mean, we were able to prove that the Uber car killed someone through reckless engineering because of its black box. It was obvious that the car saw the person and then deliberately ignored them, and the stock autonomous breaking system has been disabled.
Re:Self-driving vehicles against human drivers: Equal safety... by nl on Wednesday December 30, 2020 @07:03PM (#25587892)
Fault in driving accidents is well established, by law. No need to look at the algorithm at all - if the car was at fault under law then it's done.
Re:Self-driving vehicles against human drivers: Equal safety... by schoen on Wednesday December 30, 2020 @09:09PM (#25588792)
> we anticipate that the number of people killed will be fewer, hence 'saving lives'. However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents. There will be cases where a court determines that the autonomous system was the cause. Families of those killed will want justice, while those separately saved by autonomous systems may never be heard from in the same case.

This reasoning was addressed with the VICP program for vaccines in the U.S., based on the idea that vaccines save many lives overall, but still injure a small number of people who will want to be compensated for that injury.

https://www.hrsa.gov/vaccine-compensation/index.html

Maybe there should be a self-driving-car injury compensation program along similar lines once particular cars are convincingly proven to be even moderately safer than human drivers. People might be mad about it, but maybe the precedent of the apparent success of the VICP would be persuasive (at least for courts and legislators, and maybe for some people actually injured by self-driving cars).

A counterargument is that vaccine injuries are generally unforeseeable and reflect absolutely no fault on the part of the injured person (or injured person's guardian), while some people injured by self-driving cars will bear some fault for their own injuries, which insurers or manufacturers might well want the opportunity to adjudicate. (Otherwise, there could be a perverse incentive to deliberately do dangerous things around self-driving cars to provoke an injury and receive a payment, something I've heard already sometimes happens with personal injury claims against human drivers in some parts of the world.)

Re:Self-driving vehicles against human drivers: Equal safety... by xenocyon on Wednesday December 30, 2020 @12:31PM (#25583680)
> However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents.

So far it seems that this is very much the case. Autonomous cars do relatively well in highway scenarios whereas they appear to do poorly recognizing bicycles, for instance. Reducing safety to one single metric would be a big mistake.

Re:Self-driving vehicles against human drivers: Equal safety... by throwawaygh on Wednesday December 30, 2020 @09:32PM (#25588953)
> Will profits and insurance be able to cover the costs of defending and settling such cases.

Risk will be transferred to individual consumers through "pay attention / hands on wheels / you're still the driver" warnings. Those warnings will never go away, even with vehicles that are in all other ways marketed as L5.

Re:Self-driving vehicles against human drivers: Equal safety... by kaba0 on Thursday December 31, 2020 @07:39AM (#25592101)
And frankly, it should not be legal. Either don’t sell it as self-driving / don’t even have that feature, or take full responsibility (within normal limits) for any accident.
Re:Self-driving vehicles against human drivers: Equal safety... by sriku on Thursday December 31, 2020 @12:05AM (#25589779)
I'm wondering whether the first steps ought to be to make current driving much safer through automation - like detecting drunk driving, falling asleep, and such and limiting speed, refusing to start, alerting police and/or nearby vehicles etc. The lessons from that might better inform the long tail of cases that autonomous vehicles will eventually face?
Re:Self-driving vehicles against human drivers: Equal safety... by visarga on Thursday December 31, 2020 @12:18AM (#25589840)
Yeah, people won't buy 'crippled' car brands. Probably no manufacturer will dare be first.
Re:Self-driving vehicles against human drivers: Equal safety... by amanaplanacanal on Thursday December 31, 2020 @10:23AM (#25593438)
I could picture legal requirements that cars check for say, alcohol consumption though. Then they wouldn’t have a choice.
Re:Self-driving vehicles against human drivers: Equal safety... by paulryanrogers on Wednesday December 30, 2020 @06:59PM (#25587859)
My guess is it's much easier for the public to understand the risks and liability of human drivers than AI.

Humans often get distracted or misinterpret signals. And their errors stop with the driver. AI could react in more unexpected ways when it goes sideways. Humans too can get weird when chemically impaired but the liability is much easier to attribute.

Re:Self-driving vehicles against human drivers: Equal safety... by Justsignedup on Wednesday December 30, 2020 @11:18AM (#25582939)
Sensationalism will win out quite a bit. And responsibility. Its just a tough problem.

- People developing Bell's Palsy at the same rate with vaccine than not. But suddenly only those with the vaccine show up in the social media feeds. Because nobody just posts "I just got bell's palsy" but now they do because people are paying attention. Same will happen with AVs. "I just got into an AV accident" will make headlines, while "I just dozed off and hit a kid" will barely circulate.

- People inherently trust humans over technology. Just because. So they will be quick to distrust autonomous vehicles. I already had convos about the fact that yes, teslas do kill, but on the whole self-driving teslas do kill far less than non.

- When a human drives, the liability is on the human. When a car self-drives, the liability might be on the manufacturer.

Re:Self-driving vehicles against human drivers: Equal safety... by cj on Wednesday December 30, 2020 @11:30AM (#25583041)
> People inherently trust humans over technology. Just because.

From the perspective of someone who rides a motorcycle, the #1 thing you need to do to not crash is to anticipate what all vehicles around you might possibly do.

For example, I always avoid riding in another car’s blind spot for obvious reasons.

The problem (for motorcyclists) will now be trying to adapt to understand what a Tesla might do and where a Tesla’s blind spots might be - and once you add in the idiosyncrasies of other AVs I could see it being really difficult to ride safely around AVs.

It’s fairly easy to anticipate actions of another human, and not as easy to anticipate when actions are decided by an algorithm.

FWIW I think the above also applies to cyclists.

(I suppose this becomes a non-issue if the assumption is that AVs will be so superior to human judgement as to never strike another motorcycle or cyclist - 5x safer sounds like a starting point)

Re:Self-driving vehicles against human drivers: Equal safety... by sliken on Wednesday December 30, 2020 @01:34PM (#25584488)
I actually expect the opposite. Motorcycles preferring to be near Tesla's and any other car with sensor based safety features that are on 24/7.

I'm frequently alerted of a motorcyclist approaching from the rear by it appearing on my Tesla display because it's detected by the cameras and ultrasound. I've rarely notice the motorcycle before the car does.

Re:Self-driving vehicles against human drivers: Equal safety... by ggreer on Wednesday December 30, 2020 @12:59PM (#25584061)
I own a Tesla and I ride a motorcycle. I would much prefer to deal with 100% autopiloted Teslas than current human drivers.

Teslas don't have blind spots. They have eight cameras that give 360 degree views around the car. They also have a dozen ultrasonic sensors that can detect obstacles up to 5 meters in all directions. The only way to collide with a Tesla on autopilot is by doing something really dumb.

In practice, a Tesla on autopilot tends to drive like a human taking a driving test: accelerating slowly, always signaling before turning or lane changing, always yielding to pedestrians, always braking or cancelling lane changes if an aggressive driver gets in the way, never honking. If traffic is too dense to lane change to the desired freeway exit, it reroutes rather than cutting into traffic (as pretty much any human would).

Re:Self-driving vehicles against human drivers: Equal safety... by frenchy on Wednesday December 30, 2020 @11:41AM (#25583156)
> People inherently trust humans over technology

I don't think that's generally true, or at least, the contrary notion is also true some times. I'm pretty sure that if someone asked me the product of 13 x 6, they would trust me more if I punched some numbers in to a calculator and gave them a result versus if I just did it in my head. I don't know, but I think the likelyhood of me mistyping numbers is embarrasingly high, and probably about as likely as a mistake in easy mental math.

It's also closely linked to your third point though. Liability with self-driving cars is difficult. When people talk about self-driving cars, they sort of just hand-wave away the fact that there will be accidents, so as to avoid this difficult problem. This does not instill confidence.

Re:Self-driving vehicles against human drivers: Equal safety... by SkyBelow on Wednesday December 30, 2020 @11:27AM (#25583015)
>When a human drives, the liability is on the human. When a car self-drives, the liability might be on the manufacturer.

I think this is a point that needs more emphasis, especially on the word 'might'. Without both laws and a history of court cases giving evidence for how those laws are interpreted and enforced, it isn't possible to tell where liability may end up. I wonder if that is part of the reason people are hesitant. Liability is being removed from the driver, but it doesn't see have have found a place to settle back down at, so people are viewing it as if liability is just being removed. For initial court cases (and the amount of time and money it takes to fight them), this may not be an unrealistic expectation.

Re:Self-driving vehicles against human drivers: Equal safety... by ghaff on Wednesday December 30, 2020 @11:36AM (#25583099)
If liability is on anyone, it would seem it has to be the manufacturer. And if there's no liability then the options are basically set up some sort of vaccine fund-like system or just to shrug and say it's between you and the insurance company.
Re:Self-driving vehicles against human drivers: Equal safety... by otabdeveloper4 on Wednesday December 30, 2020 @12:47PM (#25583883)
> Just because.

Maybe they actually read those EULAs and privacy policies and made an informed choice.

I mean, I wouldn't want Facebook making a self-driving car, and it's not because I doubt their machine learning chops.

Re:Self-driving vehicles against human drivers: Equal safety... by njarboe on Wednesday December 30, 2020 @11:32AM (#25583067)
I can't think of any product that has been developed since 1970 that can kill people. The exceptions are medical devices and pharmaceuticals. I sure hope self-driving cars can be an exception, but that will definitely take a federal law limiting the liability of manufactures. Similar to how small aircraft manufacturers were being pushed to extinction due to very high liability costs until the passage of the General Aviation Revitalization Act in 1994.
Re:Self-driving vehicles against human drivers: Equal safety... by drjasonharrison on Wednesday December 30, 2020 @11:40AM (#25583147)
Boeing 737 Max? Ikea Malm dressers? Many products listed at https://www.cpsc.gov/Recalls
Re:Self-driving vehicles against human drivers: Equal safety... by yadaeno on Wednesday December 30, 2020 @02:04PM (#25584802)
Add cars and motorcycles to this list.
Re:Self-driving vehicles against human drivers: Equal safety... by njarboe on Wednesday December 30, 2020 @09:18PM (#25588857)
Cars, motorcycles, and airplanes existed before 1970.
Re:Self-driving vehicles against human drivers: Equal safety... by ghaff on Wednesday December 30, 2020 @11:39AM (#25583133)
Lots of products can (and do) kill people. But drug side effects aside, it's hard to think of modern consumer products that, used and maintained properly, might just go and kill you some day and people being OK with that.
Re:Self-driving vehicles against human drivers: Equal safety... by mcguire on Wednesday December 30, 2020 @06:07PM (#25587390)
To njarboe's point, cars, motorcycles, airplanes, and furniture predate 1970. As do most of the deadly chemical products.
Re:Self-driving vehicles against human drivers: Equal safety... by notriddle on Thursday December 31, 2020 @01:36AM (#25590160)
Li-Ion batteries can explode.
Re:Self-driving vehicles against human drivers: Equal safety... by yadaeno on Wednesday December 30, 2020 @02:02PM (#25584792)
Cars?