> “The vehicle has a level 2 driving assistance system that is already incorporated in production vehicles today and which can support the driver on demand,” the company said. “With level 2 vehicles the driver always retains responsibility.”
> BMW added that the vehicle was required to be marked as a test car for data protection purposes, because it was recording footage.
This was not self-driving to start with and could end up being 100% operator error. Though even if it was self-driving (again, it wasn't) I'm nowhere near ready to call it "negligent murder via technology". It's terrible when self-driving tech causes accidents like this but opponents of self-driving seems all too comfortable ignoring the other crashes that happen daily and on top of that there is no way to know how many accidents have been prevented by self-driving/driver assist systems. At the end of the day I care a lot more about the net-difference in car deaths, not the causes of only ones that involved "technology" (obviously accidents per-capita, by car automation type, should be taken into account here). Should we also get rid of drive-by-wire? Since that's tech that can fail? Where does this end?
In your view, what is the MVP for self-driving car safety, in terms of the number of crashes/deaths per day?
For example:
9 accidents out of 100 cars on the road in some level of driver automation (bucketed per-level) is acceptable if there were 10 accidents of 100 cars on the road with only a human driver over the same timespan (probably some kind of rolling average).
We should absolutely investigate the causes of driverless car (at any level) crashes and penalize companies if they are at fault and the issue was foreseeable but a lot people seem to think the only acceptable answer is “0 accidents” which is just absurd. Don’t let good be the enemy of great.
While it may be true that perfect is the enemy of good, there is also such a thing as setting the bar too low.
Which is the status quo for both cars and a bunch of other industries (pharma, tabaco, alcohol, fast food, the list goes on). Nothing is ever perfect (though many things don't have "death" as a potential failure case) but you are only looking at the downside and ignoring the lives that would be saved.
I don't think many families think "Well our Bobby died in a car accident that would have been preventable by technology but even if he had access to it thousands of other people would still die even while using that tech so we are ok with him dying".
The key difference here is that alcohol and tobacco do not autonomously kill people. We can feel safe blaming deaths caused by them on the individuals who purchased and used those products. Same with automotive deaths. As soon as the blame goes from diffuse individuals to a single locus, the torts will come out in full-force. If a self-driving car kills 10% as many people per vehicle-mile as the average individual driver, then the company making it will get sued out of existence.
(Or, if you will, substitute any other concrete existing model of car for the one I named.)
It's a whole different ballgame to accept that computers are going to choose to kill thousands of people per year, and it is not much comfort to know that it's slightly fewer thousands of people. I think this is especially true when the response to such deaths is not "we will investigate thoroughly and ensure this never happens again".
This is not a logically consistent argument, but humans are not logically consistent beings.
In the first case, we "remove" people at random from a pool of drivers good and bad, so we have more percentage of bad drivers after all. In the second we remove much more bad drivers than good drivers so is much more safe for the rest. Humans can learn from past experiences and apply creative solutions to complex problems, machines are slower in this sense.
Safety systems don't generally get built with an MVP mindset, but that seems to be what is happening with autonomous cars and it's concerning to me on multiple fronts.
somewhere around 1 death per hundred million miles seems reasonable.
I'd like to see us treat autonomous road safety the way we treat aircraft safety, where even minor incidents are thoroughly investigated and often lead to industry-improving changes. Their approach clearly works because despite the fact that we hurl hundreds of thousands of people through the air every day in millimetre thick metal tubes, it's the safest way to travel.
Leaving autonomous driving to the whims of the empathy-deficient utilitarianist VCs of the world, and barely regulating their work at all, is really not ok.
I'd like to see us treat autonomous road safety the way we treat aircraft safety
To do that you need to increase your standards for being a car driver up to being a pilot. Since most accidents would involve human error.Hold on a second. Lane-assist is a perfectly fine feature that is obviously meant to be used in conjunction with an alert driver with their hands on the wheel. That is typically dubbed 'Level 1' of autonomous driving, similar to adaptive cruise control. This accident wasn't related to that, but instead to a 'Level 2' autonomous driving where there is some level of driving automation.
Ahem, the Airline industry already found out why this not true. Automation always requires more training not less.
Meatbags do it all the time.
Two people die in a car accident every minute [0] and nobody cares. (Actually, two and a half, but that's just too gory.)
[0] https://www.who.int/news-room/fact-sheets/detail/road-traffi...
Many years ago the 3M company created a magnetic tape for the lane lines on roads and a device to detect those for automobiles, along with a gizmo that would vibrate the driver's seat on the side the vehicle was getting too close to crossing the lane lines.
That could help prevent these kinds of incidents, but cameras trying to detect painted lane lines have many obvious fail points and one of them is keeping the car in it's lane. This incident proves that once again.
You cannot tell a human "this car can drive itself but you need to be ready to take control at all times" because that's a clear oxymoron. It either works, or it doesn't, and if it doesn't it's potentially deadly, and it only takes a second to become deadly, and humans cannot react to that failure 100% of the time. That's been proven too many times already.