I'm so glad they're not testing their cars in my state. This makes me wonder if they even do basic safety engineering like FMEA or if they just wing it.
There's 2 chefs.
The collision avoidance system? The fail-safe that's meant to ensure the car doesn't hit something when the human driver screws up? The one that works with an entirely separate autonomous intelligence (aka, the human) controlling the car? The one explicitly designed to trigger emergency brakeing even if the primary controller is trying to do something else? The kind of system installed on many other AI controlled cars to avoid this exact type of disaster?
That backup system?
Look, it's entirely possible that for some reason this specific safety system conflicted with the current version of Uber's system, but we have zero data to suggest that, and if so, it's something specific to those two systems in that particular vehicle (and suggests a severe issue with Uber's system to boot). There's no general issue here.
> There's 2 chefs.
Yes, and sometimes one of them takes over from the other one. That's how this works.
There are plenty of intentional maneuvers required to integrate with real-world (ie. non perfect) traffic that trigger these systems.
They’re designed to take hints from human input (so for example, LKA responds less strongly to forceful unexpected inputs than a lack of expected input).
There is 0 chance the system wouldn’t interfere with a self driving.
Not to mention many of those safety systems include lockouts on the CAN bus which make removing their safety module a first step to even add your own inputs. I know that’s how it works on my Volt with a Mobileye sensor
If your SD system is supposed to be solving 100% of the same problem anyway, it's best to gut the software you don't control and work with the hardware as directly as you can. The notion of building atop a lower-level abstraction makes for great academia but doesn't work with industrial realities.
So that would, if the automated tech from Uber would have detected in time, it would have reacted like a human driver and the pre-installed system would may have not noticed it. But in case, it would have reacted as a backup.
There is no warning.
Not trying to take sides here, but the last part strikes me as "citation needed".
Do you know of anyone who's died that way?
This further reinforces my point, I think. :)
While yes - it would also force Uber to permanently partner with Volvo on technology they can't control. 'Uhuh, my Ubers a Chevy not a Ford - it could kill me because the Chevies don't built-in X is worse!'.
You do not want an arbitrary third party system controlling the car while the Uber system is in unknown ways; if the systems conflicted things could go out of control and be more dangerous.
That sounds like a win-win to me.
>You do not want an arbitrary third party system controlling the car while the Uber system is in unknown ways; if the systems conflicted things could go out of control and be more dangerous.
I find it interesting that, of these two systems, it is Volvo's widely-deployed system that is described as 'arbitrary'. If this argument had any merit, it would be unsafe for this system to be on the road, 'conflicting' with the car's human driver. On the contrary, the statistics clearly show that these systems reduce the frequency and severity of accidents.
Maybe it makes sense to rely on arbitrary vehicle specific fallbacks, but long-term it doesn't as I'm sure They don't want to be dependent on a specific model. When you request a ride, do you want to care about whether your getting a Honda or a Volvo?
I'm not sure I'd say that this is being "focused" on. It's an interesting bit of info, the other players in the space (Intel, Volvo, Aptiv) have an interest in getting their spin out there, readers are interested, so we get this article and everyone is happy. It's not a super critical key to the story, but it does help explain what happened in some small way.
> having a second system running that can't coordinate with the self-driving system would likely make the combined system less safe.
That seems like a bit of a leap to me. The Volvo system is not super-advanced; the relevant bit here would probably be their "Collision Warning with Auto Brake" feature.
Multiple independent systems with the ability to sound an alarm and slam on the brakes if they detect an imminent pedestrian collision...seem like they probably would be safer overall? They'd certainly be safer for the pedestrians, and we're currently at 1 pedestrian fatality and 0 fatalities for "people in cars killed due to overzealous/conflicting automated safety systems".
I rather suspect Uber disabled it because they wanted better data, not because they thought it was safer for other people on the road. That's certainly a valid choice, but one which might have been wiser if their tech was a lot more reliable.