News for hackers. Stuff that matters.
Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @12:43AM (#24489603)
Guy was using his phone not paying attention to the road when testing experimental equipment on a public road. He was there specifically to mitigate potential malfunctions of said experimental equipment, but he was reading reddit or whatever instead of keeping lookout.

I can't see how this is not clear cut negligence.

Re:Uber backup driver indicted in 2018 self-driving crash th... by akira2501 on Wednesday September 16, 2020 @01:02AM (#24489686)
The vehicle was travelling the posted speed limit at night, as designed. The NHTSA pointed this out that the law may require you to travel at a "safe" speed, and simply choosing to always move at the posted limit is potentially a moving violation and a design flaw.

The vehicle was travelling 20mph faster than it's own "safe clear ahead" zone allowed for. Simply ignoring it's own safety limits and travelling at a higher rate of speed is a design flaw.

Designing a large public road autonomous vehicle test and not taking into account an easily predicted human vulnerability that's been known in other automation experiments for decades is a project design flaw.

Whether or not the driver is at some fault, I think the court will be capable of determining that. Arizona's willingness to completely disregard the mountains of negligence on part of a giant corporation is disturbing.

Re:Uber backup driver indicted in 2018 self-driving crash th... by JanSt on Wednesday September 16, 2020 @01:15AM (#24489757)
Isn't it the drivers job to take control whenever there is a design flaw? I thought that was the exact job description.

If the car is going over it's speed limit, the driver should react.

I see that some people think Uber should have added systems to control the safety driver. I think that's a fair point, but it doesn't take away the drivers responsibility. They knew the car isn't perfect. It's their job to take over control whenever that happens.

Re:Uber backup driver indicted in 2018 self-driving crash th... by freeone3000 on Wednesday September 16, 2020 @04:28AM (#24490678)
Their job, as designed, is impossible. Automation complacency is well-known and well-studied -- any system which requires no input for an hour and then requires you to act randomly within seconds is an impossible task for humans. Volvo's self-driving (hands-on-wheel required) accounts for that. Uber's did not.
Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @01:18AM (#24489777)
Uber posted a safety driver specifically to make the car safe at regular speeds despite the limitations of the autonomous system. That driver just wasn't doing their job.
Re:Uber backup driver indicted in 2018 self-driving crash th... by ardy42 on Wednesday September 16, 2020 @01:03AM (#24489693)
> Guy was using his phone not paying attention to the road when testing experimental equipment on a public road. He was there specifically to mitigate potential malfunctions of said experimental equipment, but he was reading reddit or whatever instead of keeping lookout.

> I can't see how this is not clear cut negligence.

1) The driver is a woman.

2) While I think the driver does bear some fault here, they don't bear all the fault. Uber designed an unsafe system that relied on an unnatural amount of vigilance from a single person while simultaneously discouraging that vigilance [1]. They didn't design the car to shut down when one of it's critical safety components (the driver) was not operating correctly, and they didn't even give that driver amphetamines or something to increase their vigilance to artificial levels.

[1] Basically: pay close attention to a boring process while doing absolutely nothing for hours on end. I'm pretty sure that's a classic "humans suck at this" task.

Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @01:32AM (#24489837)
That "unnatural amount of vigilance" is just sitting in a comfy seat and looking at the road ahead of you go by. There is nothing unnatural about that. Lots of people do similar or more boring tasks just fine.

This isn't a truck driver falling asleep from exhaustion caused by aggressive scheduling. You don't "accidentally" take out your phone when your job is looking ahead. That's deliberate negligence.

If you want to require eye sensors to detect distraction, by all means, pass a law about it. Maybe include regular non-AI cars too. #1 cause of accidents over here.

Re:Uber backup driver indicted in 2018 self-driving crash th... by ardy42 on Wednesday September 16, 2020 @02:18AM (#24490040)
> That "unnatural amount of vigilance" is just sitting in a comfy seat and looking at the road ahead of you go by. There is nothing unnatural about that.

Statements like this seem to indicate a failure to understand what the difficult part of the task was. In short: a boring monitoring task that was practically unnecessary 99.99000% of the time, but absolutely critical maybe 0.00001% of the time. The typical-case lack of necessity would strongly re-enforce engaging with distractions over time (i.e. distraction more rewarding, and nearly all of the time no negative feedback of any kind).

> This isn't a truck driver falling asleep from exhaustion caused by aggressive scheduling. You don't "accidentally" take out your phone when your job is looking ahead. That's deliberate negligence.

I'm not saying there was no negligence here on the part of the driver, just that Uber itself was at least as negligent if not more so for designing the system in the way it did. Focusing too much on the driver is an error.

Honestly, watching a show was egregious, but I wouldn't be surprised if the drivers would end up falling asleep on a regular basis if all distractions were removed from their environment. Half paying attention to something I wasn't interested in has always been the best way to get me to fall asleep.

Re:Uber backup driver indicted in 2018 self-driving crash th... by vkou on Wednesday September 16, 2020 @02:12AM (#24490012)
> That "unnatural amount of vigilance" is just sitting in a comfy seat and looking at the road ahead of you go by.

Doing that for five minutes is easy.

Can you do that for eight hours? Day after day? Without a single lapse in attention?

This is a much harder job then the truck driver has - because he constantly has to make microadjustments, to correct for road conditions.

People's brains don't work the way you think they do.

Re:Uber backup driver indicted in 2018 self-driving crash th... by misja111 on Wednesday September 16, 2020 @03:23AM (#24490320)
The driver wouldn't be prosecuted if she just had a lapse of attention. She had taken her phone and was watching a TV show. That's a deliberate act.
Re:Uber backup driver indicted in 2018 self-driving crash th... by vkou on Wednesday September 16, 2020 @04:05AM (#24490552)
I'm not saying the driver wasn't negligent in watching TV, instead of the road. In fact, I don't think anyone in this thread is saying that.

I am saying that passively watching the road for hours on end is much harder than actively driving.

Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @02:52AM (#24490192)
Many people write this notion in this thread. Do you have any data for this BTW? How are you claiming this confidently? Have you driven a self-driving car? Many people (myself included) find it quite easy to monitor the road in it for long periods of time. If the driver was not one of them, she shouldn't have taken the job and risked innocent lives.
Re:Uber backup driver indicted in 2018 self-driving crash th... by freeone3000 on Wednesday September 16, 2020 @04:33AM (#24490708)
https://www.mitre.org/sites/default/files/pdf/pr-3426-lesson... is a 2019 literature review of the phenomenon - section 2, reaction times in response to deviations in automated tasks, is of particular relevance here. (Summary: humans are bad at this)
Re:Uber backup driver indicted in 2018 self-driving crash th... by vkou on Wednesday September 16, 2020 @04:12AM (#24490591)
How are you so confident that you are different from all the Tesla owners whose self-crashing autopilots drove their vehicles into stationary objects, fire trucks, semis, etc?

What makes you confident that you are actually good at it, and are not the victim of Dunning-Kruger? Do you regularly find yourself in the process of stopping your self-serving car from crashing into things?

Or has your car simply not crashed yet?

Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @04:19AM (#24490628)
> all the Tesla owners whose self-crashing autopilots drove their vehicles into stationary objects

All the 3 of them? Among millions of Tesla vehicles out there and the hundreds of millions of miles driven? Is that even a considerable risk when compared to the general (non-zero!) risks of driving?

For me personally I simply know when I watch the road and when I don't. For some people this might be hard, for others - not so much. I am aware of when I pull out my phone or distract myself and when not.

Re:Uber backup driver indicted in 2018 self-driving crash th... by vkou on Wednesday September 16, 2020 @01:27PM (#24494939)
I'm sure you're aware of when you've pulled out your phone, or are playing with your infotainment system. (You should also stop doing it, it's negligent and illegal.)

But are you just watching or are you seeing the road? How many times have you taken control from your car doing something stupid and dangerous?

Unless the answer to that second question is 'I do it all[1] the time, and I'm batting 20/20', what makes you confident that you'll catch the next instance?

[1] If that's really the case, you should probably short TSLA, it doesn't sound like their car can safely operate.

Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @03:09AM (#24490272)
It is rather unlikely, statistically, that this was a single lapse. Or that a single lapse would cause an accident. It's not like the driver's finger was hovering over a nuclear launch button.

Yes, I think I would be able to do this job safely. Not everyone has problems with focus to such an extent that you can't help but be on the phone when you need to be paying attention.

Re:Uber backup driver indicted in 2018 self-driving crash th... by HeWhoLurksLate on Wednesday September 16, 2020 @01:17AM (#24489771)
I agree with you except for

> and they didn't even give that driver amphetamines

Yo, what? IIRC, most *amphetamines are either illegal in the US or like FDA Class 1 substances or something like that, and you just want to throw them at people operating > 1 ton machinery? That seems like it could have an even higher risk for danger.

Re:Uber backup driver indicted in 2018 self-driving crash th... by ardy42 on Wednesday September 16, 2020 @01:23AM (#24489794)
> Yo, what? IIRC, most amphetamines are either illegal in the US or like FDA Class 1 substances or something like that, and you just want to throw them at people operating > 1 ton machinery? That seems like it could have an even higher* risk for danger.

That's true, and my comment was mostly sarcastic (but a little serious). Amphetamines are given to military pilots to increase alertness [1]. They're also used to treat attention deficit disorder (stimulants also increase focus in healthy people, see coffee). Some years ago I read that they're also popular in some parts of Asia not for recreation, but to help workers focus on boring, repetitive tasks (and they apparently can even make that kind of work seem "fun"), but I can't find the exact article again.

The kind of job these "car monitors" are expected to do is so unnatural that it's ludicrous that someone could be expected to succeed at it perfectly, unassisted.

[1] https://aviation.stackexchange.com/questions/8885/do-militar...

Re:Uber backup driver indicted in 2018 self-driving crash th... by Aunche on Wednesday September 16, 2020 @01:43AM (#24489886)
Modern cars are essentially self driving on the highway, and it doesn't require an an unnatural level vigilance to operate them. To be fair, the driver's assistance features are usually come with an attention monitor, so Uber is negligent in that aspect.

Also, no one said the driver has to do nothing. They can safely listen to audiobooks or talk on the phone.

Re:Uber backup driver indicted in 2018 self-driving crash th... by cocire on Wednesday September 16, 2020 @06:00AM (#24491147)
talking on the phone can be nearly as distracting as watching TV in some cases. it's also illegal in a lot of places...
Re:Uber backup driver indicted in 2018 self-driving crash th... by creddit on Wednesday September 16, 2020 @01:37AM (#24489858)
How is the required amount of vigilance any different than that of normal driving?
Re:Uber backup driver indicted in 2018 self-driving crash th... by freeone3000 on Wednesday September 16, 2020 @04:40AM (#24490739)
In normal driving, the driver is continually taking actions. Making small adjustments, considering hypotheticals, checking mirrors and speed. If the user is continually engaging with the system, there's less of a risk of the user's attention lapsing. Once the user's input is no longer required, humans are very bad at paying attention to something that doesn't change, and very bad at reacting to the change when it does happen.
Re:Uber backup driver indicted in 2018 self-driving crash th... by creddit on Wednesday September 16, 2020 @07:28AM (#24491560)
I fail to see what stops one of these car monitors from “considering hypotheticals, checking mirrors and speed.”

I get that it’s boring but fail to see how that’s an excuse for not paying attention (or watching streaming video) to a dynamic system you’re expected to actively engage with.

Many train systems are largely autonomous and far more static and yet we still expect train operators to not kill someone on the tracks.

How do you feel about lifeguards as a job? Failure of pools and beaches to design a good system?

Re:Uber backup driver indicted in 2018 self-driving crash th... by freeone3000 on Wednesday September 16, 2020 @01:28PM (#24494946)
Please see the top comment for how lifeguard systems avoid these issues - 30-minute short shifts, overlapping responsibilities, and monitored attention.

Train conductors do not require second-level reaction time. A train cannot stop in five seconds, no matter how quick the conductor is. People who are stopped on train tracks get killed, and the train operator is very rarely to blame.

Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @02:49AM (#24490177)
In what world is asking someone to at least not pick up their phone and start watching videos instead of doing one's job and at least looking at the road outside is "unnatural amount of vigilance"?

It's the basic job description. If she couldn't do it, she shouldn't have taken the job.

Re:Uber backup driver indicted in 2018 self-driving crash th... by brokenmachine on Wednesday September 16, 2020 @01:06AM (#24489714)
This is the first of many such cases to come.

It's unreasonable to hold someone accountable for a "self-driving car" that suddenly decides at a split-seconds notice that it can't cope driving.

Of course this is extra bad because it's an experimental car, but it's the same in my opinion with those Teslas on the road now that do the same thing.

Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @02:54AM (#24490202)
> It's unreasonable to hold someone accountable for a "self-driving car"

It is not unreasonable at all. She had one job to do - look at the road. She failed it because she felt that her entertainment was more important than doing her job. She picked up her phone and started streaming videos. She failed at her one job, plain and simple. She knew everything about the job and still chose to watch some videos and risk lives.

Re:Uber backup driver indicted in 2018 self-driving crash th... by brokenmachine on Wednesday September 16, 2020 @03:01AM (#24490232)
I said it was slightly worse in this case and sibling commenters have addressed this issue.

The experimental car shouldn't have been on the road at all if the only thing separating it from killing people is someone who is expected to maintain concentration for hours/days while simultaneously not actually doing anything.

Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @03:08AM (#24490268)
How do you expect the humanity to create a self-driving car then? Somehow magically create it from 0% to 100% in a lab, and then let out on the street? This is never going to work, it needs testing on public roads. What is your plan then? How do you propose FSD cars should be developed?
Re:Uber backup driver indicted in 2018 self-driving crash th... by ycombobreaker on Wednesday September 16, 2020 @03:24AM (#24490323)
For starters, Uber could have just not disabled the existing failsafe mechanisms that the car had.

Then, if we start with the expectation that a human in the loop is necessary for live testing, we could have two. It reduces the impact of independent failures. It also adds some social pressure to avoid negligence. It also provides overlapping coverage, as a lifeguard in this thread has pointed out.

Humans are fallible. Accept that, and design systems to be safe despite individual errors.

Driving a car is not the same aa monitoring a self driving car. There will be differences in attentiveness. Stop equating them.

Re:Uber backup driver indicted in 2018 self-driving crash th... by brokenmachine on Wednesday September 16, 2020 @07:21PM (#24499235)
Lets not act like it's a self-fulfilling prophecy that FSD cars on existing public roads will exist.

In my opinion, safe FSD cars are not possible with current technology on existing public roads - so either the technology has to improve by orders of magnitude, or the roads need to be modified significantly.

The gung-ho experimentation that is going on in public is in my opinion very dangerous and should be stopped, and this case is a perfect example of why.

Both the road infrastructure and other drivers are too crappy and unpredictable for FSD cars to be viable and safe.

Also this business of holding someone who is not actually controlling the vehicle accountable is ridiculous, and is surely something which will be proven in court eventually.

Re:Uber backup driver indicted in 2018 self-driving crash th... by lhorie on Wednesday September 16, 2020 @11:29AM (#24493588)
What I find puzzling is that I keep hearing people say that it's impossible for people to stay alert while not being the driver, when there's actually a pretty popular term to describe that very thing: a backseat driver[1].

If you go on a long multi-day road trip, you might even end up relying on a passenger's feedback in a moment of tiredness.

[1] https://en.wikipedia.org/wiki/Back-seat_driver

Re:Uber backup driver indicted in 2018 self-driving crash th... by brokenmachine on Wednesday September 16, 2020 @07:10PM (#24499129)
Did you actually read that page? A backseat driver doesn't trust the actual driver.

>A backseat driver may be uncomfortable with the skills of the driver, feel out of control since they are not driving the vehicle

Are you saying that the meatbag in a "self-driving car" is equivalent to a backseat driver?

Because if you are, then "self-driving cars" will never be viable because the humans inside don't actually trust them.

Re:Uber backup driver indicted in 2018 self-driving crash th... by lhorie on Thursday September 17, 2020 @08:07AM (#24503589)
Trust is beside the point. The actual point is that they are able to pay attention to the road, even for prolonged amounts of time, and react to perceived danger, despite not being the ones who are actually in control of the car.

The claim I'm disputing is the one that says people are somehow incapable of paying attention to the road for extended periods of time unless they are in control of the vehicle.

I might agree that a reaction might be jerky and panicky, but then again, they would by definition be so regardless, due to the unexpected nature of accidents

Re:Uber backup driver indicted in 2018 self-driving crash th... by brokenmachine on Thursday September 17, 2020 @07:04PM (#24511014)
So other road users' safety is reliant on jerky and panicky responses to perceived danger as well as real emergencies.

That sounds like a nice safe system.

For the record, I don't agree. I feel that the average person who would choose to use a self-driving will tend to be overly relaxed and trusting, not what I'd call a backseat driver.

The kind of person who is a backseat driver wouldn't trust the car's driving and would prefer to control it themselves, and thus wouldn't be using the self-driving feature in the first place.

Re:Uber backup driver indicted in 2018 self-driving crash th... by marcinzm on Wednesday September 16, 2020 @12:54AM (#24489648)
I give you a weight, you are to hold the weight in front of you with your arm outstretched, for 12 hours straight. If you drop your arm then a random person is shot. If you drop the weight is the death your fault or my fault for putting you in an impossible, for a human, situation?

Humans are very bad at paying attention for a rare event and having nothing else to do 99.999% of the rest of the time. This is surely well known to the people who set up this system in the self driving car.

Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @01:05AM (#24489710)
Looking at the road when sitting in the drivers seat without being absorbed by your phone is not, in any way, a hard task. Truck drivers, train drivers, pilots and other equipment operators exist. Millions of people do it every day. Those that don't, and end up killing someone are held responsible if found out.

Don't take a boring job if you can't handle it. The required basic level of continued attention is not a superhuman skill. It's not a job for everyone but it's not exceptional at all.

Re:Uber backup driver indicted in 2018 self-driving crash th... by ardy42 on Wednesday September 16, 2020 @01:16AM (#24489759)
> Looking at the road when sitting in the drivers seat without being absorbed by your phone is not, in any way, a hard task. Truck drivers, train drivers, pilots and other equipment operators exist. Millions of people do it every day. Those that don't, and end up killing someone are held responsible if found out.

Driving a truck is in no way comparable to what this lady was tasked to do. A truck driver is performing an active task (operating a truck), this lady was supposed to be performing a passive task (monitoring a truck's driving). Active and passive tasks are very different beasts.

But you're on to something with your comparison to pilots. Planes are mostly automated. When that automation fails, the pilots often lack the situational awareness to avoid a crash when they have to take over (for an example, see https://99percentinvisible.org/episode/children-of-the-magen...).

Re:Uber backup driver indicted in 2018 self-driving crash th... by clusterfish on Wednesday September 16, 2020 @01:42AM (#24489876)
I don't think this distinction is morally meaningful. Do passive monitoring tasks require more discipline? Probably. Are you unable to perform them? Get another job.

How many times do you think this driver was distracted with the phone when doing their job? I bet it wasn't just this one time that they happened to crash.

Pilots crash after hours of boredom because debugging problems in the air is hard, not because they were negligent leading up to the problem (vast majority of the time, anyway). And still by and large they succeed, it just goes unreported in the news because business-as-usual. This driver on the other hand got into an unrecoverable situation because of their own behaviour.

Re:Uber backup driver indicted in 2018 self-driving crash th... by marcinzm on Wednesday September 16, 2020 @01:08AM (#24489722)
Except they're not driving, they're just watching as the car drives itself. Driving implies you are perform actions in response to the environment, these people do not, they simply sit and watch.
Re:Uber backup driver indicted in 2018 self-driving crash th... by gamblor956 on Wednesday September 16, 2020 @12:56AM (#24489658)
Not even remotely the same thing.

Dude was paid to pay attention. He didn't. It wasn't because he got fatigued, it was because he was deliberately doing something else, by choice

Re:Uber backup driver indicted in 2018 self-driving crash th... by foerbert on Wednesday September 16, 2020 @01:06AM (#24489715)
Yes, but no. The point that was trying to be made was that he was hired for a task that's fundamentally extremely difficult for humans. You can pay a person all you want to stare at paint drying so they can note down the exact moment it's perfectly dry, but don't be surprised when they do a poor job.

The guy screwed up. Uber knew he almost certainly would. I won't say the guy isn't responsible at all, but pretending this is purely on him and Uber bears 0% of the responsibility is just silly. Humans are not capable of anything and everything simply because they are provided pay.

Re:Uber backup driver indicted in 2018 self-driving crash th... by gamblor956 on Wednesday September 16, 2020 @12:15PM (#24494078)
My point was that what the driver did was not negligence, it was deliberate inattention.

If she had been negligent, i.e., too tired to notice the pedestrian, that would have been a different matter. If she had been paying attention most of the time but inadvertently reached over to drink some coffee, that would have been a different matter.

But she wasn't too tired, and she wasn't momentarily reaching for a drink; she was simply choosing not to pay attention to her job so she could do something else instead.

Re:Uber backup driver indicted in 2018 self-driving crash th... by foerbert on Wednesday September 16, 2020 @02:20PM (#24495635)
You're still missing what I'm trying to say, I think. I'm not talking about fatigue, or brief inattention, or anything like that.

I'm saying that the inattention was basically a given. Yeah, at some point the driver went and grabbed a phone. It may have been fiddling with junk in the car, or their fingers, or day dreaming to the extent they were unaware of the world around them.

Yeah, they grabbed a phone. Is that really any different from any of the above? I don't think so. Particularly considering how ingrained the reflex is to grab and fiddle with a phone when bored is. I wouldn't be surprised if they never consciously decided to pick the thing up.

The task was simply unreasonable. Uber should have foreseen this problem and implemented systems to aide and monitor their drivers.

Re:Uber backup driver indicted in 2018 self-driving crash th... by bryanrasmussen on Wednesday September 16, 2020 @01:56AM (#24489950)
although I agree Uber bears most of the responsibility the analogy was ridiculous in not being fundamentally extremely difficult but basically impossible.

Aside from this, if the car had been driving over the speed suitable for the conditions at the time the fall person had plenty of time to note that and take over, in that case it was more like huh, the paint is drying but it looks like it's going to rain .... long time looking like it's going to rain ... oh no should have put the covers on!

But I'm betting the need to take over and drive is not properly given to the fall person either.

Re:Uber backup driver indicted in 2018 self-driving crash th... by marcinzm on Wednesday September 16, 2020 @01:00AM (#24489681)
When people are bored they get distracted and do other things. This is well known human nature and very few people are suited to this sort of task. The people who set up the self-driving car should have known better than the uneducated poor person who is being sacrificed.
Re:Uber backup driver indicted in 2018 self-driving crash th... by Erlich_Bachman on Wednesday September 16, 2020 @02:56AM (#24490215)
She could always just take a break if she felt her attention was lacking. Or you know, not take the job in the first place if this job was so hard for her personally.

It is not at all fair to make the comparison you are making.