News for hackers. Stuff that matters.
Re:Self-driving cars are headed toward an AI roadblock by dsnuh on Thursday July 05, 2018 @01:05PM (#17464882)
This is tangentially related, and something I have wondered, so I will ask it here.

Does anyone know how self driving cars will react to attempts by law enforcement officers to pull over the vehicle?

Re:Self-driving cars are headed toward an AI roadblock by UnderProtest on Thursday July 05, 2018 @04:43PM (#17466666)
The only reason this even looks like a problem is that humans don't follow the law.

In most jurisdictions if there's an emergency vehicle running flashers and/or siren behind you on the same side of the road you're supposed to slow, pull over, stop, then proceed only when the vehicle passes you.

If the emergency vehicle parks behind you then you have effectively been pulled over.

Pulling over safely is practically the first thing a self-driving car team works on. It is very easy to detect flashers and sirens. So... no problem.

Well, except that self-driving vehicles may accidentally be pulled over by firetrucks.

Re:Self-driving cars are headed toward an AI roadblock by dsnuh on Thursday July 05, 2018 @09:30PM (#17468284)
So if the autonomous vehicle hears the sirens, does it start to pull over, or wait until it can also detect flashers? What about a loud stereo playing a siren sound or a car with flashers installed on it? I'm just wondering, because although I know this sounds like a pretty simple problem, I don't think that it is.
Re:Self-driving cars are headed toward an AI roadblock by UnderProtest on Friday July 06, 2018 @02:57PM (#17474179)
Again, the law and custom already cover this.

When you hear a siren you're to become alert for the possibility of flashers behind you. You are not supposed to just start pulling over because it may not be on the same road as you and pulling over may block traffic. Imagine if every car in a crowded downtown pulled over every time the drivers could hear a siren. Instant gridlock.

So a siren played loudly on the radio will not cause a rule-following car to pull over, regardless of who or what is driving it. I presume you're talking about siren sounds in music, but...

Installing flashers that produce the same pattern as official police flashers and/or playing a continual siren is impersonating an officer. That's a serious crime.

Fake flashers will probably cause self-driving cars to pull over but they'll also cause humans to pull over. Not a self-driving car problem.

In the future police flashers can have a cryptographic element emdedded in the flash pattern that a self-driving car or a human-driven car with sensors can authenticate but that's an enhancement over the current situation.

It's one of the best-defined situations in traffic because it's precisely the fallback behavior. Detect emergency vehicle behind you, pull over as far as is safe, wait. If a self-driving car can't do that then it's hardly self-driving at all.

The real trouble, which you haven't brought up, is when the traffic is already at a standstill and an emergency vehicle approaches. The soft and gradual scooch-scooch movements that we have to do to clear enough space for the emergency vehicle are a much tougher case.

You can pull over a self-driving car. You just may have difficulty getting past it to an emergency.

Re:Self-driving cars are headed toward an AI roadblock by vamin on Thursday July 05, 2018 @01:07PM (#17464904)
They will pull over.
Re:Self-driving cars are headed toward an AI roadblock by devy on Thursday July 05, 2018 @01:18PM (#17465005)
Another attack surface for self-driving cars
Re:Self-driving cars are headed toward an AI roadblock by adrianN on Thursday July 05, 2018 @01:59PM (#17465345)
Human drivers also pull over when people who look like the police ask them to.
Re:Self-driving cars are headed toward an AI roadblock by bryanlarsen on Thursday July 05, 2018 @01:43PM (#17465214)
Sure, if you're willing to risk going to jail for impersonating a law enforcement officer.
Re:Self-driving cars are headed toward an AI roadblock by dsnuh on Thursday July 05, 2018 @01:48PM (#17465258)
Fair enough. I'm sure some would be willing to do that, but likely not many. I do think it is going to be very interesting to work out some of the scenarios if we do get to Johnny Cab style self driving cars.
Re:Self-driving cars are headed toward an AI roadblock by bryanlarsen on Thursday July 05, 2018 @02:37PM (#17465673)
If you're willing to risk jail, disrupting traffic is ridiculously easy, self-driving cars or not.
Re:Self-driving cars are headed toward an AI roadblock by schwap on Thursday July 05, 2018 @03:02PM (#17465848)
Is fooling a computer system into thinking you are a police officer the same thing as fooling a person?
Re:Self-driving cars are headed toward an AI roadblock by polski-g on Thursday July 05, 2018 @01:47PM (#17465240)
People are. See South Africa, Brazil, etc.
Re:Self-driving cars are headed toward an AI roadblock by dsnuh on Thursday July 05, 2018 @01:25PM (#17465075)
That was my line of thinking.
Re:Self-driving cars are headed toward an AI roadblock by gaius on Thursday July 05, 2018 @03:55PM (#17466283)
Have any of the major vendors documented this? Otherwise, citation needed.
Re:Self-driving cars are headed toward an AI roadblock by vamin on Thursday July 05, 2018 @04:19PM (#17466460)
"By working with the police department in Chandler, AZ, for example, Waymo has been able to train its cars to yield, pull over, or stop when it hears or sees sirens." [1]

[1] https://www.recode.net/2017/10/15/16472896/alphabet-waymo-se...

Re:Self-driving cars are headed toward an AI roadblock by gaius on Thursday July 05, 2018 @05:47PM (#17467130)
Thanks!
Re:Self-driving cars are headed toward an AI roadblock by dsnuh on Thursday July 05, 2018 @01:24PM (#17465067)
By what mechanism though? I could see a big griefing opportunity if there is some automated system that allows law enforcement to signal the vehicle to pull over.
Re:Self-driving cars are headed toward an AI roadblock by the-pigeon on Thursday July 05, 2018 @03:17PM (#17465981)
Actually that's kinda interesting.

Instead of recognizing the lights or something you could create a communication of some sort where the officer's vehicle provides a key that the car can then authenticate that it's a real police officer making the pull over request.

Heck you could even check with a police department system that the officer is on duty and in that area so a stolen police car or key couldn't be used.

Re:Self-driving cars are headed toward an AI roadblock by vntok on Thursday July 05, 2018 @02:09PM (#17465423)
Check out waymo's videos; the car detects the flashing lights + reflective fabric on the police officer's uniform, as well as the shoulder and arm gestures. Griefing is as much an issue as is police impersonation right now, that is a very rare occurence that will be punished very severely when occurring.
Re:Self-driving cars are headed toward an AI roadblock by jellicle on Thursday July 05, 2018 @03:12PM (#17465924)
How many different police uniforms do you think there are in the world?
Re:Self-driving cars are headed toward an AI roadblock by vntok on Thursday July 05, 2018 @04:02PM (#17466331)
Have a look[1]. Observe how they all kind of look like each other regardless of the country: shoulder pads, head cover, belt, uniform colour, formal attire, etc. Once the model knows the baseline, that is "a uniformed individual waving characteristically in front of the car", don't you think it would be quite easy to teach it with a mere few hundred pictures how local police officers look like in the current region?

1: https://www.quora.com/What-are-the-different-police-uniforms...

Re:Self-driving cars are headed toward an AI roadblock by notahacker on Thursday July 05, 2018 @04:31PM (#17466562)
They don't look remotely similar to me, especially considering that black, blue, navy, grey and khaki (and reflective yellow for people on roads) are not unpopular colours for clothes worn by people who are not police officers or otherwise involved in traffic direction, many of whom may have cause to move their arms in ways comparable to signals. Humans are just a lot better at gauging intention and even simple stuff like parsing the word "police" at an oblique angle

Frankly even with local training, you'd still think giving law enforcement devices to stop, restart and redirect vehicles was a minimum requirement.

Re:Self-driving cars are headed toward an AI roadblock by vntok on Thursday July 05, 2018 @06:53PM (#17467551)
> They don't look remotely similar to me

All of these agents follow a similar pattern of clothing (as I said, combination of similar garnments and colours) and behaviour (placement on the road, gesturing with authority, directly facing the car, etc.). Machine learning algorithms are especially good at recognizing patterns and storing their abstracted form, so it should come as no surprise that understanding what a police officer looks like in abstract is not the main issue of self driving.

> Humans are just a lot better at gauging intention and even simple stuff like parsing the word "police" at an oblique angle

Google seems to understand these intentions well enough, and at a much higher level than mere word parsing. This video is from 2015: https://youtu.be/tiwVMrTLUWg?t=9m5s

You got the car understanding all that happens at a complex intersection at 9'05, understanding what a police car looks like at 9'35, then detecting and reacting to a schoolbus and then parsing a police officer gestures right at the 10' mark. I'd say chances are these are pretty solved situations 3 years later. You can even see some creatures from their "zoo" of patterns for cars & people at 10'35.

Additionally, here is an article from last year: https://www.ibtimes.co.uk/googles-waymo-teaching-police-us-w...

> "When a Waymo car hears sirens, it will automatically pull over, yield, and stop. For example, when a number of vehicles are moving towards the scene of an accident on a highway and ambulances and other emergency vehicles are headed toward it, driverless cars will move aside and give way. Using audio sensors, the cars can detect exactly which direction the sirens are coming from and move out of the way."

Re:Self-driving cars are headed toward an AI roadblock by notahacker on Thursday July 05, 2018 @09:25PM (#17468259)
> All of these agents follow a similar pattern of clothing (as I said, combination of similar garnments and colours) and behaviour (placement on the road, gesturing with authority, directly facing the car, etc.)

Repeating an assertion does not make it cease to be false. A very small handful of pictures you linked to shows a wide variety of coats, vests and shirts of many different colours, all of which heavily overlap with general garment types and colours used in everyday clothing which tend to indicate police only with small and greatly varying trim detailing (and sometimes hats). And is the clothing and trim designed to convey authority? isn't the sort of abstract pattern recognition computers do better than humans, or even at all well. Sure, you could certainly create specific police uniform training sets for every jurisdiction and possibly even cut down false positives in other jurisdictions by geofencing them (so you don't get people stopping in California for commuters wearing the distinctive er... blue shirts and black trousers of the Hong Kong police) but it's a non-trivial undertaking even if there are bigger problems for SDVs to tackle

More importantly, unlike humans evolved to have an intimate understanding of human mannerisms, machine learning has no concept of "gesturing with authority", beyond whether moving human shapes fit very specific patterns within its calibration parameters, and police officers often don't have scope to place themselves in a particular position in order to get the car to understand them.

> Google seems to understand these intentions well enough, and at a much higher level than mere word parsing.

The video shows examples of predicting possible directions of travel of moving road users based on maps and movements (i.e. its fundamental driving model) and a shot of it recognising two arm gestures in an idealised front on positions. Neither fall under the scope of being able to understand how the traffic policemen intends to clear the blocked intersection from his shouts and gesticulations at you and various other vehicles. Humans also don't need to be signalled to go again if the black-jacketed man they've stopped for was actually trying to hail the taxi behind them.

Re:Self-driving cars are headed toward an AI roadblock by onemoresoop on Thursday July 05, 2018 @05:38PM (#17467053)
And who will get the tickets? The car? The passengers? The manufacturer?
Re:Self-driving cars are headed toward an AI roadblock by jtbayly on Thursday July 05, 2018 @01:13PM (#17464960)
One would hope! lol. But seriously, how do you know this? Just curious.