News for hackers. Stuff that matters.
Re:New reports suggest limits to autonomous vehicle performance by visarga on Friday February 02, 2018 @11:27PM (#16296167)
> Letting a computer drive my car is high-risk: If there is a malfunction at 70mph, I could die!

Google can't even make GPS mapping work perfectly - it's apparent if you use it for a day. Not to mention that AI vision systems are susceptible to adversarial attacks, which means they can be hacked by external images. This paper just came out yesterday: "Breaking 7/8 of the ICLR 2018 adversarial example defenses" (https://arxiv.org/abs/1802.00420). The situation is dire.

I think they are afraid that drawing a couple of lines with a marker on a street sign might make it invisible, or turn it into another sign. They can't defend against such attacks because the neural net doesn't actually understand the world, it just observes patterns. Understanding requires causal reasoning.

Re:New reports suggest limits to autonomous vehicle performance by tziki on Saturday February 03, 2018 @12:16AM (#16296313)
>Not to mention that AI vision systems are susceptible to adversarial attacks ... The situation is dire.

That's like saying a human driver can be blinded with a bright light so the situation is dire.

New world, old rules. You'll still go to jail for manslaughter (or whatever the charge would be).

Re:New reports suggest limits to autonomous vehicle performance by kajecounterhack on Saturday February 03, 2018 @05:06AM (#16296992)
Fwiw maps used for autonomous vehicles are higher fidelity than consumer maps. Furthermore the cars are generally equipped with IMUs so that they don't get thrown off by urban canyons, clouds, etc. And more error correction (particle filters, visual cues + map data) is used to pinpoint your location on a map.

Adversarial attacks are concerning for any AI model, but autonomous vehicles aren't all AI. Lots of rules and heuristics and pre-knowledge are utilized. In the end if something is uncertain it generally amounts to "slam on the brakes" which is more a ux problem than a safety problem.

Re:New reports suggest limits to autonomous vehicle performance by Twisell on Saturday February 03, 2018 @08:28AM (#16297526)
There is no « better quality » map out there (unless maybe military and restricted).

Mapping the world is hard because it is complex and evolve way faster than a Google Car army can patrol it for a reasonable cost. More often than not OpenStreetMap which is a community project is more up to date than commercial map, but it’s not precise enough. Beside nobody would bet there life on something that is Wikipedia-like editable by ill-intentioned trolls.

This is precisely why all autonomous car rely heavily on computer vision and why adversial attacks should be carefully considered.

Uncertainty will indeed « slam on brake » but adversial attack don’t aim to generate uncertainty the aim to generate false certitudes.

Re:New reports suggest limits to autonomous vehicle performance by kajecounterhack on Sunday February 04, 2018 @02:43PM (#16304475)
Nope. There are higher fidelity maps. You should read about robotics.

It's true these maps don't exist for the whole world yet but it's also why all sdc companies are launching in metros. They're building them.

Vision is good at recognition but bad at localization. This is the real problem. In robotics a fundamental problem is SLAM. You should read about it.

Re:New reports suggest limits to autonomous vehicle performance by Twisell on Monday February 05, 2018 @03:12AM (#16307367)
Could you explicit acronyms? They seem very business specific but I would gladly learn about theses projects as I often use cartographic products for my work.
Re:New reports suggest limits to autonomous vehicle performance by Piskvorrr on Sunday February 04, 2018 @02:59AM (#16301866)
UX problem unless in traffic; getting rammed by the next car is not my idea of safety (not to mention that slamming the brakes for no apparent reason is a textbook example of reckless driving in many places). Oh well, let's just not drive unless the street is empty, I guess ;o)
Re:New reports suggest limits to autonomous vehicle performance by conception on Friday February 02, 2018 @11:34PM (#16296194)
Well map software on a phone isn't written to specs that account for liability for human life for one. Apples and oranges.
Re:New reports suggest limits to autonomous vehicle performance by jacquesm on Saturday February 03, 2018 @08:13AM (#16297480)
It should be. They're used as inputs to humans making decisions at highway speeds. Now obviously we allow this because we assume humans are intelligent enough and have enough of a model of the real world in their head that they should be able to cope with these issues but I see no reason why an AI driving a car should cross a lower bar. I fully expect that AI to take mapping errors into account and to survive them.