Re:Adversarial image attacks are no joke
by ineedasername on Monday November 29, 2021 @08:24PM
(#29387645)
I just meant it as an example where a large group of humans will follow what a computer tells them even when it is pretty clearly wrong. It's not hard to conceive of possibilities where the danger wouldn't be obvious until after person blindly follows the instructions.
Re:Adversarial image attacks are no joke
by google234123 on Monday November 29, 2021 @09:20PM
(#29388083)
> A human would be like “wait, I think I saw a cyclist, slow down and figure out what this really was”.
This explains why there are only 5.25 million car accidents a year in the US.
Re:Adversarial image attacks are no joke
by littlestymaar on Tuesday November 30, 2021 @04:06AM
(#29390304)
Most of them being benign collisions though. “Only” 34k of them are fatal. For like 270M vehicle in circulation.
I don't know how many automated vehicle Uber has, but with one killed already the ratio is a few orders of magnitude worse for their automated vehicle than for the average driver in the US. (probably even way worse than the average drunk driver actually)
This common sense of danger is what IAs must have before we can trust them on the streets.
For instance in the Uber fatal crash: the IA correctly labelled the cyclist as a cyclist several times then revised its judgment, then definetely labelled it as a cyclist but “oops too late”. A human would be like “wait, I think I saw a cyclist, slow down and figure out what this really was”. Obviously with the current computer vision technology you cannot do that, otherwise your car would be afraid of everything and refuse to even start, because there's way too much mislabelling happening at some point or another.