Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @12:36AM
(#15616730)
> the human mind is not ML
Pooling layers in CNNs throw away lots of information about spatial co-occurrence of features, which leads to a possibility of adversarial images where adversarial features are scattered all over the place and so they don't significantly affect humans' visual processing.
The conclusion should be "Human mind is not that kind of ML".
CNNs are the best we have. If they can't deal with adversarial examples, then what can?
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @01:18AM
(#15616867)
Hinton's "capsule networks", probably. Or any other future architecture which preserves positional information better.
It is a problem inherent in any ML method with large VC dimension. The model will overfit, and when it overfits, adversarial examples become possible.
The very nature of ML seems incapable of dealing with this dilemma. You either work within a very constrained domain (low VC) to ensure everything is covered, and thus are unable to fit complex datasets, or expand the domain (large VC) and thus overfit the datasets. It's the bias-variance tradeoff, and is insurmountable.
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @02:37AM
(#15617087)
Adversarial examples are no longer adversarial in any meaningful sense, when humans are fooled by them too. We don't need to surmount BV tradeoff, we need to make sure that ML models make the same tradeoffs as humans.
Evidence that humans are fooled by adversarial examples? Optical illusions and other perception issues don't count, as explained by many others in this set of threads.
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @03:16AM
(#15617215)
Camouflage. Paintings perceived as real 3d objects for a fraction of second.
You think these are equivalent to changing a single pixel and causing a complete misperception of the object which is believed with almost 100% certainty?
Re:How Adversarial Attacks Work
by red75prime on Sunday November 05, 2017 @05:38AM
(#15628906)
Single pixel attack is an artifact of the network architecture. It is not inherent vulnerability of every ML technique.
A true counter example must be similar to making me believe a car is a toaster by manipulating a single cone cell in my eye. Such a possibility is absurd, which leads me to conclude the human mind is not ML.