Re:How Adversarial Attacks Work
by yters on Friday November 03, 2017 @01:10AM
(#15616837)
CNNs are the best we have. If they can't deal with adversarial examples, then what can?
[ Parent
| on HN ]
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @01:18AM
(#15616867)
Hinton's "capsule networks", probably. Or any other future architecture which preserves positional information better.
It is a problem inherent in any ML method with large VC dimension. The model will overfit, and when it overfits, adversarial examples become possible.
The very nature of ML seems incapable of dealing with this dilemma. You either work within a very constrained domain (low VC) to ensure everything is covered, and thus are unable to fit complex datasets, or expand the domain (large VC) and thus overfit the datasets. It's the bias-variance tradeoff, and is insurmountable.
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @02:37AM
(#15617087)
Adversarial examples are no longer adversarial in any meaningful sense, when humans are fooled by them too. We don't need to surmount BV tradeoff, we need to make sure that ML models make the same tradeoffs as humans.
Evidence that humans are fooled by adversarial examples? Optical illusions and other perception issues don't count, as explained by many others in this set of threads.
Re:How Adversarial Attacks Work
by red75prime on Friday November 03, 2017 @03:16AM
(#15617215)
Camouflage. Paintings perceived as real 3d objects for a fraction of second.
You think these are equivalent to changing a single pixel and causing a complete misperception of the object which is believed with almost 100% certainty?
Re:How Adversarial Attacks Work
by red75prime on Sunday November 05, 2017 @05:38AM
(#15628906)
Single pixel attack is an artifact of the network architecture. It is not inherent vulnerability of every ML technique.