News for hackers. Stuff that matters.
Re:How Adversarial Attacks Work by yters on Thursday November 02, 2017 @03:57PM (#15613693)
In order for optical illusions to be a counter example, I must believe those lines are not parallel with near certainty. While I perceive them as such, I don't believe they are. The fact that I can know my perception does not match reality is what gives optical illusions their novelty. Thus, the very nature of optical illusions makes them not a counter example.

A true counter example must be similar to making me believe a car is a toaster by manipulating a single cone cell in my eye. Such a possibility is absurd, which leads me to conclude the human mind is not ML.

Re:How Adversarial Attacks Work by red75prime on Friday November 03, 2017 @12:36AM (#15616730)
> the human mind is not ML

Pooling layers in CNNs throw away lots of information about spatial co-occurrence of features, which leads to a possibility of adversarial images where adversarial features are scattered all over the place and so they don't significantly affect humans' visual processing.

The conclusion should be "Human mind is not that kind of ML".

Re:How Adversarial Attacks Work by yters on Friday November 03, 2017 @01:10AM (#15616837)
CNNs are the best we have. If they can't deal with adversarial examples, then what can?
Re:How Adversarial Attacks Work by red75prime on Friday November 03, 2017 @01:18AM (#15616867)
Hinton's "capsule networks", probably. Or any other future architecture which preserves positional information better.
Re:How Adversarial Attacks Work by yters on Friday November 03, 2017 @01:33AM (#15616900)
It is a problem inherent in any ML method with large VC dimension. The model will overfit, and when it overfits, adversarial examples become possible.

The very nature of ML seems incapable of dealing with this dilemma. You either work within a very constrained domain (low VC) to ensure everything is covered, and thus are unable to fit complex datasets, or expand the domain (large VC) and thus overfit the datasets. It's the bias-variance tradeoff, and is insurmountable.

Re:How Adversarial Attacks Work by red75prime on Friday November 03, 2017 @02:37AM (#15617087)
Adversarial examples are no longer adversarial in any meaningful sense, when humans are fooled by them too. We don't need to surmount BV tradeoff, we need to make sure that ML models make the same tradeoffs as humans.
Re:How Adversarial Attacks Work by yters on Friday November 03, 2017 @02:49AM (#15617128)
Evidence that humans are fooled by adversarial examples? Optical illusions and other perception issues don't count, as explained by many others in this set of threads.
Re:How Adversarial Attacks Work by red75prime on Friday November 03, 2017 @03:16AM (#15617215)
Camouflage. Paintings perceived as real 3d objects for a fraction of second.
Re:How Adversarial Attacks Work by yters on Friday November 03, 2017 @06:36PM (#15622649)
You think these are equivalent to changing a single pixel and causing a complete misperception of the object which is believed with almost 100% certainty?
Re:How Adversarial Attacks Work by red75prime on Sunday November 05, 2017 @05:38AM (#15628906)
Single pixel attack is an artifact of the network architecture. It is not inherent vulnerability of every ML technique.