News for hackers. Stuff that matters.
Re:How close are we to solving vision? by eli_gottlieb on Sunday November 13, 2016 @11:58AM (#12944229)
>This is a super overblown issue. It's been shown that every machine learning algorithm is vulnerable to adversarial examples. Especially linear models, NNs are actually more resistant to it. We don't know that humans aren't vulnerable to them - no one's ever opened up a human brain and backpropagated to the inputs. Adversarial examples are astronomically unlikely to occur by chance

Generative models are only vulnerable to adversarial examples that are actually unlikely in the data distribution. They do not have patterns or filters that can be added to ordinary images to cause wild misclassifications.

The brain, as far as we know, uses generative modeling.

So yeah.

Re:How close are we to solving vision? by oifnwoivnoinvo on Sunday November 13, 2016 @12:09PM (#12944310)
"Generative models are only vulnerable to adversarial examples that are actually unlikely in the data distribution. They do not have patterns or filters that can be added to ordinary images to cause wild misclassifications."

^ Actually, you are wrong on this. See this recent paper "Universal adversarial perturbations"

https://arxiv.org/pdf/1610.08401v1.pdf

Re:How close are we to solving vision? by eli_gottlieb on Sunday November 13, 2016 @02:38PM (#12945181)
That paper deals with non-stochastic deep neural networks, and its mathematical analysis deals with discriminative classification. It doesn't deal with generative models, which model the joint probability distribution of classes and data instances rather than just taking a maximum-a-posteriori estimate from the posterior.
Re:How close are we to solving vision? by Houshalter on Sunday November 13, 2016 @05:31PM (#12946083)
We don't know that the brain uses generative models. Generative models are pretty inefficient.

Also the original adversarial examples paper found that autoencoders were just as vulnerable. I don't see why generative models wouldn't be vulnerable.

Re:How close are we to solving vision? by eli_gottlieb on Sunday November 13, 2016 @08:29PM (#12946867)
>We don't know that the brain uses generative models.

We have some fair evidence, see: http://www.fil.ion.ucl.ac.uk/~karl/A%20free%20energy%20princ...