News for hackers. Stuff that matters.
Re:Deep learning: a critical appraisal by red75prime on Sunday June 03, 2018 @02:34AM (#17218233)
Adversarially robust classifiers have interpretable gradients and feature representations [0]. The problem seems to be that the standard networks capture all the statistics there is, including surface statistical regularities and noise. It can be mitigated, though.

[0]: https://arxiv.org/abs/1805.12152

Re:Deep learning: a critical appraisal by mlthoughts2018 on Sunday June 03, 2018 @08:37AM (#17219246)
Thanks for the link!

Note that it’s not just adversarial robustness that is a problem, as the paper’s result merely with altering surface statistics with a Fourier domain filter applied to the training data already creates problems for interpreting the network’s internal representation as having any type of semantic representation of the underlying structure relevant for the task, without needing to involve the part about adversarial robustness at all.