Re:Audio Adversarial Examples
by ttul on Tuesday January 30, 2018 @01:15PM
(#16267474)
I can’t wait to try this on my friend’s Google phone.
[ Parent
| on HN ]
It won't work on google phone right now, from the paper: "The audio adversarial examples we construct in this paper do not remain adversarial after being played over-the-air, and therefore present a limited real-world threat; however, just as the initial work on image-based adversarial examples did not consider the physical channel and only later was it shown to be possible, we believe further work will be able to produce audio adversarial examples that are effective over-the-air."
However prior work [1] was shown to work on google phones, it is just much more noticeable.
Re:Audio Adversarial Examples
by Ar-Curunir on Wednesday January 31, 2018 @01:30AM
(#16271944)
Just so you know, Nick Carlini was also on that prior work.
I believe this requires the attacker to have access to the ASR neural net's weights, so Mozilla's seems like the only popular framework that's vulnerable right now (not that I'm opposed to them keeping things open).
This is exactly why we need to keep ASR tech open. These kinds of issues affect DNNs in general, and other ASR engines based on them are also vulnerable. Having models and the data used to train them open is a great way to help academia make progress in this space.
Adversarial examples don’t actually have to be generated with the same neural network. If you want to attack another NN, you can make your own with similar training data and similar structure and the attacks can carry over to some extent.