Title | Stochastic Substitute Training: A Gray-box Approach to Craft Adversarial Examples Against Gradient Obfuscation Defenses |
Publication Type | Conference Paper |
Year of Publication | 2018 |
Authors | Hashemi, Mohammad, Cusack, Greg, Keller, Eric |
Conference Name | Proceedings of the 11th ACM Workshop on Artificial Intelligence and Security |
Publisher | ACM |
Conference Location | New York, NY, USA |
ISBN Number | 978-1-4503-6004-3 |
Keywords | adversarial example, composability, gradients obfuscation, gray-box attack, Metrics, pubcrawl, resilience, substitute training, White Box Security |
Abstract | It has been shown that adversaries can craft example inputs to neural networks which are similar to legitimate inputs but have been created to purposely cause the neural network to misclassify the input. These adversarial examples are crafted, for example, by calculating gradients of a carefully defined loss function with respect to the input. As a countermeasure, some researchers have tried to design robust models by blocking or obfuscating gradients, even in white-box settings. Another line of research proposes introducing a separate detector to attempt to detect adversarial examples. This approach also makes use of gradient obfuscation techniques, for example, to prevent the adversary from trying to fool the detector. In this paper, we introduce stochastic substitute training, a gray-box approach that can craft adversarial examples for defenses which obfuscate gradients. For those defenses that have tried to make models more robust, with our technique, an adversary can craft adversarial examples with no knowledge of the defense. For defenses that attempt to detect the adversarial examples, with our technique, an adversary only needs very limited information about the defense to craft adversarial examples. We demonstrate our technique by applying it against two defenses which make models more robust and two defenses which detect adversarial examples. |
URL | http://doi.acm.org/10.1145/3270101.3270111 |
DOI | 10.1145/3270101.3270111 |
Citation Key | hashemi_stochastic_2018 |