A Test Cases Generation Technique Based on an Adversarial Samples Generation Algorithm for Image Classification Deep Neural Networks
Title | A Test Cases Generation Technique Based on an Adversarial Samples Generation Algorithm for Image Classification Deep Neural Networks |
Publication Type | Conference Paper |
Year of Publication | 2019 |
Authors | Huang, S., Chen, Q., Chen, Z., Chen, L., Liu, J., Yang, S. |
Conference Name | 2019 IEEE 19th International Conference on Software Quality, Reliability and Security Companion (QRS-C) |
Date Published | jul |
Keywords | adversarial samples, adversarial samples generation algorithm, artificial intelligence tasks, Classification algorithms, coverage metric, Deep Learning, DNN, Filtering, image classification, image classification deep neural networks, learning (artificial intelligence), Measurement, Metrics, metrics testing, neural nets, Neural networks, program testing, pubcrawl, Software, Software algorithms, test cases generation, test cases generation technique |
Abstract | With widely applied in various fields, deep learning (DL) is becoming the key driving force in industry. Although it has achieved great success in artificial intelligence tasks, similar to traditional software, it has defects that, once it failed, unpredictable accidents and losses would be caused. In this paper, we propose a test cases generation technique based on an adversarial samples generation algorithm for image classification deep neural networks (DNNs), which can generate a large number of good test cases for the testing of DNNs, especially in case that test cases are insufficient. We briefly introduce our method, and implement the framework. We conduct experiments on some classic DNN models and datasets. We further evaluate the test set by using a coverage metric based on states of the DNN. |
DOI | 10.1109/QRS-C.2019.00104 |
Citation Key | huang_test_2019 |
- Measurement
- test cases generation technique
- test cases generation
- Software algorithms
- Software
- pubcrawl
- program testing
- Neural networks
- neural nets
- Metrics
- metrics testing
- adversarial samples
- learning (artificial intelligence)
- image classification deep neural networks
- image classification
- Filtering
- DNN
- deep learning
- coverage metric
- Classification algorithms
- artificial intelligence tasks
- adversarial samples generation algorithm