Visible to the public Resilient Linear Classification: An Approach to Deal with Attacks on Training Data

TitleResilient Linear Classification: An Approach to Deal with Attacks on Training Data
Publication TypeConference Paper
Year of Publication2017
AuthorsPark, Sangdon, Weimer, James, Lee, Insup
Conference NameProceedings of the 8th International Conference on Cyber-Physical Systems
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-4965-9
KeywordsCPS Resilience, Cyber-physical systems, linear classification, pubcrawl, resilience, Resiliency, training data attacks
AbstractData-driven techniques are used in cyber-physical systems (CPS) for controlling autonomous vehicles, handling demand responses for energy management, and modeling human physiology for medical devices. These data-driven techniques extract models from training data, where their performance is often analyzed with respect to random errors in the training data. However, if the training data is maliciously altered by attackers, the effect of these attacks on the learning algorithms underpinning data-driven CPS have yet to be considered. In this paper, we analyze the resilience of classification algorithms to training data attacks. Specifically, a generic metric is proposed that is tailored to measure resilience of classification algorithms with respect to worst-case tampering of the training data. Using the metric, we show that traditional linear classification algorithms are resilient under restricted conditions. To overcome these limitations, we propose a linear classification algorithm with a majority constraint and prove that it is strictly more resilient than the traditional algorithms. Evaluations on both synthetic data and a real-world retrospective arrhythmia medical case-study show that the traditional algorithms are vulnerable to tampered training data, whereas the proposed algorithm is more resilient (as measured by worst-case tampering).
URLhttp://doi.acm.org/10.1145/3055004.3055006
DOI10.1145/3055004.3055006
Citation Keypark_resilient_2017