Visible to the public Comparative Study of Outlier Detection Algorithms for Machine Learning

TitleComparative Study of Outlier Detection Algorithms for Machine Learning
Publication TypeConference Paper
Year of Publication2018
AuthorsNazari, Zahra, Yu, Seong-Mi, Kang, Dongshik, Kawachi, Yousuke
Conference NameProceedings of the 2018 2Nd International Conference on Deep Learning Technologies
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-6473-7
Keywordscomposability, machine learning, Metrics, Outlier detection, pubcrawl, Resiliency, Support vector machines
AbstractOutliers are unusual data points which are inconsistent with other observations. Human error, mechanical faults, fraudulent behavior, instrument error, and changes in the environment are some reasons to arise outliers. Several types of outlier detection algorithms are developed and a number of surveys and overviews are performed to distinguish their advantages and disadvantages. Multivariate outlier detection algorithms are widely used among other types, therefore we concentrate on this type. In this work a comparison between effects of multivariate outlier detection algorithms on machine learning problems is performed. For this purpose, three multivariate outlier detection algorithms namely distance based, statistical based and clustering based are evaluated. Benchmark datasets of Heart disease, Breast cancer and Liver disorder are used for the experiments. To identify the effectiveness of mentioned algorithms, the above datasets are classified by Support Vector Machines (SVM) before and after outlier detection. Finally a comparative review is performed to distinguish the advantages and disadvantages of each algorithm and their respective effects on accuracy of SVM classifiers.
URLhttp://doi.acm.org/10.1145/3234804.3234817
DOI10.1145/3234804.3234817
Citation Keynazari_comparative_2018