Visible to the public Accelerated Stochastic Gradient Method for Support Vector Machines Classification with Additive Kernel

TitleAccelerated Stochastic Gradient Method for Support Vector Machines Classification with Additive Kernel
Publication TypeConference Paper
Year of Publication2017
AuthorsWang, X., Zhou, S.
Conference Name2017 First International Conference on Electronics Instrumentation Information Systems (EIIS)
Keywordsaccelerated mini-batch stochastic gradient descent algorithm, accelerated stochastic gradient method, Acceleration, acceleration strategy, additive kernel, additive kernel version, Additives, Classification algorithms, composability, data mining, gradient approximation, gradient methods, Kernel, learning (artificial intelligence), linear classifier, machine learning, Metrics, mini-batch stochastic gradient descent, Nesterov's acceleration strategy, pattern classification, polynomials, pubcrawl, resilience, Resiliency, Stochastic processes, Support vector machines, Support vector machines (SVMs), support vector machines classification, SVM classification, Testing, Training
Abstract

Support vector machines (SVMs) have been widely used for classification in machine learning and data mining. However, SVM faces a huge challenge in large scale classification tasks. Recent progresses have enabled additive kernel version of SVM efficiently solves such large scale problems nearly as fast as a linear classifier. This paper proposes a new accelerated mini-batch stochastic gradient descent algorithm for SVM classification with additive kernel (AK-ASGD). On the one hand, the gradient is approximated by the sum of a scalar polynomial function for each feature dimension; on the other hand, Nesterov's acceleration strategy is used. The experimental results on benchmark large scale classification data sets show that our proposed algorithm can achieve higher testing accuracies and has faster convergence rate.

URLhttps://ieeexplore.ieee.org/document/8298732/
DOI10.1109/EIIS.2017.8298732
Citation Keywang_accelerated_2017