Towards scalable support vector machines using squashing
Dmitry Pavlov, Darya I. Chudova, Padhraic Smyth · 2000
Support vector machines (SVMs) provide classi cation models with strong theoretical foundations as well as excellent empirical performance on a variety of applications.One of the major drawbacks of SVMs is the necessity to solve a large-scale quadratic programming problem.This paper combines likelihood-based squashing with a probabilistic formulation of SVMs, enabling fast training on squashed data sets.We reduce the problem of training the SVMs on the weighted \squashed" data to a quadratic programming problem and show that it can be solved using Platt's sequential minimal optimization (SMO) algorithm.W e compare performance of the SMO algorithm on the squashed and the full data, as well as on simple random and boosted samples of the data.Experiments on a number of datasets show that squashing allows one to speed-up training, decrease memory requirements, and obtain parameter estimates close to that of the full data.More importantly, squashing produces close to optimal classi cation accuracies.