Sparse Solutions for Single Class SVMs: A Bi-Criterion Approach
Santanu Das, Nikunj C. Oza · 2011
In this paper we propose an innovative learning algorithm – a variation of One-class ν Support Vector Machines (SVMs) learning algorithm to produce sparser solutions with a much reduced computational complexity. The proposed technique returns an approximate solution, nearly as good as the solution obtained by the classical approach, by minimizing the original risk function along with a regularization term. We introduce a bi-criterion optimization that helps guide the search towards the optimal set in reduced time in comparison to the classical approach. The outcome of the proposed learning technique was compared with the benchmark one-class Support Vector machines algorithm which more often leads to solutions with redundant support vectors. Throughout the analysis, the problem size for both optimization routines was kept consistent. We have tested the proposed algorithm on a variety of data sources under different conditions to demonstrate its effectiveness. In all cases the proposed algorithm closely preserves the accuracy of standard one-class ν SVMs while reducing both training time and test time by several factors.