Memory-efficient large-scale linear support vector machine
Abdullah Alrajeh, Akiko Takeda, Mahesan Niranjan · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2015
Stochastic gradient descent has been advanced as a computationally efficient method for large-scale problems. In classification problems, many proposed linear support vector machines are very effective. However, they assume that the data is already in memory which might be not always the case. Recent work suggests a classical method that divides such a problem into smaller blocks then solves the sub-problems iteratively. We show that a simple modification of shrinking the dataset early will produce significant saving in computation and memory. We further find that on problems larger than previously considered, our approach is able to reach solutions on top-end desktop machines while competing methods cannot.