Stochastic optimization for PCA and PLS
Raman Arora, Andrew Cotter, Karen Livescu, Nathan Srebro · 2012
We study PCA, PLS, and CCA as stochastic optimization problems, of optimizing a population objective based on a sample. We suggest several stochastic approximation (SA) methods for PCA and PLS, and investigate their empirical performance.