Generalized Oja's rule for linear discriminant analysis with Fisher criterion
José Carlos Príncipe, Dongxin Xu, Chuan Xi Wang · 2002
Online learning rules for both principal component analysis (PCA) and linear discriminant analysis (LDA) with Fisher criterion are analyzed under the same framework, and a generalized Oja's rule for both is derived. For the LDA problem, the relationship between the Fisher criterion and the criterion of minimizing mean square error (MSE) is discussed. The experiments show that the convergence speed of the generalized Oja's rule as an adaptive method for the Fisher criterion is much faster than that of gradient descent method for the MSE criterion.