Self Organized Networks for Optimal Feature Extraction
Youness Aliyari Ghassabeh, Hamid Abrishami Moghaddam · 2007
In this paper, we introduced new adaptive learning algorithms and related networks to extract optimal features from multidimensional data in order to reduce the data dimensionality while preserving class separability. For this purpose, new adaptive algorithms for the computation of the square root of the inverse covariance matrix Sigma-1/2are introduced. We introduce a new cost function related to the given adaptive learning algorithms in order to prove their convergence. Self organized Sigma-1/2networks are constructed based on these algorithms. By cascading Sigma-1/2network and an adaptive principal component analysis (APCA) network, we present new adaptive self organized LDA feature extraction network. Adaptive nature of the new optimal feature extraction method makes it appropriate for on-line incremental pattern classification and machine learning applications. Both networks in the proposed structure are trained simultaneously, using a stream of input data. Existence of cost function, make it available to compute learning rate efficiently in every iteration in order to increase the convergence rate. Experimental results using synthetic multi-class multi-dimensional sequence of data, demonstrated the effectiveness of the new adaptive self organized feature extraction networks.