Why Can SVM Be Performed in PCA Transformed Space for Classification?
Jian Zhang, Liling Bo, Jia Wei Xu, Seop Hyeong Park · Advanced materials research · 2011
PCA plus SVM is a popular framework for classification problems. On the one hand, it can avoid the SVM kernel Gram to become overlarge and save storage space. On the other hand, PCA plus SVM approach has been verified effective for classification by experience. This paper focuses on building a theoretical foundation for this framework. By derivation, the equivalence relation between PCA plus SVM and LDA is discovered for binary classification. Moreover, we give a specific analysis about the framework to validate our viewpoint compared with SVM and combined SVM/LDA on ORL face database, Yale face database and real world benchmark data. The experimental results indicate that SVM can be performed in PCA transformed space for classification.