Kronecker PCA based spatio-temporal modeling of video for dismount classification
Kristjan H. Greenewald, Alfred O. Hero · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2014
We consider the application of KronPCA spatio-temporal modeling techniques1, 2 to the extraction of spatiotemporal features for video dismount classification. KronPCA performs a low-rank type of dimensionality reduction that is adapted to spatio-temporal data and is characterized by the T frame multiframe mean μ and covariance ∑ of p spatial features. For further regularization and improved inverse estimation, we also use the diagonally corrected KronPCA shrinkage methods we presented in.1 We apply this very general method to the modeling of the multivariate temporal behavior of HOG features extracted from pedestrian bounding boxes in video, with gender classification in a challenging dataset chosen as a specific application. The learned covariances for each class are used to extract spatiotemporal features which are then classified, achieving competitive classification performance.