Long Term Activity Analysis in Surveillance Video Archives
Mingyu Chen · 2010
Surveillance video recording is becoming ubiquitous in daily life for public areas such as supermarkets, banks, and airports. The rate at which surveillance video is being generated has accelerated demand for machine understanding to enable better content-based search capabilities. Analyzing human activity is one of the key tasks to understand and search surveillance videos. In this thesis, we perform a comprehensive study on analyzing human activities from short term to long term and from simple to complicated activities in surveillance video achieves. A general, efficient and robust human activity recognition framework is proposed. We extract local descriptors at salient points from videos to represent human activities. The local descriptor is called Motion SIFT (MoSIFT) which explicitly augments appearance features with motion information. A quantization and classification framework then applies the descriptors to recognize activities of interest in surveillance videos. We further propose constraint-based clustering,bigram models, and soft-weighting scheme to improve the robustness and performance of the algorithm by exploring spacial and temporal relationships between local descriptors. Detection is another essential task of surveillance video analysis. The difficulty of detection lies on identify-