Learning and detecting coordinated multi-entity activities from persistent surveillance
Georgiy Levchuk, Matthew D. Jacobsen, Caitlin Furjanic, Aaron Bobick · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2013
In this paper, we present our enhanced model of multi-entity activity recognition, which operates on person and vehicle tracks, converts them into motion and interaction events, and represents activities via multiattributed role networks encoding spatial, temporal, contextual, and semantic characteristics of coordinated activities. Our model is flexible enough to capture variations of behaviors, and is used for both learning of repetitive activity patterns in semi-supervised manner, and detection of activities in data with large ambiguity and high ratio of irrelevant to relevant tracks and events. We demonstrate our models using activities captured in CLIF persistent wide area motion data collections.