Behavior recognition using cognitive swarms and fuzzy graphs
Swarup S. Medasani, Y. Owechko · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2007
Behavior analysis deals with understanding and parsing a video sequence to generate a high-level description of object actions and inter-object interactions. In this paper, we describe a behavior recognition system that can model and detect spatio-temporal interactions between detected entities in a visual scene by using ideas from swarm optimization, fuzzy graphs, and object recognition. Extensions of Particle Swarm Optimization based approaches for object recognition are first used to detect entities in video scenes. Our hierarchical generic event detection scheme uses fuzzy graphical models for representing the spatial associations as well as the temporal dynamics of the discovered scene entities. The spatial and temporal attributes of associated objects and groups of objects are handled in separate layers in the hierarchy. We also describe a new behavior specification language that helps the user analyst easily describe the event that needs to be detected using either simple linguistic queries or graphical queries. Our experimental results show that the approach is promising for detecting complex behaviors.