Object tracking and video event recognition with Fuzzy Semantic Petri Nets
Piotr Szwed, Mateusz Komorkiewicz · 2013
Abstract—Automated recognition of video events is an impor-tant research area in computer vision having many potential applications, e.g. intelligent video surveillance systems or video indexing engines. In this paper we describe components of an event recognition system building up a full processing chain from low-level features extraction to high-level semantic information on detected events. It is comprised of three components: object detection and tracking algorithms, a fuzzy ontology and Fuzzy Semantic Petri Nets (FSPN), a formalism that can be used to spec-ify events and to reason on their occurrence. FSPN are Petri nets coupled with an underlying fuzzy ontology. The ontology stores assertions (facts) concerning object classification and detected relations being an abstraction of the information originating from object tracking algorithms. Fuzzy predicates querying the ontology are used in Petri net transitions guards. Places in FSPN represent scenario steps. Tokens carry information on objects participating in an event and have weights expressing likelihood of an event’s step occurrence. Introduced fuzziness allow to cope with imprecise information delivered by image analysis algo-rithms. We describe the architecture of video event recognition system and show examples of successfully recognized events. Index Terms—video events, surveillance, fuzzy Petri Nets, fuzzy ontology