VORTEX: video retrieval and tracking from compressed multimedia databases: affine transformation and occlusion invariant tracking from MPEG-2 video
Dan Schonfeld, Dan Lelescu · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 1998
In this paper, we present topics related to tracking of video objects in compressed video databases, within the context of video retrieval applications. We developed a video retrieval and tracking system (VORTEX), to enable operation directly on compressed video data. The structure of the video compression standards is exploited in order to avoid the costly decompression operation. This is achieved by utilizing motion compensation - a critical prediction filter embedded in video compression standards - to eliminate and interpolate the desired method for template matching. Occlusion analysis, filtering and motion analysis are used to implement fast tracking of objects of interest on the compressed video data. Being presented with a query in the form of template images of objects, the system operates on the compressed video in order to find the images or video sequences, where those objects are present and their positions are in the image. This enables the retrieval and display of the query-relevant sequences.