A Query Language for Multimedia Content
Jonathan Mamou, Yosi Mass, Michal Shmueli-Scheuer, Benjamin Sznajder · 2007
The growing amount of digital multimedia data available today and the de-facto MPEG-7 standard for multimedia content description has lead to the requirement of a query language for multimedia content. MPEG-7 is expressed in XML and it defines descriptors of the multimedia content such as audio-visual descriptors, location and time attributes as well as other metadata such as media author, media Uri and more. While most search solutions for multimedia today are based on text annotations, having the MPEG-7 standard opens an opportunity for real multimedia content based retrieval. In this paper we propose an IR-style query language for such multimedia content based retrieval that exploits the XML representation of MPEG-7. The query language is an extension of the “XML Fragments ” query language that was originally designed as a Query-By-Example for text-only XML collections. We mainly focus on the unique characteristics of Multimedia content which needs to support similarity search query (range search and K-nearest neighbors) and queries on spatio-temporal attributes.