A survey of semantic multimedia retrieval systems
Carmelo Pino, Roberto Di Salvo · International Conference on Mathematical and Computational Methods in Science and Engineering · 2011
A growing number of research approaches are focusing on combining multimedia retrieval processing with semantics and knowledge based methods in order to achieve higher-level understanding of multimedia content. This research direction, often called semantic multimedia, combines techniques such as low-level multimedia feature extraction and common semantic representation schemes for features and concepts, thus making possible to manage query based on semantics that is a way for better supporting end user searches and result visualization in multimedia retrieval. Since low-level representations of media greatly differ from the higher level concepts associated with them, understanding the semantics of a query required a further insight in multimedia retrieval to bridge the semantic gap. In this paper we review the state-of-the-art techniques in semantic multimedia retrieval by discussing how relevant multimedia retrieval systems incorporate a semantic layer to improve the system performance. Some criticism is also expressed since the current systems lack in clustering to increase the recall and to support the reuse of multimedia material for developing new artefacts, thus envisaging novel research directions.