Astera - A Generic Model for Semantic Multimodal Information Retrieval
Serwah Sabetghadam, Mihai Lupu, Andreas Rauber · 2013
Finding useful information from large multimodal document collections such as the WWW is one of the major challenges of Information Retrieval (IR). The many sources of information now available- text, images, audio, video and more- increases the need for multimodal search. Particularly important is also the recognition, that each information item is inherently multimodal (i.e. has aspects in its information character that stem from di↵erent modalities) and forms part of a networked set of related information items. In this paper we propose a graph-based model for multimodal information retrieval based on a faceted view of information objects. For retrieval purposes, we consider both relatedness and similarity relations between objects. 1