Boosting contextual information in content-based image retrieval
Jaume Amores, Nicu Sebe, Petia I. Radeva, Theo Gevers, Arnold W. M. Smeulders · 2004
We present a new framework for characterizing and retrieving objects in cluttered scenes. This CBIR system is based on a new representation describing everyobject taking into account the local properties of its parts and their mutual spatial relations, without relying on accurate segmentation. For this purpose, a new multi-dimensional histogram is used that measures the joint distribution of local properties and relative spatial positions. Instead of using a single descriptor for all the image, we represent the image bya set of histograms covering the object from different perspectives. We integrate this representation in a whole framework which has two stages. The first one is to allow an efficient retrieval based on the geometric properties (shape) of objects in images with clutter. This is achieved byi) using a contextual descriptor that incorporates the distribution of local structures, and ii) taking a proper distance that disregards the clutter of the images. At a second stage, we introduce a more discriminative descriptor that characterizes the parts of the objects bytheir color and their local structure. By using relevant-feedback and boosting as a feature selection algorithm, the system is able to learn simultaneously the information that characterize each part of the object along with their mutual spatial relations. Results are reported on two known databases and are quantitativelycompared to other successful approaches.