Precise and Efficient Retrieval of Captioned Images: The MARIE Project.
Neil C. Rowe · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · 1999
THEMARIE PROJECT HAS EXPLORED knowledge-based information retrieval of captioned images of the kind found in picture libraries and on the Internet.It exploits the idea that images are easier to understand with context, especially descriptive text near them, but it also does image analysis.The MARIE approach has five parts: ( 1 ) find the images and captions;(2) parse and interpret the captions; ( 3 )segment the images into regions of homogeneous characteristics and classify them; (4) correlate caption interpretation with image interpretation using the idea of focus; and (5) optimize query execution at run time.MARIE emphasizes domainindependent methods for portability at the expense of some performance, although some domain specification is still required.Experiments show MARIE prototypes are more accurate than simpler methods, although the task is very challenging and more work is needed.Its processing is illustrated in detail on part of an Internet World Wide Web page.