Evaluation Resources for Concept-based Cross-Lingual Information Retrieval in the Medical Domain
Paul Buitelaar, Diana Steffen, Martin Volk, Dominic Widdows, Bogdan Sacaleanu, Špela Vintar, Stanley Peters, Hans Uszkoreit · 2004
The paper describes evaluation resources for concept-based, cross-lingual information retrieval in the medical domain.All resources were constructed in the context of the MuchMore project and are freely available through the project website.Available resources include: a bilingual, parallel document collection of German and English medical scientific abstracts, a set of queries and corresponding relevance assessments, two manually disambiguated test sets for semantic annotation (sense disambiguation), two evaluation lists for German morphological decomposition of medical terms. MuchMoreThe evaluation resources described in this paper were all constructed in the context of the MuchMore project 1 on concept-based, cross-lingual information retrieval (CLIR).The project provided a framework for integrating and refining existing technologies and developing new approaches to CLIR for the medical domain.For this purpose, the project pursued the following aims:• Integrated and effective combination of different approaches and heterogeneous resources for crosslingual information access and management, including performance and user evaluation for realistic information access tasks.• Automated acquisition of domain-specific linguistic resources and effective use of multilingual concept hierarchies.• Demonstration of a cross-lingual information access prototype system for the medical domain, that provides access to multilingual information on the basis of a combined use of corpus analysis and (domain-specific) ontologies and thesauri.