An evaluation measure for distributed information retrieval systems
Hans Friedrich Witschel, Florian Holz, Gregor Heinrich, Sven Teresniak · 2008
Abstract. This paper is concerned with the evaluation of distributed and peer-to-peer information retrieval systems. A new measure is introduced that compares results of a distributed retrieval system to those of a centralised system, fully exploiting the ranking of the latter as an indicator of gradual relevance. Problems with existing evaluation approaches are verified experimentally. 1