Querylog-based Assessment of Retrievability Bias in a Large Newspaper Corpus
Myriam C. Traub, Thaer Samar, Jacco van Ossenbruggen, Jiyin He, Arjen P. de Vries, Lynda Hardman · 2016
Bias in the retrieval of documents can directly influence the information access of a digital library. In the worst case, systematic favoritism for a certain type of document can render other parts of the collection invisible to users. This potential bias can be evaluated by measuring the retrievability for all documents in a collection. Previous evaluations have been performed on TREC collections using simulated query sets. The question remains, however, how representative this approach is of more realistic settings.