The Fault, Dear Researchers, is not in Cranfield, But in our Metrics, that they are Unrealistic.
Mark D. Smucker, Charles L. A. Clarke · 2012
As designers of information retrieval (IR) systems, we need some way to measure the performance of our systems. An excellent approach to take is to directly measure actual user performance either in situ or in the laboratory [12]. The