Overview of the NTCIR-11 MobileClick Task.
Makoto P. Kato, Matthew Ekstrand-Abueg, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto, Mayu Iwata · NTCIR · 2014
In these equations, rel(i) is the number of GiUnits found within ranks [1, i], R is the total number of GiUnits, and is a patience parameter which we set to 1 following established standards [6]. Q-measure is a recall-based graded-relevance metric, while nDCG is a rank-based graded-relevance metric. Thus, we expect that using both metrics will enable us to measure the performance from different perspectives. Moreover, both of them were shown to be reliable [7].