Overview of the NTCIR-16 Unbiased Learning to Rank Evaluation (ULTRE) Task
Yurou Zhao, Zechun Niu, Feng Wang, Jiaxin Mao, Qingyao Ai, TAO YANG, Junqi Zhang, Yiqun Liu · Institutional Repositories DataBase (IRDB) · 2022
In this paper, we present an overview of the NTCIR-16 Unbiased Learning to Rank (ULTRE) task. The ULTRE task is motivated by the ongoing development of Unbiased Learning to Rank research, consisting of two subtasks: offline ULTR and online ULTR. In the overview, we introduce the dataset , simulation method and evaluation protocols of ULTRE, and report the official evaluation results of the received runs.