H5 at TREC 2008 Legal Interactive: User Modeling, Assessment & Measurement
Christopher J. Hogan, Dan Brassil, Jennifer Reinhart, Misti Gerber, Teresa Jade · Text REtrieval Conference · 2008
Treating the information retrieval task as one of classification has been shown to be the most effective way to achieve high performance on a particular task. In this paper, we describe a hybrid human-computer system that addresses the problem of achieving high performance on IR tasks by systematically and replicably creating large numbers of document assessments. We demonstrate how User Modeling, Document Assessment and Measurement combine to provide a shared understanding of relevance, a means for representing that understanding to an automated system, and a mechanism for iterating and correcting such a system so as to converge on a desired result.