Evaluating expertise recommendations
David W. McDonald · 2001
Finding a person who has the experience to solve a specific precif is an imporKRI application ofr1SSWRI-1W systems to a difficultorcultRA1AWAR pr11Rr Pr11 systems have made attempts to implement solutions to thisprsRDAK but few systems haveunderC12 systematicuser evaluation. This wor descrDWA a systematic evaluation of theExperWAW Recommender (ER), a system thatrtRAKAC1R people who ar likely to haveexper1Ain a specific prcific ER and the or2-1CRICCW11 contextfor which it was designedar descredR toprAA2R a basisfor underDM-2RIC this evaluation.Pral t o conducting the evaluation, a baselineexpereRA2 showed that peoplear rpleRWKSgood at judging coworRD1- experRD when given an appr1RIM2W context. This finding prdingR a way to demonstrKW the effectiveness of ER bycompar-R ER's per-1MRIMK torRAAMM by coworARIM The evaluation, the design, andrdR2SW ar descrSRI in detail. ThereRDMD suggest that the parDMARIM-W agr with therRAKWAKRIM-W11 made by ER, and that ER significantly outpercant other experrc rperrcan systems when compared using similar metrics.