Optimal testing of structured knowledge
Michael Munie, Yoav Shoham · 2008
Adopting a decision-theoretic perspective, we investigate the problem of optimal testing of structured knowledge – the canonical example being a qualifying examination of a graduate student. The setting is characterized by several factors: examinee’s knowledge structured around several inter-dependent topics, a limited “budget ” of questions available to the examiner, a decision to be made (pass/fail), and an utility for good and bad decisions. The existence of multiple professors brings up additional issues such as committee formation, and the existence of multiple students brings up issues such as fairness. 1.