A Comprehensive Framework for Defensible Testing Part I
Gregory J. Cizek · 2020
This chapter provides a rationale and explication of the two components of a comprehensive approach to defensible testing: validation of intended test score inferences; and justification of intended test score uses. It focuses on the first half of the framework: the processes and evidentiary sources for addressing the validation of intended test score inferences. Tests are useful, however, to the extent that they yield scores that are valid; that is, scores that, as accurately as possible, reflect examinees’ standing on the construct of interest. The Sources of Evidence component of the model captures all of the sources of evidence that could be brought to bear on the intended score meaning. The Sources of Evidence supporting validation of the intended inferential claim are indicated the Validation of Score Inference step. The sources of construct-relevant variation are shown in each panel in bold, capital letters; the sources of construct-irrelevant variation are shown in italics.