Results of NAEP Reading Item Automated Scoring Data Challenge (Fall 2021)
John Whitmer, Evelyn Deng, Charles Blankenship, Magdalen Beiting‐Parrish, Ting Zhang, Paul T. Bailey · 2023
This brief describes the results of a data challenge to evaluate the potential of using automated scoring techniques to score open-ended responses to reading assessment items. The purpose of the challenge was to help NAEP determine the existing capabilities, accuracy metrics, the underlying validity evidence of assigned scores, and costs and efficiencies of using automated scoring.