We Write Automated Scoring
Kausalai Kay Wijekumar, Debra McKeown, Shuai Zhang, Pui‐Wa Lei, Nikolaus Hruska, Pablo N. Pirnay-Dummer · 2024
This chapter describes an approach to developing and testing a novel automated scoring model that leveraged ChatGPT to evaluate upper elementary-grade persuasive writing within the context of an efficacy evaluation of the We Write intervention. In addition to describing this scoring approach, this chapter presents results comparing the performance of ChatGPT and human scores. The chapter concludes with a discussion of findings and directions for future research related to the application of ChatGPT and large language models to the automated scoring of writing.