Experiments of Automatic Scoring Using Generative AI in a Summary Essay Learning System
Takahiro Yamasaki, Ayako Hiramatsu · IIAI Letters on Institutional Research · 2024
We are developing an e-learning system aimed at improving Japanese language proficiency. This system focuses on the task of summarizing texts. An e-learning system designed for on-demand learning requires an automatic scoring function to provide feedback to users. This paper focuses on the scoring function using generative AI. Generative AI can be utilized in two ways: generating various patterns of correct answers and using it in the scoring process itself. When generating model answers, the user’s responses are compared to these model answers for scoring, so the method of comparison is also considered. This paper reports experimental results on the differences between these applications.