Correlation between human assessment of essays and ROUGE evaluation of essays' summaries
Seemab Latif, Mary McGee Wood, Goran Nenadić · 2009
In this paper we have addressed the qualitative (human evaluation) and quantitative (ROUGE) evaluation of computer generated summaries of the students' essays. The experimental results show that there is a positive high correlation between ROUGE scores and human assessment of the essays (human assigned marks). We have also found out that human evaluation of the automatic summaries positively correlates with the human assessment of the essays. These correlations can be used to classify students' essays into broad bands of quality.