Pragmatic Usage of Linear Regression Models for the Prediction of User Judgments
Klaus-Peter Engelbrecht, Sebastian Möller · 2007
Automatic evaluation of spoken dialog systems has gained interest among researchers in the past years.In the PARADISE framework (Walker et al. 1997), a linear regression function is trained on a dialog corpus to predict user ratings of satisfaction from interaction parameters.The accuracy of such predictions is generally measured with R 2 , which usually is rather low.In this paper, it is shown that predictions according to PARADISE can lead to accurate test results despite the low R 2 .