Conversational Evaluation of Personalized Solutions for Adaptive Educational Systems.
Martin Labaj, Mária Bieliková · 2013
Abstract. Current educational systems offer many personalized features. But do they really help? Which personalization method is the best in given settings? Evaluating the personalization in an educational system is as important as designing the methods themselves. While many quantitative and qualitative methods have been explored previously, there are various rules and issues when performing experiments with participants – users. E.g. users should not interact with experimenters, but on the other hand, only post-session testing can be affected by maturation. We proposed a conversational evaluation approach in which we combine advantages of uncontrolled experiments with advantages of other methods. We describe a method for evaluation questions asked to the users in appropriate moments during their work in a web-based environment and its initial evaluation within ALEF adaptive learning framework. 1 Introduction and Related Work When designing and operating adaptive and personalized systems in particular, evaluation is an essential part of the process. Without knowing the performance of the personalized