Intelligent Tutoring Systems: A Taxonomy of Evaluation Issues
Kurt W. Steuck, J. L. Fleming · 1990
Abstract : This paper posits a taxonomy for categorizing issues that arise in the evaluation of Intelligent Tutoring Systems (ITSs). The taxonomy has three dimensions: Life Cycle of Evaluation, Research Issues, and Methodological Issues. The Life Cycle dimension has four levels: pre-experimental, laboratory study, field study, and initial operational test and evaluation. The three levels of the Research Issues dimension--functionality, effectiveness, and cost- -are subsequently further divided into several sublevels. The Methodological Issues dimension is discussed in the context of each of the Research Issues levels. A recommendation from this work is that ITS evaluation studies should adopt multi-dimensional, multi-method designs.