A Review of and Recommendations for Procedures Used to Evaluate the External Effectiveness of Intelligent Tutoring Systems
Peter J. Legree, Philip D. Gillis · 1991
Abstract : This report reviews and discusses intelligent tutoring system (ITS) evaluation standards and procedures. Three criteria evolved from the review and are proposed to accurately evaluate ITS product effectiveness. First, the instructional effectiveness of ITS applications, human tutors, and traditional methods needs to be compared using performance data. Second, extensive ITS applications should be used to evaluate instruction effectiveness. Third, large groups of subjects must be used for the evaluations to precisely estimate ITS effectiveness.