THE INTELLIGENT TUTORING SYSTEM AS A TRAINING INTERVENTION: IMPLEMENTING ITSs IN INDUSTRY
D. S JOHNSON, Kalen F. Pieper · Cybernetics & Systems · 1995
Intelligent tutoring systems (ITSs) have great potential for addressing training needs, especially in situations requiring sophisticated simulation equipment and/or where too few experts are available to conduct training. However, little attention has been given lo the evaluation of ITSs. Furthermore, evaluations have been primarily formative in nature, examining the system's architecture (internal evaluation) and how the system affects students' problem-solving processes (external evaluation) during system development. However, as the focus shifts to implementing ITSs in industry as training tools, summative evaluations are increasingly important, focusing on how well the system covers the training content, trainee reactions to the system, the transfer of knowledge and skills acquired from the ITS to the actual job setting, and other organizational outcomes. We propose guidelines for assessing ITS effectiveness as training interventions and discuss the extent to which ITSs possess unique characteristics that require modifying traditional evaluation procedures.