Using Heuristics to Evaluate a Computer Assisted Assessment Environment
Gavin Sim, Janet C. Read, Phil Holifield · EdMedia: World Conference on Educational Media and Technology · 2006
Focusing on the usability of the software, this paper reports the findings from an expert evaluation of a single, off the shelf, computer assisted assessment environment with an emphasis on the context in which it is being utilised. The aim of the study was to establish whether the problems differed according to the context of use, and to also establish if the provision of additional information about the assessment aided the evaluators in identifying and rating problems. The method that was used was a heuristic evaluation using eight evaluators, divided into two groups, with one group receiving additional information about the context of use. The study revealed several usability problems and conclusions highlight the fact that a number of problems were only identified in one context but could equally have applied to both. The provision of additional information about assessment did not assist the evaluators in either identifying or rating the severity of the problems.