Supportive evaluation methodology: a method to facilitate system development
DAVE ROBINSON, Mike Fitter · Behaviour and Information Technology · 1992
This paper presents an overview of the ‘supportive evaluation methodology’, a method of facilitating system development in the health care domain. Supportive evaluation methodology has a number of defining characteristics. Firstly, it is a formative evaluation whose primary aim is to support and improve the development of a prototype system. Secondly, it is an iterative process providing rapid feedback to designers. Thirdly, ‘human factors’ issues such as functionality, usability, and clinical and social impact are the primary focus of the evaluation. Finally, the evaluation is carried out by a team independent of the designers of the prototype. The complete supportive evaluation methodology involves iterative cycles in which requirements are analysed, designs put forward and prototypes developed. The prototypes are then assessed in order to refine the requirements and designs. A key element in the methodology is the ‘formative assessment workshop’ in which potential users test the systems in simulations of their usual environment. Role playing is often used to simulate doctor-patient interactions. Users responses to the systems are analysed through observations, questionnaires and group discussions. The contexts in which the methodology has been used and our experiences in applying it are described.