Experiments, quasi-experiments, and case studies: A review of empirical methods for evaluating decision support systems
Leonard Adelman · IEEE Transactions on Systems Man and Cybernetics · 1991
Developers of decision support systems (DSS) often fail to present empirical data supporting the claimed merits of their systems. Discussions with developers indicate that they often do not consider or know how to perform the required empirical evaluations. That problem is addressed by reviewing the issues inherent in using experiments, quasi-experiments, and case studies to evaluate DSSs. The discussion revolves around the issues of reliability and four types of validity: internal, construct, statistical conclusion, and external. The discussion is focused upon but not restricted to expert systems.>