Evaluating computers and their performance: Perspectives, pitfalls, and paths
Jack J. Dongarra, John Martin, Jack Worlton · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · 1987
Various considerations relating to the evaluation of computer systems and their performance are presented with particular emphasis on the issue of benchmarking. In this context, the issue of workload analysis and the subsequent justification of benchmark authenticity based on correlation to the workload is discussed as well as the need to limit variables in the analysis process. The objective has been to present a guide to some of the considerations and approaches involved in the benchmarking and performance evaluation of computers. Special attention will be given to supercomputers because of the extremely high cost associated with their development, procurement, and use as well as the urgent need of users to obtain the highest speeds possible for their computations.