A server for automated performance analysis of benchmarking data
Hans Detlef Mittelmann, Armin Pruessner · Optimization methods & software · 2006
As part of Performance World, we describe an automation server (PAVER: http://www.gamsworld.org/performance/paver ) to help facilitate reproducible performance analysis of benchmarking data for optimization software. Although PAVER does not solve optimization problems, it automates the task of performance data analysis and visualization, taking into account various performance metrics. These include not only robustness and efficiency, but also quality of solution. This paper discusses the tools and the performance metrics used, as well as the design of the server. We give examples of performance data analysis using an instance of the COPS test case for nonlinear programming to illustrate the features of the server.