Experiments on Metaheuristics: Methodological Overview and Open Issues
Marco Chiarandini, Luís Paquete, Mike Preuß, Enda Ridge · 2007
Metaheuristics are a wide class of solution methods that have been successfully applied to many optimization problems. The assessment of these methods is commonly based on experimental analysis but the lack of a methodology in these analyses limits the scientific value of their results. In this paper we formalize different scenarios for the analysis and comparison of metaheuristics by experimentation. For each scenario we give pointers to the existing statistical methodology for carrying out a sound analysis. Finally, we provide a set of open issues and further research directions.