Guest Editorial Special Issue on Benchmarking Sampling-Based Optimization Heuristics: Methodology and Software
Thomas Bäck, Carola Doerr, Bernhard Sendhoff, Thomas Stützle · IEEE Transactions on Evolutionary Computation · 2022
Benchmarking provides an essential ground base for adequately assessing and comparing evolutionary computation methods and other optimization algorithms. It allows us to gain insights into strengths and weaknesses of different existing techniques, and consequently design more efficient optimization approaches. The need for good benchmarking practices opens up a broad range of complementary research questions, arising as a byproduct of challenges encountered when optimization methods are assessed. From the selection of representative benchmark problem instances, different algorithms, and suitable performance metrics, over efficient experimentation, to a sound evaluation of the benchmark data, these research questions lie at the core of establishing a well-designed and standardized benchmarking procedure.