Towards large scale automated algorithm design by integrating modular benchmarking frameworks
Amine Aziz-Alaoui, Carola Doerr, Johann Dreo · Proceedings of the Genetic and Evolutionary Computation Conference Companion · 2021
We present a first proof-of-concept use-case that demonstrates the efficiency of interfacing the algorithm framework ParadisEO with the automated algorithm configuration tool irace and the experimental platform IOHprofiler. By combing these three tools, we obtain a powerful benchmarking environment that allows us to systematically analyze large classes of algorithms on complex benchmark problems. Key advantages of our pipeline are fast evaluation times, the possibility to generate rich data sets to support the analysis of the algorithms, and a standardized interface that can be used to benchmark very broad classes of sampling-based optimization heuristics.