GAIM: A C++ library for Genetic Algorithms and Island Models
Georgios Detorakis, Andrew Burton · The Journal of Open Source Software · 2019
The need for optimization is almost everywhere today, especially with the rise of deep learning approaches to AI that require searching through millions of neural network weights and at least dozens of architectural hyperparameters.Optimization problems consist of finding a maximum or minimum value of a objective function (in most practical cases, subject to a set of constraints).Depending on the inherent complexity and characteristics of the function to be optimized, there is a diverse armamentarium of ways to attack optimization problems.Methods including Linear and Nonlinear programming, Dynamic programming, Calculus of Variations, and Optimal Control have long been successfully used on smaller, traditional problems and can in some cases be completely dominant in a given area of application.