Optimization cultures
Manfred Gilli, Enrico Schumann · Wiley Interdisciplinary Reviews Computational Statistics · 2014
Computational optimization methods can be broadly classified into two groups: classical methods—which require and exploit specific functional forms of objective function and constraints—and heuristics. Those latter methods impose few, if any, restrictions on models, at the price of being more computationally demanding. But because of the growth of computing capacity over the last decades, those methods are now perfectly practical tools for everyday use. Yet, instead of realizing the advantages of heuristics, users still cling to classical methods. We discuss the reasons for this nonacceptance of heuristics, and argue that the choice of numerical‐optimization techniques is as much driven by the culture of the user—field of work and educational background—as by the quality of the method. In particular, we argue that many of the alleged shortcomings of heuristics could be overcome if researchers stopped treating optimization as a mathematical, exact discipline; instead, they should consider it a practical, computational tool. WIREs Comput Stat 2014, 6:352–358. doi: 10.1002/wics.1312 This article is categorized under: Algorithms and Computational Methods > Stochastic Optimization