Chapter 5: Method Ranking
Adam B. Levy · Society for Industrial and Applied Mathematics eBooks · 2022
So, what makes one optimization method better than another? The answer sometimes depends on the situation, as some methods are better than others in some cases but worse in other cases. One generic measuring stick of a method’s value is the time and effort it takes to produce an acceptable result. Since it’s not possible beforehand to know what degree of accuracy every practitioner will deem acceptable, it is typically required that the updated guesses become arbitrarily close to an optimizer x* (since an optimizer is the star of this show, it gets a superscript *).