Strategies for benchmarking with optimizing compilers
Tim Birus, Christine Cipriani, Dean F. Sutherland · 2003
It is pointed out that better compiler optimizations often interfere with the intended operation of certain classes of benchmarks, leading to surprising results and rendering their interpretation a most difficult task. The authors present several such optimizations and show their effects on selected benchmarks. They also offer guidelines for the creation or selection of benchmarks that facilitate the interpretation of the measurements obtained.>