How good is bad weather?
Daniel Fullmer, Vasu Chetty, Sean C. Warnick · 2014
Accurately identifying key parameters in complex systems demands sufficient excitation, so that the resulting data will be informative enough to reveal hidden parameter values. In many situations, however, users choose inputs that attempt to optimize the system response, not necessarily those that yield more informative data. This leads to the classic trade-off between exploitation and exploration in learning problems.