Predictive model performance
Jeonghee Yi, Ye Chen, Jie Li, Swaraj Sett, Tak W. Yan · 2013
We study the accuracy of evaluation metrics used to estimate the efficacy of predictive models. Offline evaluation metrics are indicators of the expected model performance on real data. However, in practice we often experience substantial discrepancy between the offline and online performance of the models.