Estimation of Over-Parameterized Models from an Auto-Modeling Perspective
Yiran Jiang, Chuanhai Liu · Journal of the American Statistical Association · 2025
From a model-building perspective, we propose a paradigm shift for fitting over-parameterized models. Philosophically, the mindset is to fit models to future observations rather than to the observed sample. Technically, given an imputation method to generate future observations, we fit over-parameterized models to these future observations by optimizing an approximation of the desired expected loss function based on its sample counterpart and an adaptive duality function. The required imputation method is also developed using the same estimation technique with an adaptive m-out-of-n bootstrap approach. We illustrate its applications with the many-normal-means problem, n