Ridging methods in local polynomial regression
Burkhardt Seifert, Théo Gasser, Sanford Weisberg · Zurich Open Repository and Archive (University of Zurich) · 1998
When estimating a regression function r or its th derivative, local polynomials are an attractive choice due to their flexibility and asymptotic performance. Seifert & Gasser (1996) proposed local polynomial ridging to overcome problems of local polynomials with variance for random design while keeping their advantages. In this paper we present a data--adaptive spatial choice of the ridge parameter which outperforms our previously used rule of thumb. The main message is, however, that ridging is a powerful tool for the improvement of local polynomials, whereas the choice of the ridge parameter is not so decisive, but can improve the fit to some extent. Local polynomial ridging is related to methods of shrinking the estimator towards the origin, to adaptive order choice, and to polynomial mixing. Relations between these methods and ridging will also be discussed. The concept of ridging is not restricted to local modifications of estimators. Many penalized estimators like spline smoothe...