Dimension-Free Estimators of Gradients of Functions with(out) Non-Independent Variables
Matieyendou Lamboni · Axioms · 2025
This study proposes a unified stochastic framework for approximating and computing the gradient of every smooth function evaluated at non-independent variables, using ℓp-spherical distributions on Rd with d,p≥1. The upper-bounds of the bias of the gradient surrogates do not suffer from the curse of dimensionality for any p≥1. Additionally, the mean squared errors (MSEs) of the gradient estimators are bounded by K0N−1d for any p∈[1,2], and by K1N−1d2/p when 2≤p≪d with N the sample size and K0,K1 some constants. Taking max2,log(d)