Almost sure convergence of stochastic approximation algorithms with non-additive noise
George Yin, Yu Min Zhu · International Journal of Control · 1989
Stochastic approximation algorithms with non-additive noise are discussed. In studying strong convergence of such algorithms, traditionally one assumes that the iterates return to a bounded or compact set infinitely often, or that the function under consideration grows with certain rate. The usual projection algorithms require that the bounded projection region is known beforehand. It is desirable to weaken these ‘boundedness’ conditions. By introducing randomly varying truncations, Chen and Zhu (1986) achieved this for stochastic approximation algorithms with additive noise. Here, we extend their result to a more general setting.