Recursive self-tuning control of finite Markov chains
Vivek S. Borkar · Applicationes Mathematicae · 1997
A recursive self-tuning control scheme for finite Markov chains is proposed wherein the unknown parameter is estimated by a stochastic approximation scheme for maximizing the log-likelihood function and the control is obtained via a relative value iterati