Convergence and Approximation of Regular Markov Chains
Wenqiang Zhao · Journal of Southwest University · 2010
This paper discusses the convergence and approximation in Markov chains by employing operator semigroup method. It is showed that if the Markov chains are regular,then the convergence of a sequence of transition functions is equivalent to the convergence of the corresponding resolvent functions. Furthermore,a condition on q-matrices such that their corresponding Q-functions converge is also obtained.