Stochastic transition matrix , construction of markov chains in random environment and communicating properties
Wang Hesong · Journal of Hunan Institute of Science and Technology · 2007
The construction of the Markov chains in random environment is solved by using the stochastic transition matrix.In addition,the concepts of communicating state and strong communicating state are introduced,furthermore,the relations between them are studied.