Stationary Distributions of a Markov Chain
Rinaldo B. Schinazi · Birkhäuser Boston eBooks · 1999
What is in this chapter? Let X n be the state of a Markov chain at time n. Assume that X0, the initial state of the chain, is distributed according to a distribution π. That is, assume that the probability that X0 is in state i is π(i). Can we find a distribution π such that if X0 has distribution π then X n , for all times n, also has distribution π? Such a distribution is said to be stationary for the chain. This chapter deals with the existence of and the convergence to stationary distributions.