Discrete-Time, Infinite-State Markov Chains
James R. Kirkwood · 2025
This chapter extends the discussion begun in Chapter 2 by introducing discrete-time, countable-state Markov chains. Here we consider renewal processes and take another look at equilibrium states. Null recurrent and positive recurrent states are discussed. Branching processes are introduced, and a random walk in Z d is considered.