The Markovian Case
R. Cairoli, Robert C. Dalang · Wiley series in probability and statistics · 1996
This chapter contains sections titled: Markov Chains and Superharmonic Functions Optimal Control of a Markov Chain The Special Case of a Random Walk Control and Stopping at the Time of First Visit to a Set of States Markov Structures