A Brouwer fixed-point mapping approach to communicating Markov decision processes
Paul J. Schweitzer · Journal of Mathematical Analysis and Applications · 1987
The solvability of the functional equations of communicating Markov decision processes is demonstrated by an elementary application of the Brouwer fixed-point mapping theorem. The technical assumptions include finite state space and finite or compact action spaces.