Approximation of Infinite Horizon Discounted Cost Markov Decision Processes
François Dufour, Tomás Prieto-Rumeau · Birkhäuser Boston eBooks · 2012
We deal with a discrete-time infinite horizon Markov decision process with locally compact Borel state and action spaces and possibly unbounded cost function. Based on Lipschitz continuity of the elements of the control model, we propose a state and action discretization procedure for approximating the optimal value function and an optimal policy of the original control model. We provide explicit bounds on the approximation errors. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.