Robust markov decision processes with uncertain transition matrices
Arnab Nilim, Laurent El Ghaoui · 2004
Optimal solutions to Markov decision problems may be very sensitive with respect to the state transition probabilities. In many practical problems, the estimation of these probabilities is far from accurate. Hence, estimation errors are limiting factors in applying Markov decision processes to real-world problems.