Context model inference for large or partially observable MDPs
Christos Dimitrakakis · 2010
We describe a simple method for exact on-line inference and decision making for par-tially observable and large Markov decision processes. This is based on a closed form Bayesian update procedure for certain classes of models exhibiting a special conditional in-dependence structure, which can be used for prediction, and consequently for planning. 1.