Approximate Planning for Factored POMDPs
Zhengzhu Feng, Eric A. Hansen · 2014
We describe an approximate dynamic programming al-gorithm for partially observable Markov decision pro-cesses represented in factored form. Two complemen-tary forms of approximation are used to simplify a piecewise linear and convex value function, where each linear facet of the function is represented compactly by an algebraic decision diagram. ln one form of approxi-mation, the degree of state abstraction is increased by aggregating states with similar values. In the second form of approximation, the value function is simplified by removing linear facets that contribute marginally to value. We derive an error bound that applies to both forms of approximation. Experimental results show that this approach improves the performance of dynamic programming and extends the range of problems it can solve.