A Survey of POMDP Solution Techniques
Kevin P. Murphy · 2007
this paper, we assume all actions take one unit of discrete time at some (unspecied) time scale. If we allow actions to take variable lengths of time, we end up with a semi-Markov model; see e.g., [SPS99].