Markov decision processes and regular events
Costas Courcoubetis, Mihalis Yannakakis · IEEE Transactions on Automatic Control · 1998
Desirable properties of the infinite histories of a finite-state Markov decision process are specified in terms of a finite number of events represented as /spl omega/-regular sets. An infinite history of the process produces a reward which depends on the properties it satisfies. The authors investigate the existence of optimal policies and provide algorithms for the construction of such policies.