Adaptive dynamic programming algorithm for discrete-time systems with ∈-error bound and discount factor in the performance cost
Ning Jin, Derong Liu, Yingying Ma · 2009
In this paper, we present our work on dynamic programming, which is referred as epsi-adaptive dynamic programming, for discrete-time system with discount factor 0epsi*, is obtained to approximate the optimal controller. The optimal controller muepsi* can always control the state to approach the equilibrium state, while the performance cost is close to the biggest lower bound of all performance costs within an error according to epsi. An algorithm for finding the optimal controller is developed and numerical experiments are given to illustrate the performance of the algorithm.