Initial Excitation-Based Optimal Control for Continuous-Time Linear Nonzero-Sum Games
Hongyang Li, Qinglai Wei · IEEE Transactions on Systems Man and Cybernetics Systems · 2024
In this article, the initial excitation-based optimal control methods are presented for continuous-time linear nonzero-sum games. The traditional reinforcement learning-based optimal control methods for continuous-time linear nonzero-sum games require the persistent excitation condition or data storage to guarantee the convergence of the algorithms. To relax the above conditions, the initial excitation-based policy iteration and value iteration algorithms are presented to obtain the Nash equilibrium solution under an online-verifiable initial excitation condition. The properties of the initial excitation-based policy iteration and value iteration algorithms are analyzed. Simulation examples are provided to show the efficiency of the presented methods.