Reinforcement Learning-Based Prescribed-Time Optimal Formation Control for Multiagent Systems
Guanglei Zhao, Zhizhong Li, Changchun Hua, Weili Ding · IEEE Transactions on Automation Science and Engineering · 2025
This paper addresses the problem of prescribed-time optimal formation control for nonlinear multi-agent systems (MAS) via reinforcement learning (RL). First, a new finite horizon performance cost function is constructed, which incorporates specified time and terminal constraints, thereby it is useful for embedding the prescribed convergence time performance into optimal control framework. Based on the cost function, RL-based optimal formation controller is subsequently devised under actor-critic structure, by incorporating terminal constraint errors into the critic update law, it ensures that the optimal value function can be approximated while satisfying terminal constraints. Then, the prescribed-time optimal formation controller is designed by integrating an adjustment function with the devised optimal formation controller, with which, the formation tracking errors are ensured to converge to the origin within specified time. The proposed approach provides some advantages such as system model information is not required, optimal performance is achieved with satisfied terminal constraints, and asymptotic rather than bounded prescribed-time formation control is achieved. Finally, the effectiveness of the proposed strategy is validated through simulation examples.