Zero-Sum Game Based Secure Tracking Control of UAV Against FDI Attacks Using Fixed-Time Convergent Reinforcement Learning
Zhenyu Gong, Feisheng Yang, Dongrui Wu · 2023
In this paper, a fixed-time convergent reinforcement learning (RL) algorithm is developed to realize the secure tracking control of the unmanned aerial vehicle (UAV) via the zero-sum game for the first time. To mitigate FDI attack on actuators that may cause the UAV to deviate from the reference trajectory, a zero-sum differential game framework is built in which the secure controller tries to minimize the common performance function, yet the attacker plays a contrary role. Obtaining the optimal secure tracking controller depends on solving the Hamilton-Jacobi-Isaacs (HJI) equation related to the zero-sum game. Therefore, a critic-only online RL algorithm is proposed that can converge in a fixed time interval, with the corresponding convergence proof provided. A simulation example is given to show the effectiveness of the raised method.