A multi-agent reinforcement learning algorithm based on Stackelberg game
Cheng Chi, Zhangqing Zhu, Bo Xin, Chunlin Chen · 2017 6th Data Driven Control and Learning Systems (DDCLS) · 2017
Multi-agent reinforcement learning has been paid much attention due to its wide applications in various engineering systems. In this paper, the control problems of large-scale multi-agent systems with multiple roles are formulated into a multiplayer Stackelberg game, which provides a new perspective on cooperative issues. Then a Stackelberg Q-learning algorithm is proposed and knowledge transfer is applied to improve the efficiency of the learning process. Finally the proposed algorithm is applied to cognitive radio networks. Simulation results indicate that the Stackelberg Q-learning algorithm can efficiently promote the utility of the agents in the system, and significantly reduce the interference caused by the jammer.