A Spectrum Resource Sharing Algorithm for IoT Networks based on Reinforcement Learning
Zhaoyuan Shi, Xianzhong Xie, Michel Kadoch, Mohamed Cheriet · 2020
Internet of Things (IoT) has attracted tremendous interest since it can improve production efficiency and system intelligence significantly. However, with the explosive growth of various types of device and data flow, IoT suffers spectrum resource scarcity for wireless applications. In this paper, we propose a solution for spectrum resource sharing in the IoT network, with the objective to facilitate the limited spectrum sharing between different kinds of sensors. To overcome the challenges of unknown dynamic IoT environment, the deep Q-learning network (DQN) is adopted. BS acts as the single agent and centrally manages all spectrum resources. First, a new reward function is designed to drive the learning process, which takes into account the different communication requirements of various sensors. In addition, to improve the learning efficiency of DQN, we compress the action space. Finally, simulation results show that compared with other algorithms, the proposed algorithm can achieve good network performance.