Modular Deep Reinforcement Learning: Enhancing Flexibility through Agent Splitting
Chong Tian, Danda B. Rawat · 2024
Deep reinforcement learning (DRL) has shown remarkable success in tackling complex tasks by learning representations directly from raw data. However, as DRL agents become increasingly sophisticated, they often face challenges in adapting to new tasks or environments due to their monolithic structure. In this paper, we prove that by decomposing the agent into modular components, we enable more efficient adaptation as well as more efficient than that of the singular DRL agent on tackling complex tasks. Overall, our work contributes to advancing the field of DRL by introducing a flexible and scalable framework for agent decomposition. By enabling the creation of modular agents, we empower DRL systems to efficiently adapt to changing environments, learn new tasks with minimal intervention, and achieve higher levels of performance and versatility.