Large-Small Model Collaboration in Mobile Edge Networks With Heterogeneous Computational Resources
Lu Cheng, Shuhang Zhang, Hongliang Zhang, Qingyu Liu, Boya Di, Dusit Niyato, Lingyang Song · IEEE Journal on Selected Areas in Communications · 2025
Large Artificial Intelligence Models (LAMs) possess powerful learning capabilities and are regarded as key technologies for addressing communication challenges in the future sixth-generation (6G) wireless networks. However, their massive parameters make them difficult to deploy on computation resource-constrained end nodes. Recently, large-small model collaboration has been extensively studied, but most works assume homogeneous computational resources across end nodes. This assumption neglects the heterogeneity among nodes, potentially causing significant performance degradation or even system failures due to improper resource allocation and task partitioning. To address this challenge, we propose a large-small model collaboration framework that accounts for heterogeneous computational resources and limited wireless communication bandwidth. In this proposed framework, end nodes are responsible for data collection and local inference using small models. They also cooperate with the edge server that provides large model inference and model update. We design a joint optimization strategy that considers data transmission optimization and transmission resource allocation. The primary objective of this strategy is to enhance the inference accuracy of the framework by maximizing the mean average precision (mAP). Furthermore, we derive a closed-form lower bound for the mAP of the proposed framework. Simulations based on object detection experiments demonstrate that the proposed framework significantly outperforms existing frameworks under different communication bandwidths and data scales.