Transforming 6G Mobile Edge Intelligence With Large Models

Xiaoming He, Yunzhe Jiang, Yinqiu Liu, Huajun Cui, Heng Pan, Yingchi Mao · IEEE Network · 2025

Large models (LMs) exhibit transformative power in 6G Mobile-Edge Intelligence (MEI) scenarios, which can effectively address key challenges regarding network complexity, resource optimization, intelligent decision-making, and user experience. In this article, we first introduce the basics of LM and explain the potential applications and existing solutions for integrating LMs into 6G MEI. Afterward, we conduct a case study oriented to LM-assisted 6G MEI scenarios, focusing on how to use LMs to predict the size of traffic. Specifically, we employ two attention modules named Dartboard Spatial Multi-head Self-Attention (DS-MSA) and Causal Temporal Multi-head Self-Attention (CT-MSA) to extract spatio-temporal features. A Large Language Model (LLM) named GPT- 2 is utilized as the backbone model. To fit time-series data, the original token encoding layer is replaced by the convolutional encoding layer. Additionally, to handle multi-scale temporal information, we adopt an additional temporal encoding layer. During training, the majority of the pre-trained parameters are frozen, with only the input/output layers and the fully connected layer involved in parameter updates. The simulation results demonstrate that, compared to the traditional AI-based baselines, the proposed LM-based framework acquires a lower training loss and converges faster. Moreover, it achieves better prediction accuracy with less resource consumption.

Read the paper · More papers on PaperTik