Collaborative Virtual 3D Object Modeling for Mobile Augmented Reality Streaming Services Over 5G Networks
Gi Seok Park, Ryeong Hwan Kim, Hwangjun Song · IEEE Transactions on Mobile Computing · 2022
This paper presents a collaborative virtual 3D object modeling system for mobile augmented reality (AR) streaming services over 5G networks. The objective of the proposed system is to provide AR streaming services with low latency and high virtual object quality by effectively leveraging mobile edge cloud (MEC) and device-to-device (D2D) communication. MEC is utilized to perform computation-intensive 3D object modeling, such as virtual object slicing and mesh simplification, with abundant computing and storage resources. D2D communication is also utilized to reduce transmission delay by sharing virtual objects of interest among adjacent users. To achieve this goal, we propose a part-segment quality selection algorithm that can control the quality of each part segment and the transmission source by considering the user's network condition. In the proposed system, all elements in the AR cloud, MEC, and mobile device are technically integrated to work together seamlessly. Finally, the proposed system is fully implemented using well-known open-source frameworks, including WebGL and AR.js. The system was then examined in real wireless network environments. The experimental results demonstrate the performance of the proposed system. The proposed system outperforms conventional systems in terms of service latency and visual 3D object quality.