A progressive transmission scheme for 3D models in VR/AR based on UEP-LT code
Yishi Liu, Yitong Liu, Hongwen Yang · 2017
Virtual reality (VR) and augmented reality (AR) applications with interactions are usually delay-sensitive. Fast delivery of three-dimensional (3-D) models in VR/AR over wireless networks has been a crucial task due to limited bandwidth and packet error. In this paper we propose an application layer content-aware joint source-channel coding scheme based on forward error correction (FEC). A 3D model is progressively encoded to a base mesh and several refinement layers consisting of connectivity and geometric data. A new design of LT code with a special coding graph has been proposed to provide unequal error protection (UEP) to these two kinds of data. Then a statistical measure is used to optimize the rate allocation for each refinement layer, which is scalable to both network bandwidth and packet loss rate (PLR). Experimental results show that the proposed streaming scheme can achieve the objectives of low transmission delay and small distortion under serious loss.