Remote walkthrough over mobile networks using 3-D image warping and streaming
Paul G. Bao, Douglas L Gourlay · IEE Proceedings - Vision Image and Signal Processing · 2004
A mobile walkthrough environment based on 3-D superview warping and view compensation streaming is presented. In this environment, 3-D views are rendered on the remote clients using 3-D oversized reference views and compensated on a view-on-demand basis by the graphically rendered views from the server. The view compensations (hole residuals and the depth map) are coded using a layered joint source–channel coding with unequal error corrections to protect the significant packets on noisy and erasure mobile channels. The new compensated view will then serve as a reference view for the subsequent rendering on the clients. This environment enables numerous mobile virtual applications, such as remote m-gaming, remote m-design, m-learning, m-CAD/CAM, etc., scalable to different network capabilities.