An overview of free viewpoint depth-image-based rendering (DIBR)
Wenxiu Sun, Lingfeng Xu, Oscar C. Au, Sung Him Chui, Chun Wing Kwok · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 2010
3D Video has caught enormous attention in consumer market due to the progress in technical maturity of 3D displays, digital video broadcasts and computer vision algorithms. Video-plus-depth representation makes the concept of free viewpoint video feasible allowing the user to freely navigate within real world visual scenes. In this paper, we review the existing methodologies and 3D video processing framework. Previous image-based rendering techniques can be classified into three categories according to the amount of geometric information being used, of which DIBR combines the advantages of the two extremes (geometry based and image based representations). We then discuss the techniques for depth map creation, the method for rendering given the depth information and post-processing for corresponding artifacts in the multi-view adaptation. We also issue the quality measurement of the generated depth and synthesized view. In respect to the clear demand from industry and user side for such new types of visual media, there is still a large improving room in the 3D data representation and rendering quality of 3D perception.