Depth propagation for semi-automatic 2D to 3D conversion
Ekaterina V. Tolstaya, Petr Pohl, Michael N. Rychagov · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2015
In this paper, we present a method for temporal propagation of depth data that is available for so called key-frames through video sequence. Our method requires that full frame depth information is assigned. Our method utilizes nearest preceding and nearest following key-frames with known depth information. The propagation of depth information from two sides is essential as it allows to solve most occlusion problems correctly. Image matching is based on the coherency sensitive hashing (CSH) method and is done using image pyramids. Disclosed results are compared with temporal interpolation based on motion vectors from optical flow algorithm. The proposed algorithm keeps sharp depth edges of objects even in situations with fast motion or occlusions. It also handles well many situations, when the depth edges don’t perfectly correspond with true edges of objects.