Diminished reality in textureless scenes
Yuka Namboku, Hiroki Takahashi · 2020
Diminished Reality (DR), which removes real objects visually, is expected in various scenes. It is, however, difficult to remove an object in some scenes with textureless backgrounds. One of its main factors is the difficulty of estimating geometric information using feature-point-based approaches. This paper, therefore, proposes a method to realize DR in textureless scenes based on feature lines. Missing backgrounds are filled with each of divided background planes based on geometric information. The background is divided by boundaries of the background planes obtained by using Line Segment Detector (LSD), Hough transformation and the condition for concurrency of three straight lines. A removal object is tracked by feature point matching. Missing backgrounds are filled by using image inpainting only in the first frame. In the second frame and after, removal regions obtained by projecting background boundaries are overlaid by the complemented background image. Proposed approach achieves removing an object in textureless scenes.