Diminished Reality using Multiple Handheld Cameras

Akihito Enomoto, Hideo Saitô · 2007

In this paper, we present a system for Diminished Reality with mul-tiple handheld camera system. In this paper, we assume a situation such that the same scene is captured with multiple handheld cam-eras, but some objects occlude the scene. In such case, we pro-pose a method for synthesizing image for each camera in which the occluding objects are diminished by the support of the different cameras that capture the same scene at the different viewpoints. In the proposed method, we use the AR-Tag marker to calibrate the multiple cameras, so that online process can be possible. By the use of AR tag, we compute homographies for between each cam-era’s imaging plane and the objective scene that is approximated as a planar in this research. The homography is used for warping the planar area for synthesizing the viewer’s image that includes only the objective scene without the occluding object that cannot be approximated as a planar area. We demonstrate that the viewer’s image without the occluding object can be synthesized for every camera on-line, even though all the cameras are freely moving for all cameras each camera that relates.

Read the paper · More papers on PaperTik