On-site real-time 3D match move for MR-based previsualization with relighting
Ryosuke Ichikari, Kaori Kikuchi, Wataru Toishita, Ryuhei Tenmoku, Fumihisa Shibata, Hideyuki Tamura · 2010
We are developing a previsualization method called MR-PreViz, which utilizes mixed reality technology for filmmaking [Tenmoku et al. 2006]. To determine camera-work at the shooting site, estimating camera position and posture is required. In this paper, we introduce a method for on-site real-time 3D match move and relighting for MR-PreViz. To realize the match move, we developed a computer vision-based camera tracking method using natural feature tracking. This method is based on details about the site captured in advance. The method can automatically construct a feature landmark database (LMDB) using a fiducial marker. Moreover, the result of the method enables MR-PreViz to design lighting for the site using a relighting method. To add lighting effects to the real objects, the relighting method uses reflectance properties of the real objects and LMDB.