Three-Dimensional Image Information Media. A Study on Human Face Replacing in Motion Picture.
Chun Fan, Tomoharu Nagao · The Journal of The Institute of Image Information and Television Engineers · 1998
This paper describes an image processing and generating method which replaces a human face in motion pictures with another person's face. First, we set the positions of four feature points of the facial region of person A on the first frame of a motion picture M1 manually. Their positions on the following frames are determined almost automatically to obtain the three dimensional motion of person A's face. Second, the facial image of person B is extracted from a motion picture M2, and mapped to the surface of the 3-D patches pre-generated from 3-D data of person B's face. Third, for each frame in M1, the 3-D patches are transformed according to the direction of person A's face and synthesized with it to generate the frame of a synthesized motion picture M3. Finally, a post-processing is executed to make M3 natural. Algorithms of the proposed method are described with several experimental results.