Facial Expression Transfer with Input-Output Temporal Restricted Boltzmann Machines
Matthew D. Zeiler, Graham W. Taylor, Leonid Sigal, Iain A. Matthews, Rob Fergus · 2011
We present a type of Temporal Restricted Boltzmann Machine that defines a prob-ability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponen-tially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved perfor-mance over several baselines modeling high-dimensional 2D and 3D data. 1