The mimic game
Nicolas Stoiber, O. Aubault, Renaud Séguier, Gaspard Breton · 2010
We present an interactive animated agent system that mimics the facial expressions of a person facing a webcam. Related studies have pursued the same objective from a retargeting perspective, by capturing the facial deformations of a source face to apply them on a virtual character one frame at a time. Our system differs from these approaches in that it works at the semantic level, and not the morphological one. The system first captures the current facial configuration of the user and recognizes his expressive state. The agent then autonomously produces a facial expression based on the identified state, using its own deformation and dynamic characteristics. This behavior is therefore referred to as mimicking instead of retargeting or cloning. Rigid head movements are also captured and mimicked by the agent.