Face-Responsive Interfaces: From Direct Manipulation to Perceptive Presence
Trevor J. Darrell, Konrad Tollmar, Frank R. Bentley, Neal Checka, L.-P. Morency, Ali Rahimi, Alice H. Oh · 2002
Abstract. Systems for tracking faces using computer vision have re-cently become practical for human-computer interface applications. We are developing prototype systems for face-responsive interaction, ex-ploring three different interface paradigms: direct manipulation, gaze-mediated agent dialog, and perceptually-driven remote presence. We consider the characteristics of these types of interactions, and assess the performance of our system on each application. We have found that face pose tracking is a potentially accurate means of cursor control and selec-tion, is seen by users as a natural way to guide agent dialog interaction, and can be used to create perceptually-driven presence artefacts which convey real-time awareness of a remote space. 1