From Human Gesture to Synthetic Action

Michael F. Kipp · 2001

Embodied Agents are still looking for their own body language. Our eorts aim at analyzing human speakers to extract individual repertoires of gesture. We argue that TV personalities or actors are better suited for this purpose than ordinary subjects. For analysis, we propose an annotation scheme and present the tool ##### for transcoding gesture and posture. For transfer to synthetic agents, we suggest to think of gestures as categorizable in equivalence classes, a subset of which can make up an agent's nonverbal repertoire. Results of investigating dierent levels of gesture organisation and posture shifts are presented. The concept of GGroups is introduced whichishypothesized to correspond to rhetorical devices. Also, we give a brief sketchonhow these results are planned to be integrated in a multimodal generation system for presentation teams.

Read the paper · More papers on PaperTik