Linguistically Valid Movement Behavior Measured Non-Invasively
Adriano Vilela Barbosa, Hani Camille Yehia, Eric Vatikiotis‐Bateson · 2008
We use optical flow to extract reliable kinematics from video for motions of the head, face, torso, and hands during speech and musical performance. Unlike dot- and marker- based measures, these markerless measures are non-invasive and require no a priori specification of measurement locations. Reliability is compared with marker tracking data and the method’s utility is demonstrated for data from Plains Cree, English, and Shona. Index Terms: optical flow, kinematics, non-invasive measures. 1. Overview Since the mid-1990’s [1], we have been keen to develop videobased tools for measuring spoken communication that would be computationally tractable, reliable, non-invasive, and not restricted to laboratory recording equipment and conditions. At that time, digital image processing was cumbersome and expensive,