Criteria, Challenges and Opportunities for Gesture Programming Languages
Lode Hoste, Beat Signer · 2014
An increasing number of today’s consumer devices such as mobile phones or tablet computers are equipped with various sensors. The extraction of useful information such as ges-tures from sensor-generated data based on mainstream im-perative languages is a notoriously difficult task. Over the last few years, a number of domain-specific programming languages have been proposed to ease the development of gesture detection. Most of these languages have adopted a declarative approach allowing programmers to describe their gestures rather than having to manually maintain a history of event data and intermediate gesture results. While these declarative languages represent a clear advancement in ges-ture detection, a number of issues are still unresolved. In this paper we present relevant criteria for gesture detection and provide an initial classification of existing solutions based on these criteria in order to foster a discussion and identify op-portunities for future gesture programming languages. Author Keywords Gesture language; multimodal interaction; declarative