If Words Could Dance
Shannon Cuykendall, Ethan Soutar-Rau, Thecla Schiphorst, Steve DiPaola · 2016
The value of integrating the body and experience into technology has become an important goal in third wave HCI. One challenge in using experiential design methodologies is understanding how to transmit and apply the fullness of an experience into a computational system. We explore the relationship and meaning that can be created between kinesthetic experiences, words, and sensor data through the design of an interactive system that generates poetry from movement data. POEME (Portrayal of Ephemeral Movement Experiences) combines words into insightful, whimsical, and witty poetry that interprets one's movement. We refined our design of POEME through kinesthetically evaluating sensor data with the aid of visual analytic tools and confirmed the utility of these results through incorporating them into an effective machine learning system. Through this combination of visual analytics and kinesthetic evaluation, we contribute to the exploration of innovative design practices that both embody and evaluate movement interaction design strategies.