Embodied Composition for Imagining Robotic Sound Space
Stine S. Johansen, Yanto Browning, Anthony Brumpton, Jasper Vermeulen, Wei Win Loy, Jared W Donovan, Markus Rittenbruch · 2025
This paper presents an account of using embodied composition as an approach to engage people in imagining robotic sound space. Embodied composition entails using bodily movements to produce a sequence of sounds. Semantic-free sound can play a useful communicative role in human-robot interaction. This includes robotic consequential sounds, i.e., sounds that robots inevitably make when moving, and the sonification of this movement. We bring together these topics and present a participatory, embodied approach that enables in-person investigation of robot consequential sound and movement sonification. We present three key insights about the approach based on three consecutive studies with a total of 29 participants. First, embodied composition engages participants' imagination of robotic sounds. Second, we found that movement, similar to listening, is tied to the individual and thereby leads to features and constraints for composition. Third, we found that sound can change people's experiences of the physical presence of the robot. Our discussion highlights that designing robot sounds benefits from a dialectical interaction approach. This offers a new direction for sound in human-robot interaction, relying not just on linear and functional design, but rather on designing for sound experiences.