Dance Movement and Sound Cross-Correlation; Synthesis Parameters on the Micro and Meso Musical Time Scales
Aleksandar Koruga, Koray Tahıroğlu · 2024
The sonification of dance movements is a dynamic area of research in the experience of interaction with sound, focusing on modulating sound synthesis within a complex relationship between human movement, technology and auditory domains. This paper introduces our method for constructing a parameter space for the sonification of dance movement, which includes correlations between real time data received from different body parts, timepoints referenced to Mel-frequency cepstral coefficient (MFCC) feature extraction, and phase vocoder index points related to movement energy. Our approach facilitates for a nuanced and dynamic interaction between dance movements and sound. We further discuss the parameter space and its impact on sound synthesis, providing a detailed explanation of how higher-order information extracted from sensory systems can modulate sound in real-time. Our project explores the theoretical foundations of this technique and its practical applications in dance performances. Through subjective observations from the participating dancer in our public demonstration, we highlight the potential of our sonification system for artistic experimentation and innovation. This work aims to contribute to the interdisciplinary field of music and dance performance studies, offering an alternative means of connecting the dancer and the music with a synthesis technique that operates at micro and meso temporal scales.