A Dynamic 3D Performance Space for Control of Virtual Musical Instruments

Andrew Hollenbach, Matthew Cox, Joe Geigel · 2016

This work explores developing an intuitive, real-time music generation system and interface. We present a system that uses the real-time skeletal tracking provided by the Kinect to generate complex musical compositions containing up to four tracks, with instruments represented in distinct physical spaces. The performer's position and movements are translated into cues that are relayed to Ableton Live for music generation. Finally, we experiment with an interface projected in physical space to provide real-time feedback to the user.

Read the paper · More papers on PaperTik