Integrating Gesture Data in Computer-aided Composition: A Framework for Representation, Processing and Mapping
Marlon Schumacher, Marcelo M. Wanderley · Journal of New Music Research · 2016
In this article, we discuss physical gestures from the perspective of computer-aided composition (CAC) and propose solutions for the integration of gesture signals as musical materials into these environments. After presenting background and motivations, we review related works and describe design guidelines for our developments. A particular focus is given to the idiosyncrasies of working with gestures in real-time vs differed-time paradigms. We present an implementation of our concepts as the library OM-Geste, integrated into the CAC environment OpenMusic. Two case studies are presented for the generation of a symbolic musical score and spatial audio synthesis from gesture recordings of dance and instrumental performances.