Notes on Bimodal Muscle Sensing for the Sonification of Indeterminate Motion

Marco Donnarumma · 2014

This article offers an overview of a musical performance instrument that leverages bimodal muscle sensing for the sonification of motion. Namely, the instrument a) captures the sound produced by a performer's muscles and makes it available for real-time audio processing, and b) enables a performer to drive the processing parameters using high-level features extracted from muscle activity. This enables the performer to produce and finely shape sound with gestures that do not need to be specified beforehand as a vocabulary of a finite number of movements. This allows the performer and the software to create an open-ended range of sonified movements which arise from the interplay of bodily mechanisms and software processes.

Read the paper · More papers on PaperTik