The multimodal music stand
Bo Bell, Jim Kleban, Daniel Overholt, Lance Putnam, John Thompson, JoAnn C. Kuchera-Morin · 2007
We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.