Gesture-based control of physical modeling sound synthesis
Jules Françoise, Norbert Schnell, Frederic P. Bevilacqua · 2013
We address the issue of mapping between gesture and sound for gesture-based control of physical modeling sound synthesis. We propose an approach called mapping by demonstration, allowing users to design the mapping by performing gestures while listening to sound examples. The system is based on a multimodal model able to learn the relationships between gestures and sounds.