InMuSIC: an Interactive Multimodal System for Electroacoustic Improvisation
Giacomo Lepri · University of Michigan Library Repository · 2016
InMuSIC is an Interactive Musical System (IMS) designed for electroacoustic improvisation (clarinet and live electronics). The system relies on a set of musical interactions based on the multimodal analysis of the instrumentalist's behaviour: observation of embodied motion qualities (upper-body motion tracking) and sonic parameters (audio features analysis). Expressive cues are computed at various levels of abstraction by comparing the multimodal data. The analysed musical information organises and shapes the sonic output of the system influencing various decision-making processes. The procedures outlined for the real-time organisation of the electroacoustic materials intend to facilitate the shared development of both long-term musical structures and immediate sonic interactions. The aim is to investigate compositional and performative strategies for the establishment of a musical collaboration between the improviser and the system.