Harmony across Music, Visuals and Movement in a New Audio-visual Gestural Performance
Alon Ilsar, Matthew Hughes · 2020
This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the 'AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music and graphics using movements captured by handheld motion controllers. In this piece, the AirSticks are combined with commodity depth sensors, and a custom visualisation system 'Confluence' which generates graphics from music and motion in real-time. The hardware used to display the images within the performance space is also described, as well as an overview of the resulting performance, which explores harmony across music, visuals and movement, and investigates our complex relationship with technology.