Creative Control of Granular Synthesis Using Fluid Simulation & Motion Tracking
Andrew Bluff, Andrew Johnston · 2014
This paper describes the development of an audio-visual performance system which applies 'reality based interaction' techniques. The real-time gestures and sounds of a musician playing an acoustic instrument are tracked and translated into forces which act on a fluid simulation. The simulation is visualised and also sonified using granular synthesis. Several strategies for linking live performance, fluid behaviour and generated sounds and visuals are discussed.