Iterative Synaesthetic Composing with Multimedia signals.
Angus Graeme Forbes, Kiyomitsu Odai · University of Michigan Library Repository · 2012
This paper explores the use of orchestrated feedback as an organizational theme in an interactive multimedia composition entitled Annular Genealogy. The composition is performed by two players, each of whom use a separate digital interface to create and interact with the parallel iterative processing of compositional data in both the aural and visual domains. In the aural domain, music is generated using a stochastic process that sequences tones mapped to a psycho-acoustically linear Bark scale. The timbre of these tones and the parameters determining their sequencing are determined from various inputs, including especially the 16-channel output of the previous pass fed back into the system via a set of microphones. In the visual domain, animated, real-time graphics are generated using custom software to create an iterative visual feedback loop. This software runs on the iPad tablet and uses a custom fluid dynamics system, a vector visualization technique, and custom image processing filters to generate complex, evolving visual structures. Additionally, information from each of the domains is transferred into the other domain in realtime over a wireless network: sonic data is used to control the image processing parameters and visual information influences the generative parameters of the audio component. Interactive control of the composition is available through multi-touch interaction via the iPad tablet (for the visuals) and via the use of SuperCollider as a live coding environment (for the audio). 1.