Audio-Visual Art Performance System Using Computer Video Output Based on Converting Component Video Signal to Audio
Yuichi Ito, Carl Stone, Masashi Yamada, Shinya Miyazaki · 2013
This paper proposes a method for controlling video images in performance using video signals in the audio domain. It also describes a demonstration performance system using this representation method. This system consists of hardware for converting the component video signal to audio and software for easy control of image to produce the pitch(frequency), intensity(amplitude), rhythm and timbre(wave shape). Also included is data for verification of effectiveness of the proposed system and method of performance operation using a questionnaire survey of subject experiment, and demonstration of audio-visual performance in a public hall. This proposed representation method was created as a new unique relationship between video and audio signals, and also shows a new aspect of computer as a musical instrument.