An Artistic Technique for Audio-to-Video Translation on a Music Perception Study
Eugene Mikyung Kim · The International journal of Multimedia & Its Applications · 2012
The paper presents an audio-to-visual instrument that allows sound-to-image transformation based on an empirical investigation of the relationship between four auditory parameters -pitch, amplitude, timbre, and duration -and four visual parameters -color, location, shape, and size -in the multimedia context. Implementing the audio-to-visual instruments involves real-time sound analysis by using a constant-Q transform and image generation in a Max/MSP/Jitter environment.