Audiovisual Analysis of Music Performances: Overview of an Emerging Field
Zhiyao Duan, Slim Essid, Cynthia C. S. Liem, Gaël Richard, Gaurav Sharma · IEEE Signal Processing Magazine · 2018
In the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.