Visual Rhythm Detection and Its Applications in Interactive Multimedia
Trista P. Chen, Ching-Wei Chen, Phillip Popp, Bob Coover · IEEE Multimedia · 2011
True multimedia experience involves multimodal media and their intrinsic interactions. This article identifies rhythm as the link between physical movement, other visual stimuli, and the musical art form. It describes two example interactive multimedia applications in which visual rhythm is extracted for synchronization of music and video to allow more intuitive interaction between a user and both audio and video content, leaving the door open for many potential innovative applications.