Visually supported analysis of music.
Bożena Kostek · The Journal of the Acoustical Society of America · 2010
Subjective tests are highly regarded means for determining musical sound timbre, sound and music quality, audio-visual correlations, etc. The multimedia development created a new domain of interests, namely, quality of experience, in which subjective evaluation has proven to be one of, if not, the most important tool. It should be pointed out that experience is not only subjective but also context-dependent. In addition to the external factors related to the environment aspects, perception and cognitive state clearly play a critical role in the context. Despite significant advances in objective measuring methods, the only way to evaluate subjective audio/video signal quality is to acquire opinions of subjects, and then to quantify resulted choices. Many multimedia applications stimulated new methods of subjective evaluation. Also, audio-visual perception evaluation requires a new methodological approach, which can be fulfilled while employing gaze-tracking technology. Gaze-tracking-based experiments consist in determining the part of the screen that the user is looking at and in superimposing it against an audio-video content. This method allows for measuring the attention and performance of the subject, thus making the subjective tests more reliable. The proposed methodology based on the gaze-tracking technique applied to audio-visual correlation tests will be shown.