Multimodal navigation within multilayer-modeled Gregorian Chant information

Adriano Baratè, Goffredo M. Haus, Luca A. Ludovico, Damiano Triglione · 2012

Information entities can often be described from many different points of view. In the digital domain, a multimedia environment is fit to the goal of describing, as well as a multimodal framework is fit to the goal of enjoying those information entities which are rich in heterogeneous facets. The proposed approach can be applied to all the fields where symbolic, textual, graphical, audio and video contents are involved. This paper aims at deepening the concept of multimodal navigation for multilayer-modeled information. Addressing the specific case study of music, our work first presents a suitable format to encode heterogeneous information within a single document. Then it proposes a computer-based approach for analyzing recordings whose musical scores are known, identifying their semantic relationship in automatic way. Finally, the method is tested on a set of Gregorian chants, in order to produce a multimodal Web application.

Read the paper · More papers on PaperTik