A semantic-based multi-modal utility approach for multimedia adaptation

Martin Prangl, Hermann Hellwagner, Tibor Szkaliczki · SZTAKI Publication Repository (Hungarian Academy of Sciences) · 2006

Content adaptation is an important issue of multimedia frameworks in order to achieve Universal Multimedia Access (UMA), i.e., to enable consumption of multimedia content independently of the given resource limitations, terminal capabilities, and user preferences. The Digital Item Adaptation (DIA) standard, one of the core specifications of the MPEG-21 framework, supports content adaptation considering a wide range of networks, devices, and user preferences. Most adaptive multimedia frameworks targeting the UMA vision do not consider utility aspects in their adaptation decisions. This paper focuses on a generic multi-modal utility model for DIA currently under design and evaluation, that aims to enhance the multimedia experience for the client. Our proposed model is able to take the semantics and the perceptual features of the content as well as the clients’ specific utility aspects into account. Based on a detailed analysis of these constraints, we will show how the model reacts on individual input data. Finally, we will discuss results of the multi-modal decision taking process according to a few use case scenarios.

Read the paper · More papers on PaperTik