Using programming by demonstration for multimodality in mobile-human interactions

Zouhir Bellal, Sidi Mohamed Benslimane, Nadia Elouali · 2017

The emergence of sensor-based modalites enriches the human-mobile interaction. However, mobile applications end-users are often faced with interaction restrictions and do not yet have the possibility to modify their interaction modalities, according to their needs. In this paper, we present an approach that allows smartphone users to add and modify the interaction modalities of their already installed mobile applications, according to their preferences and needs. The approach is based on a Wrapper that acts as an intermediary between the user and the application and on the Programming By Demonstration (PBD) that allows the user to specify the desired changes.

Read the paper · More papers on PaperTik