Mobile based multimodal retrieval and navigation of learning objects using a 3D car metaphor
Abu Saleh Md Mahfujur Rahman, Abdulmotaleb El Saddik · 2011
In contrast to the traditional 2D layout design for search results display, we adopt a 3D car gaming environment as a search results organization and visualization metaphor. We argue that the 3D virtual environment based user interface may provide an alternative to the traditional presentation techniques, especially in a learning environment where learners are looking for multimedia learning resources that match their interests. To draw attention and create entertainment we devise multi-modal mobile interaction with the car metaphor. We propose mobile accelerometer gestures to control the 3D car gaming metaphor and navigate learning resources. Additionally, through the mobile interface we provide the option to access, play, and store the learning objects for later browsing. We describe a preliminary prototype and illustrate user study on the suitability of the proposed multi-modal approach to learning resource access.