Multimodal interaction in augmented reality

Zhaorui Chen, Jinzhu Li, Yifan Hua, Shen Rui, Anup Basu · 2017

With the boost of computing power in mobile devices and availability of cloud APIs in recent years, mobile augmented reality (AR) applications have become increasingly embedded in people's everyday life. However, effective and intuitive interaction between virtual and real worlds in these AR applications is still an open question. In this paper, we make one step towards an answer by exploring the possibility of incorporating two input modalities, gesture and speech, for enhancing user experience in AR applications.

Read the paper · More papers on PaperTik