Improving Language Learning by an Interact-to-Learn Desktop VR Application: A Case Study with Peinture
Xiao Liu, Shuwei Zhang, Tao Xu, Yun Zhou · 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · 2022
Mastering vocabulary is a daunting task for second language learners. Desktop Virtual Reality (VR) can inspire and engage learners with interact-to-learn activities to facilitate memorizing vocabulary. This paper proposes a desktop VR application for color vocabulary learning called Peinture. Peinture consists of a lecturing video and an interactive coloring virtual space. The talking teacher in the lecturing video is generated automatically through text-to-speech and lip synthesis approaches. Learners can paint and interact in a theme when or after lecture learning. A preliminary user study based on performance, self-report and eye tracking data analysis shows that interact-to-learn activities provided by Peinture were beneficial for second language learning. However, there is still considerable room to upgrade such educational VR.