Evaluation of a multimodal 3-D pronunciation tutor for learning Mandarin as a second language: An eye-tracking study
Ying Gang Zhou, Fei Chen, Hui Chen, Lan Wang, Nan Yan · 2016
Recently, various 3-D talking heads have been applied to computer-aided language learning as a novel mode. However, there is a lack of objective evaluation of learners' perception of the talking head when learning Mandarin as a second language. This study used eye-tracking methodology to evaluate a multimodal 3-D Mandarin pronunciation tutor, in comparison with real human instructor. The pronunciation tutors were presented under two conditions: human face video (HF) and a multimodal 3-D talking head (3-D), each of which has been shown with a front view and a profile view respectively. Results indicated that foreign learners have showed more preference to the 3-D tutor with a shorter entry time. Moreover, learners observed the lip movement of 3-D tutor for a longer time with a front view, and the multimodal 3-D pronunciation tutor exhibited greater advantage of effectively delivering both articulator movements and airflow information with a transparent profile view. In conclusion, all of these findings proved the multimodal 3-D pronunciation tutor has attracted more attentions than human face during the process of learning.