SignInstructor: An Effective Tool for Sign Language Vocabulary Learning
Xiujuan Chai, Zhuang Liu, Yongjun Li, Fang Yin, Xilin Chen · 2017
Sign language (SL) is an efficient and important communication means for deaf community. To grasp sign language, many elementary schools set the SL course for both deaf and hearing students. However, the tutors are still limited resource in most of the countries. This paper presents a natural and facilitate substitute, Sign Instructor, to help self-learning of SL vocabularies with an inexhaustible tutor. Briefly speaking, the system is mainly composed of three modules: 1) multimodal playing of the standard SL materials, including sign video, key postures, illustration figure and text; 2) online capturing action when the user performs sign words; 3) and an automatic evaluation module by scoring the user's action. Aiming at the effective learning, there designed three basic education functions, including teaching, practice and testing. A prototype of this Sign Instructor is developed with Kinect input and deeply user study on it convincingly shows the effectiveness in SL learning, especially compared with other two traditional ways.