Multi-modal hand gesture designing in multi-screen touchable teaching system for human-computer interaction
Tingting Liu, Zengzhao Chen, Hai Liu, Zhaoli Zhang, Yingying Jennifer Chen · 2018
In this paper, we developed a hand gesture recognition technology in a human-computer interaction system with several hand gestures. The proposed system can help teacher to control the multi-screen touchable teaching tools, such as sweeping right or left to access the previous or next slide, with a fist to call the eraser tool to rub out the wrong content. To verify its efficiency and other qualities, we conducted a quasi-experiment in our program site in east part of China which analyzed the pre- and post-test scores in Math class of each experimental groups. Moreover, the error recognition rate is reduced by increasing the relevant features and threshold training for the teaching application. Experimental results demonstrate that the proposed system achieves the high accuracy and real-time performance.