Implementing Alternative Communication using a Limited Number of Simple Sign Language Gestures

Ruslan Bahrii, Iurii V. Krak, Olexander Barmak, Veda S. Kasianiuk · 2019 IEEE International Conference on Advanced Trends in Information Theory (ATIT) · 2019

The article discusses one of the approaches to the implementation of alternative communication using non-verbal communication means. It is proposed to use human finger configurations as input controls. A model of a human hand is proposed for the implementation of the dactyl alphabet of sign language for the deaf. The possibilities of existing hand tracking devices have been investigated. An application has been developed to identify a set of finger configurations that are reliably recognized by front stereo cameras. A limited number of simple sign language gestures are defined that are convenient to show and easy to remember for people. A software module for text entry messages with a limited number of simple finger configurations has been developed. The main advantage of this approach is its ease of use and accessibility for people with temporary communication disabilities. Further research is focused on the use of dynamic gestures as controls.

Read the paper · More papers on PaperTik