Gesture Vocaliser using leap motion controller
P. Nikul, Nithin Johnson, B. P. Sooraj, Vaishak Sajeev, S. A. Asha · AIP conference proceedings · 2020
In present-day societies, talking is the main form of communication between humans. Different thoughts that are shaped in the human psyche are conveyed by discourse through the form of words, expressions, and sentences by applying some appropriate syntactic rules. One of the major challenges for people with hearing impairment is their fettered communication with the outside world. Deaf people make use of sign language or gestures to convey their thoughts and to make understand what they are trying to say but it is impossible to understand or comprehend for a person who does not understand sign language. Limited access to technology owing to their inability to communicate has a significant impact on their quality of life.American sign language is the most standardized and famous sign language used by ill abled people throughout the world for communication. We propose a gesture recognition system called ‘Gesture Vocaliser’ which detects American sign language alphabets (ASLA) as gestures. This system aims to provide high reliability and fast response. Upon showing these signs the gesture detection system detects the sign shown with the help of a classifier. The gesture detection system consists of a vision sensor which uses tracking technology to track the hand gestures. Whenever the proposed system senses any gesture, it converts these gestures into text, which is then converted into an audio message. There is a reverse phase in which human speech is recognised as a text and is then converted into sign language gestures for each corresponding character.