AI-Based Sign Language Interpreter (GestPret)
Hind Alzarooni, Hessa Al Ali, Salma Fadaaq, Talal Bonny · 2023
Hearing, speech, and sight are the three key factors that aid in communication. Hearing and speech impaired people often find it hard to communicate their emotions because they lack two of the three essential communication requirements. The communication gap persists despite the availability of sign language (hand gestures used for communication), as sign language is incomprehensible to those who are not impaired. GestPret (Gesture Interpreter) is a portable stand-alone device, suitable for all ages, designed to bridge the communication gap between signers and non- signers. GestPret is an AI-based translator that transforms Arabic sign language gestures into text in real time. Initially, the user creates a hand gesture in front of the camera which will be captured and processed using image processing. The Graphical user interface allows the users to easily navigate through the software to utilize its features. GestPret operates at 9.3 frames per second and generates results in real time. The trained model also assigns the sign to one of 41 distinct classes with an average classification accuracy of 94.6%.