ISL Animated Translator and Desktop Virtual Assistant
Syed Ali Zain ul Abideen Naqvi, Mahek Zahid Suleman, Kavya Dev Verma, Prachi Dhanawat · 2023
Sign language is a visual language that uses hand gestures to exchange information between their community and with other people. There has always been difficulty in communication between a verbally impaired person and a normal person. The Sign Language Recognition system is a breakthrough for helping deaf-mute people to communicate with others. Various Indian Sign Language Systems have been developed by many developers around the world but they are neither flexible nor cost-effective for the end users. The main reason behind the lack of research is that there is no proper grammar of ISL and another reason is Sign language is not universal and it varies from country to country and region to region [1]. The aim of this project is to develop a software system that can facilitate communication between normal individuals and deaf/mute individuals by translating Hindi or English text into Indian Sign Language (ISL) gestures, and vice versa using the MediaPipe model. The system will consist of a translator component to generate ISL gestures from input text, an animator component that uses computer graphics techniques to create realistic representations of ISL gestures, and an AI virtual assistant that interprets ISL gestures made by the user to trigger corresponding actions. The system will be integrated with the MediaPipe model to enable translation of ISL gestures to text using computer vision techniques. The overall goal is to provide an advanced system that bridges the communication gap between normal individuals and deaf/mute.