Enhancing Communication for the Hearing Impaired: A Real-Time Speech to Sign Language Converter
Akash Deshmukh, Aryan Machindar, Sahil Lale, Prahshant Kasambe · 2024
Whether it’s conversing, playing computer games, attending a meeting, or participating in a video conference, deaf individuals constantly miss out on the enjoyment that other people may have. Since not every local speaks sign language, communicating with them is the hardest issue. The goal of our research is to develop a communication system for the deaf by converting words or speech into sign language. The system records voice, translates it into text, and displays Indian Sign Language actions application serves a dual function by not only translating English speech into textual representation but also into visual formats with appropriate Sign language counterpart of the word/alphabet. The uniqueness of its predictive analysis model lies in its ability to process frames over a 5 -second duration, generating cumulative sentences that are synthesized into video, enhancing accessibility for a diverse user base. Furthermore, the SignLingo extends its inclusivity by providing a valuable service to individuals with visual impairments. The synergistic combination of advanced machine learning techniques with an intuitive and user-centric interface positions the sign language conversion as a pioneering initiative in creating truly inclusive communication spaces.