SignCom AI: A Real-Time Communication System for Indian Sign Language Using AI and NLP Techniques
G. Jemilda, Venkata Satya Santhi S, A.Vinil Britus -, M. Williams Pearlson Jebus -, Mohammed Muhsin Iliyas - · International Journal on Science and Technology · 2025
Communication barriers between the deaf and hearing communities remain a significant challenge in today’s society. Our project aims to bridge this gap by developing a real-time Sign Language Translator App capable of converting Indian Sign Language (ISL) into both text and speech. The application uses the device's camera to capture hand gestures and leverages machine learning and computer vision techniques to recognize and interpret signs accurately. It supports translation into multiple Indian regional languages, making it accessible to a broader audience. Additionally, the app features a Learning Mode to teach ISL, and a Text-to-Sign avatar that displays user-input text in animated sign language. This comprehensive approach empowers the deaf community by facilitating inclusive communication, promoting ISL learning, and fostering societal awareness.