A Web Application for Audio to Indian Sign Language Translation using Natural Language Processing and Computer Vision

International Research Journal of Modernization in Engineering Technology and Science · 2023

This research paper presents a web application aimed at bridging the communication gap between individuals using sign language (SL) and those with hearing loss.The project's primary focus is to develop an efficient audio-to-Indian Sign Language (ISL) translator using Python, natural language processing (NLP), and computer vision techniques.The context of the study revolves around the challenges faced by the deaf community in communicating with hearing individuals and the limited availability of audio to sign language conversion systems.The proposed solution leverages the Google Speech API for audio recognition, NLP for text preprocessing, and dictionary-based machine translation to generate ISL graphics.The key findings reveal that the application successfully converts spoken input into text and subsequently translates it into Indian Sign Language graphics, facilitating seamless communication between deaf and hearing individuals.The research highlights the potential impact of technology in empowering the deaf community and enhancing accessibility to information and social interactions.

Read the paper · More papers on PaperTik