MUDRAKSHARA - A Voice for Deaf/Dumb People

Yeresime Suresh, J Vaishnavi, M Vindhya, Mohammed Sadiq Afreed Meeran, Supritha Vemala · 2020

Human beings communicate with each other using words of different spoken languages, but what will happen if a person is deaf/dumb and not able to hear or speak. The deaf/dumb people need to communicate using a certain sign language. As sign language is not understandable by everyone, a translator is needed to make up communication between normal and deaf/dumb people. Practically, translators are not available all the time hence a beneficial impact on the social lives of these hearing/speech disabled people can be brought by a system that recognizes hand gestures and performs the task same as translators. The propound system “Mudrakshara” is an ASL interpreter developed using concepts of machine learning like neural network methodologies and image processing techniques. It identifies hand gestures in the images obtained from video that is captured by a web `cam recorder and gives the meaning of signs made by hearing/speech disabled people thus making communication complete. In this article, an approach is proposed to convert video of hand gestures made by deaf/dumb people into text and audio format.

Read the paper · More papers on PaperTik