Communication Decipher: Text to Speech and Hand Gesture to Speech Conversion

Sowmya R. Bangari, Sunita Shirahatti, S. T. Veerabhadrappa, G C Suguna, H.S Kavitha · 2022

Communication between people with some kind of disabilities has always been a problem faced by our society. Communication between a normal person and a physically challenged person has always been a challenging task. Mute people can use sign language to communicate with one another, but it is hard to communicate with someone who doesn't understand the sign language. The blind cannot read the normal text and rely on the Braille scripts. Many of the modern-day researches focus on addressing the issues of one of the above challenges, but not all. This paper aims to venture into the field of assistive learning tools, where the work described can help teach the Kannada alphabet to everyone, irrespective of their disabilities. Using this system, the visually impaired can hear the information represented as text by converting the text into speech. The deaf/mute can communicate by converting the speech input into text output, or the hand sign input into text and audio output. In exceptional cases where a person is deaf, mute and blind can use the Braille letter board. The assistive system is built on Raspberry Pi with Image Processing and Speech Recognition techniques. The designed system works with 99 % accuracy.

Read the paper · More papers on PaperTik