Hand Gesture based Speech Recognition system for Hard of Hearing People
Sanjay S Tippannavar, M S Surya, Pilimgole Sudarshan Yadav, Mohammed Zaid Salman, M Ajay · International Journal for Research in Applied Science and Engineering Technology · 2022
Abstract: For people who are intellectually challenged, this document provides a sign to speech translator. In contemporary society, the dumb have very little ability to converse with the normal person. Therefore, they are unable to interact with common people until common people, like ourselves, learn how to communicate through sign language. Dumb sign language is not something that everyone can learn because it is so challenging to perfect. Because of this, nobody can go and talk to these physically challenged persons. So, here is a system that would make it possible for those who are illiterate to speak with everyone. With today's technology, even the deaf may communicate by making hand gestures. Each hand gesture is set to play back a different audio message. Hand motions were captured by a flex sensor and an accelerometer, and the microcontroller then accepted these inputs. The flex sensor tracks hand movements and detects deflections, converting them into the right signals that trigger the system to produce recorded sound signals for transmission via the speakers. There are many different Arduino Boards available right now, and they can be used for a variety of things. The Arduino Mega 2560 is the ideal solution since it is the most cost-effective, allows faster computing, and can integrate and interface various sensors while consuming less power. The device under discussion is basically made up of a glove and a microcontroller-based system. Four strategically placed flex sensors are included in the data glove.