Advanced Glove for Deaf and Dumb with Speech and Text Message on Android Cell Phone

Krishnamurthy Bhat, C. L. Chayalakshmi · 2020 IEEE International Conference for Innovation in Technology (INOCON) · 2020

Most of us are blessed with natural ability to see, listen and interact. However, few people do not have this ability. Due to various reasons like birth defects, accidents, oral diseases, and environmental impacts the number of such people is rapidly increasing in the recent years. Most of the deaf and dumb use gesture and sign symbol for the communication. Sign language is the form of communication where shapes, arms or body, orientation and movement of hands, and facial expressions are systematically combined. But, sign language is ineffective in many cases. It may not be sufficient when such people are involved in the educational, social and professional environments where they want to interact with others. Therefore, there is an immediate need to have an advanced sign language detection and gesture recognition system. The need, design methodology and implementation strategies of a smart glove are discussed in this paper. The main objective of the work is to bring the technology for the help of differently abled people to communication effectively and in most meaningful form. The hand glove converts the hand/finger gestures in to meaningful voice messages over an Android phone. An app is designed using Android Studio for the said purpose. There are several works carried out across the globe for converting hand and finger gesture or sign language into speech. The work described in this paper uses NodeMCU as processing and wireless communication of data and it is most advanced form of all the hand glove designs so far.

Read the paper · More papers on PaperTik