Deaf-Mute Communication Interpreter
Anbarasi Rajamohan, R. Hemavathy, M. G. Dhanalakshmi · 2013
Abstract- Communications between deaf-mute and a normal person have always been a challenging task. The project aims to facilitate people by means of a glove based deaf-mute communication interpreter system. The glove is internally equipped with five flex sensors, tactile sensors and accelerometer. For each specific gesture, the flex sensor produces a proportional change in resistance and accelerometer measures the orientation of hand. The processing of these hand gestures is in Arduino. The glove includes two modes of operation – training mode to benefit every user and an operational mode. The concatenation of letters to form words is also done in Arduino. In addition, the system also includes a text to speech conversion (TTS) block which translates the matched gestures i.e. text to voice output. Keywords—Deaf-Mute, communication, gesture, Flex sensor, tactile sensors, accelerometer, TTS. data processing. Another challenge in image and video processing includes variant lighting conditions, backgrounds and field of view constraints and occlusion. The sensor based technique offers greater mobility. The main aim of this paper is to present a system that can efficiently translate American Sign Language[1] gestures to both text and auditory voice. The interpreter here makes use of a glove based technique comprising of flex sensor [7], tactile sensors [2] and accelerometer. For each hand gesture made a signal is produced by the sensors corresponding to the hand sign [3] [9] the controller matches the gesture with pre-stored inputs. The device not only translates alphabets but can also forms words using made gestures. Training mode is offered in device so that it fits every user and accuracy is increased. The device can also be made to translate larger gestures that require single hand movement. I.