Sign To Speech And Display Converter

Anudeep Komera, Nageswara Goud, Sri Harsha Katragadda, Narayana Swamy Katragadda · Iconic Research and Engineering Journals · 2018

This report presents a system VISION-BASED SIGN LANGUAGE TRANSLATION DEVICE for automatic translation of gestures into speech in English to assist the impaired people to communicate with hearing people. It can be used as a translator for people who do not understand sign language. The proposed system is an interactive application program developed by using MATLAB software and incorporated into Arduino board. The sign language gesture images are acquired using the inbuilt camera of the LAPTOP or Webcam; vision analysis functions are performed in the operating system and provide speech output through speaker which is in connection with APR33A3 the inbuilt audio device thereby minimizing hardware requirements and expense. The information is sent one after another through the Arduino in 8 bit format to reduce the error. This allows for almost instantaneous recognition from finger and hand movements to translation. This is able to recognize one handed sign representations of alphabets (A-Z) and numbers (0-9). The results are found to be highly consistent, reproducible, with fairly high precision and accuracy.

Read the paper · More papers on PaperTik