A Design of Smart Glasses-Based Gesture Recognition and Translation System for Sign Languages

Chu Zhang, Kiminori Sato, Bo Wu · 2023

Sign languages are not understood by most people with no hearing disabilities. Therefore, translation systems for sign languages to written or spoken languages are useful. However, existing software and hardware that can translate sign languages are very difficult to carry and use. Smart glasses are becoming increasingly widespread, and with the development of software and hardware, they have become capable of recognizing hand movements. Therefore, this study attempts to propose a real-time translation system based on smart glasses with an Android OS, to facilitate better communication with deaf people. When the user puts on the smart glasses, the sign language gestures can be translated in to written language, in real-time, in the smart glasses. This will make it smoother and easier for the people who are not versed in sign languages to communicate with the deaf people. The results will improve the functions of smart glasses and contribute to the development of the communication systems for the deaf people.

Read the paper · More papers on PaperTik