Gesture Translation Device Using Flex Sensors, Accelerometer and Gyroscope with Cloud-Based Mobile Application

Jessie R. Balbin, Gia Mae A. Rapio, Bryant V. Baldivicio · 2023

Gesture Translation device is a device that can provide easy communication between deaf and mute community and ordinary people. This study aims to create and set up hand wearable technology with a mobile application that can display the obtained translated sign language into text and speech. The user needs to perform a sign language and the values given by the flex sensors, accelerometer, and gyroscope will then undergo to comparison test between the database of the system. If a match is found it will then be forwarded to the mobile application and the user will be able to view and hear the translated gesture. The accuracy of the device in translating the letters, numbers and phrases are 88.08%, 100%, and 83.75%, respectively. The overall accuracy of this study in terms of recognition is 89.17%.

Read the paper · More papers on PaperTik