Kinect-based sign language recognition of static and dynamic hand movements

Rando C. Dalawis, Kenneth Deniel R. Olayao, Evan Geoffrey I. Ramos, Mary Jane C. Samonte · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2017

A different approach of sign language recognition of static and dynamic hand movements was developed in this study using normalized correlation algorithm. The goal of this research was to translate fingerspelling sign language into text using MATLAB and Microsoft Kinect. Digital input image captured by Kinect devices are matched from template samples stored in a database. This Human Computer Interaction (HCI) prototype was developed to help people with communication disability to express their thoughts with ease. Frame segmentation and feature extraction was used to give meaning to the captured images. Sequential and random testing was used to test both static and dynamic fingerspelling gestures. The researchers explained some factors they encountered causing some misclassification of signs.

Read the paper · More papers on PaperTik