Real-Time Dynamic Sign Language Recognition Based on Hierarchical Matching Strategy
Wenle Liang, Yuanyuan Huang, Zuojin Hu · International Journal of Signal Processing Image Processing and Pattern Recognition · 2017
Dynamic sign language can be described by its trajectory and the key hand-action.However, a large number of statistical data show that most of the commonly used sign language can be recognized by its trajectory curve.Therefore, a hierarchical matching recognition strategy for dynamic sign language is proposed in this paper.First, the gesture trajectory can be obtained by the somatosensory equipment like Kinect.According to its point density an algorithm of key frame detection is designed and is used to extract the key gestures.Then the dynamic time warping (DTW) algorithm is optimized and used to do the first-level matching, i.e. trajectory matching.If the recognition results can be get currently, then the recognition process can be finished, otherwise the process should go into the second-level, i.e. key frame matching and get the final recognition results.Experiments show that this algorithm not only has good real-time performance, the recognition accuracy is also higher.