Gesture Intention Understanding Based on Depth and RGB Data
Feng Yu, Luefeng Chcn, Wanjuan Su, Kaoru Hirota · 2018
Aiming at the problem that the process of gesture recognition based on color image is greatly affected by environmental factors such as lighting, a gesture intent understanding method based on the fusion of Red-Green-Blue (RGB) data and depth data is proposed. Firstly, the gesture feature extraction based on the Speeded Up Robust Feature (SURF) method after foreground segmentation are used to get gesture information. Then, we apply Backpropagation (BP) neural network to classify and recognize gestures. The final recognition results are obtained through data fusion from recognition results based on both RGB images and depth images. We evaluated the effectiveness of the proposed method through ChaLearn Gesture Database.