Localization and Recognition of Digit-Writing Hand Gestures for Smart TV Systems
Hefeng Wu · Journal of Information and Computational Science · 2014
A novel framework is put forward in this paper for localization and recognition of digit-writing hand gestures, which forms the basis of a vision-based interactive interface that we will develop later for smart television systems. The framework uses as input a video stream capturing the hand gesture of writing a digit dynamically by the user, and outputs the digit inferred from the gesture. A fast and robust tracker is used to flnd the gesture trajectory, and prior constraints and a motion predictor are applied to improve the tracker’s performance. The trajectory is then turned into the flnal output by a recognizer, which is formed by the combination of dynamic time warping and the convolutional neural network. The efiectiveness of the proposed framework is validated by experiments.