Hand motion recovery based on skin color segments and motion parameter estimation
Samuel Henry Chang, Les Elkins, ZhaoYang Wang, Tong Zhou, Seat Foo, Andrei Tchoyprakov, Joseph J. Fuller · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2004
The problem of tracking the motion of a functional, electrically controlled hand is addressed in this paper. We show that by using skin color and hand segments, the motion of a human hand controlled by a functional electrical stimulation (FES) system can be recovered and predicted. The hand motion tracking and prediction information can then be used as feedback in a closed loop control system to improve the control of the hand motion. We show how skin color tracking can be used to segment the human hand regions and how the hand segments can be used to identify the hand moving positions and how the changes of hand segments between two frames can be used to track the hand orientations. We then show how the hand motion can be recovered based on the changes of the hand positions and orientations and how the motion can be simulated and predicted. The tracking and motion identification methods are verified by the presentation of experimental results obtained using the methods described in the paper.