Real time sign language recognition using depth sensor
Jayesh Gangrade, Jyoti Bharti · International Journal of Computational Vision and Robotics · 2019
Communication via gestures is a visual dialect utilised by deaf and hard-of-hearing (HoH) people group. This paper proposed a system for sign language recognition utilising human skeleton data provided from Microsoft's Kinect sensor to recognising sign gestures. The Kinect sensor generates the skeleton of a human body and distinguishes 20 joints in it. The proposed method utilises 11 out of 20 joints and extracts 35 novel features per frame, based on distances, angles and velocity involving upper body joints. Multi-class support vector machine classified the 35 Indian sign gestures in real time with accuracy of 87.6%. The proposed method is robust in cluttered environment and viewpoint variation.