Vision and Voice Based Hand Gesture Recognition
S. Abdul Raheem, A. Shiva Sai, B. Keerthana, Asst. Prof. Mrs. A. Amulya · International Journal for Research in Applied Science and Engineering Technology · 2023
Abstract: The development of sign language over time has been astounding. It's unfortunate that this language has some unpleasant side effects. Not everyone can understand spoken sign language when using sign language among a mute or deaf person. For deaf-dumb people, hand gestures and sign language are important forms of communication. Communication is difficult without an interpreter, hence it is necessary to translate sign language so that it is understandable to the general public. The goal is to increase the participation of the deaf and the mute in communication. In order to incorporate colour, depth, and trajectory information to increase performance, the CNN is fed numerous channels of video streams that include body joint locations in addition to depth cues and colour information. We demonstrate how the proposed model outperforms conventional approaches based on hand-crafted features by testing it on a real dataset gathered using Microsoft Kinect.