Enhancing Communication with Gesture Recognition for People with Disabilities
Akshay Kumar, Kapil Kumar Joshi, Saumitra Chattopadhyay, Yogita Kaushik, Harishchander Anandaram, Vansh Taneja · 2023
Gesture recognition plays a vital role in the era of smart city and visual perception. This work introduces an innovative smart application designed to enhance inclusive communication for individuals with disabilities. By leveraging real-time sign language detection and interpretation, the application harnesses advanced technologies such as artificial intelligence, computer vision, and gesture recognition. Its main goal is to overcome communication barriers, facilitating smooth conversations between sign language users and non-sign language users. This article provides a comprehensive analysis of the application's design, features, and functionality, emphasizing its potential to bridge the communication gap. Through an evaluation of effectiveness, usability, and user satisfaction, the research showcases the transformative impact of the application on sign language communication. The findings highlight the significant role of this technology in promoting inclusivity, empowerment, and equal participation across various domains for individuals with disabilities. Additionally, the article discusses implications, limitations, and identifies future research directions for the further development and implementation of the application. The model is trained on a large corpus downloaded from Kaggle and can be used to interpret sign language. The user simply needs to perform their sign gesture and the model will automatically read and convert it to text in real time. It achieved 97.3% final accuracy hence can be used by sign language users to communicate with non sign language users effectively.