GesSpy: ML Driven Real Time Sign Language Detection
Nusrat Jawed Iqbal Ansari, Siddhi Awari, Sri Haritha Movva, Ananya Parthasarathy, Srushti Poriwade · 2024
Various sign language translation technologies are used to ease the work of the sign language interpreters. Laying a stress on this, a real-time sign language detection system has been designed which employs OpenCV, MediaPipe, TensorFlow, Scikit-Learn and CNN to construct a system that accurately detects signs in real-time and further obtains the textual representation of the hand gestures. This system efficiently interprets the hand gestures used by the sign language users and converts it into its relevant text translation. This system is integrated in a web application for more interactive communication. This is done by integrating the Flask web API into android studio. System exhibits significant accuracy in detecting the gestures appropriately. Envisioning the goal to empower people with disabilities by enabling an inclusive environment. The proposed system is an efficient tool to increase awareness about ISL and enable non-ambiguous interactions between the deaf and hearing community.