Adventure ASL: A Serious Game for Practicing American Sign Language (ASL) Fingerspelling with Gesture Recognition
Arianne Clyde Inoc, Michael T. Lee · 2025
This study showcases a serious game for learning and practicing American Sign Language (ASL) Fingerspelling with gesture recognition using machine learning and Python. The game will utilize a webcam, or a camera connected to a computer to detect hand gestures, and an artificial intelligence model will determine the letters based on the hand gesture shown. The environment features colorful 2D graphics that simulate different places for players to explore and monsters that must be defeated by signing the right letter or correctly fingerspelling the word on the screen. This gameplay style can be used for a whole vocabulary of words in ASL done with specific movements or gestures or for practicing other sign languages such as Taiwan Sign Language (TSL).