LeapASL: A platform for design and implementation of real time algorithms for translation of American Sign Language using personal supervised machine learning models
Jon Jenkins, Sherif S. Rashad · Software Impacts · 2022
There is a need for a system that is easy to use, accurate, and portable to translate from American Sign Language (ASL) to English. The proposed innovative system combines Unity's usability with Python's machine learning capabilities to create a platform for real time translation of ASL. The Leap Motion Controller is used to capture hand movements and information to create supervised machine learning models. This system will be able to work in an adaptive way to learn from the signer how they sign individual words to allow for a more robust accuracy than a general model for sign language recognition.