Development of Interactive ASL (American Sign Language) Learning App

Pema Thinley, Thinley Wangchuk, Tenzin Lhendup, Sanga Choden, Tshering Yangden, Kazuhiro Muramatsu · 2022

The ASL (American Sign Language) is one of the most used sign languages today due to the increased population of people with hearing loss and speech impediment. The interactive and fun learning platform for these individuals are less which causes communication gap between impaired and unimpaired people, trouble availing services and difficult learning sign language for abled individuals. In this paper, the basics of ASL, alphabets are animated according to the sign language using Blender software to model a 3D character and using Unity software, developed an interactive basic ASL learning app. It has features like AR (Augmented Reality) and audio for all signs which can be heard with respect to the letter typed by the user. The AR is integrated in Unity software with the Vuforia plug-in. The app was developed successfully with instant response by the 3D character model with letter input and for AR, detection of target image was found to be within seconds.

Read the paper · More papers on PaperTik