Stringing Subtitles in Sign Language
Tejas Dharamsi, Rituparna Jawahar, Kavi Mahesh, Gowri Srinivasa · 2016
This paper presents a system designed as a sign language teaching aid. This system is capable of generating the sign-language equivalent of an input phrase or sentence in textual or audio form, with automated processing for language constructs such as tenses and plurals. For words or phrases, especially named entities not present in the repository, the system strings together images or video clips of alphabets to transcribe the input. The system also has the provision for a user to record their version of phrases and words as video clips (or still images) to augment the system's repository. This is particularly useful for pedagogy in Indian sign languages since most schools have their own vocabulary. The system was designed with inputs and continuous feedback from faculty at the Mathru Center for the Deaf, Dumb and Differently-Abled in Bengaluru. We envisage continuing to test the system and augment features to eventually open this up as a useful avenue for the pedagogy of sign languages.