Exploiting the full potential of JASigning to build an avatar signing train announcements

Sarah Ebling, John Glauert · Zurich Open Repository and Archive (University of Zurich) · 2013

We are building a system that translates German train announcements of the Swiss Federal Railways (Schweizerische Bundesbahnen, SBB) into Swiss German Sign Language (Deutschschweizerische Gebärdensprache, DSGS) in real time and displays the result via an avatar. We use the JASigning system to animate the avatar. Deliverables of the projects during which JASigning was developed are the main source of documentation for the system along with notes on the website. Not all planned features have been fully implemented: some because they are used very infrequently; others because there is insuffcient linguistic research on which to base an implementation. Our team of hearing and Deaf researchers identified the avatar functionality we needed for our project. In close collaboration with the developers of JASigning, we then found workarounds for those features that were not yet directly available in the system. Our goal for this paper is to share the solutions we found, thereby providing a use case for exploiting the full potential of JASigning. The features we required were not specific to train announcements: Among them were the extension of non-manual features over multiple signs, the addition of pauses between items of a signed list, or the introduction of stamping movements following successive identical digits and fingerspelled letters. Hence, knowledge of how to achieve their designated effects in the JASigning system can be useful to persons working with other types of sign language data as well.

Read the paper · More papers on PaperTik