Addressing Deaf or Hard-of-Hearing People in Avatar-Based Mixed Reality Collaboration Systems
Kristoffer Waldow, Arnulph Fuhrmann · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · 2020
Automatic Speech Recognition (ASR) technologies can be used to address people with auditory disabilities by integrating them in an interpersonal communication via textual visualization of speech. Especially in avatar-based Mixed Reality (MR) remote collaboration systems, speech is an important additional modality and allows natural human interaction. Therefore, we propose an easy to integrate ASR and textual visualization extension for an avatar-based MR remote collaboration system that visualizes speech via spatial floating speech bubbles. In a small pilot study, we achieved word accuracy of our extension of 97% by measuring the widely used word error rate.