Bridging Communication Gaps Using Augmented Reality: Designing a User Conversational Interface for Hearing Impaired Student
Adriana Lorena Iñiguez-Carrillo, Daniel Aréchiga, Miguel Ángel Rangel Romero, Ana Gabriela Espíndola-Barajas · 2024
An immersive interface is designed to improve communication for individuals with hearing impairments and speech disabilities.This interface integrates advanced speech-to-text and TTS technologies, facilitating real-time communication for educational settings.The speech-to-text technology transcribes the teacher's spoken words into text, displayed on an immersive augmented reality headset.Additionally, TTS technology vocalizes the student's typed responses through a virtual keyboard, enabling verbal communication with the teacher and peers.By focusing on cooperative learning and social computing, this study explores how to implement a conversational user interface, ensuring trustworthiness and reliability.Preliminary design insights and strategic implementation efforts aim to demonstrate the interface's potential as a transformative communication tool in assistive technology.The research highlights the collaborative aspects of educational environments, showing how augmented reality can enhance student social interaction.This research uses advanced technology to support, mediate, and enhance human social interactions, creating more inclusive and effective educational experiences.