HoloBand: An Augmented Reality Experience to Train Music Perception for the hard-of-hearing
Balazs Andras Ivanyi, Christian Tsalidis, Scott Naylor, Truls Bendik Tjemsland, Ali Adjorlu, Nille Elise Kepp, Stefania Serafin · VBN Forskningsportal (Aalborg Universitet) · 2022
HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH). It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP). We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis. Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.