[DC] Understanding the Impact of the Fidelity of Multimodal Interactions in XR based Training Simulators on Cognitive Load
Nikitha Donekal Chandrashekar · 2024
As eXtended Reality (XR) technologies evolve, the integration of multimodal interfaces becomes a defining factor in immersive expe-riences. Existing literature highlights a lack of consensus regarding the impact of these interfaces in XR environments. Due to the Uncanny Valley Effect and its amplification in multimodal stimuli, the uncanny valley effect poses a potential challenge of increased cognitive load due to dissonance between user expectations and reality. My research pivots on the observation that current studies often overlook a crucial factor-the fidelity of stimuli presented to users. The main goal of my research is to answer the question about how multimodal interactions in XR based applications impact the cognitive load experienced by the user. To address this gap, I employ a comprehensive human-computer interaction (HCI) research approach involving frameworks, theories, user studies and guidelines. The goal is to systematically investigate the interplay of stimulus fidelity and cognitive load in XR, aiming to offer insights for the design of Audio-Visual-Haptic (AVH) interfaces.