The Role of Visual Augmentation on Embodied Skill Acquisition Across Perspectives and Body Representations
Ruochen Cao, Zequn Liang, Chenkai Zhang, Andrew Cunningham, James A. Walsh, Rui Cao · IEEE Transactions on Visualization and Computer Graphics · 2025
Immersive embodiment holds great promise for motor skill acquisition, however the design and effect of real-time visual guidance across perspectives and body representations remain underexplored. This study introduces a puppet-inspired visual feedback framework that uses continuous visual linkages - line, color, and thickness cues - to externalize spatial deviation and scaffold embodied learning. To evaluate its effectiveness, we conducted a controlled virtual reality experiment (N = 40) involving gesture imitation tasks with fine (sign language) and gross (aviation marshalling) motor components, under first- and third-person viewpoints. Results showed that color-based guidance significantly improved imitation accuracy, short-term learning, and perceived embodiment, especially in finger-based and first-person settings. Subjective assessments (NASA-TLX, Motivation, IPQ, Embodiment) confirmed improvements in presence, agency, and task engagement.