Analyzing the Cognitive-Affective Pathways of Hand-Eye Coordination Interaction: A VR User Experience Study Based on the SOR Model
Yunfan Deng, Zhiyong Zhou, Wenting Fang · International Journal of Human-Computer Interaction · 2025
This study investigates the indirect interaction mode of hand-eye synergy (gaze + pinch) in virtual reality. Based on the stimulus-organism-response (SOR) framework, a multidimensional chain-response framework is constructed using Partial Least Squares Structural Equation Modelling (PLS-SEM). A generalized linear model (GLM) was utilized to analyze the main and interaction effects of directness of interaction and dimensionality of interaction. PLS-SEM was applied to examine the cognitive-affective chain reaction pathways, with data collected through a between-subject design. The results reveal that: (1) dimensionality of interaction shapes user experience primarily through its impact on immersion, whereas directness of interaction contributes to user experience by strengthening interactivity; (2) pleasure functions as a significant mediator linking interactivity and immersion to both user experience and behavioral intention, while arousal exhibits a more limited role, mediating only their relationship with user experience; (3) directness and dimensionality of interaction jointly yield synergistic benefits for user experience and behavioral intention. These findings support the dual-track optimization principle for VR design: “Environmental immersion is prioritized, and operational naturalness is synergized.” It provides theoretical insights and practical implications for cognitive-emotional coupling in multimodal systems. Future research could explore cross-cultural emotional responses and multisensory synergy.