Adapting to Natural Interaction: Exploring Gesture Control Innovations in XR with Apple Vision Pro
Panagiotis-Efstratios Chontas, Sabin Corneliu Buraga, Adrian Iftene · Procedia Computer Science · 2025
This study explores the intuitiveness and user acceptance of gesture-based interaction paradigms within extended reality (XR) environments, using the Apple Vision Pro headset as a testing platform. Through a three-stage evaluation process—comprising Pre-Test, Mid-Test, and Post-Test questionnaires—data was collected from participants with varied levels of technological experience. The findings indicate a strong preference for naturalistic, embodied interactions such as hand gestures and voice input over traditional digital methods like keyboard typing. Notably, all participants successfully engaged with 3D models and immersive interface elements without prior instruction, highlighting the effectiveness of real-world gesture metaphors in facilitating user adaptation. Despite limited prior XR exposure, the majority of users found the system intuitive and enjoyable, especially when interacting with spatial content in three-dimensional formats. These results underscore the viability of gesture-driven interaction models in future XR systems and emphasize the importance of aligning interface design with users’ innate cognitive and motor behaviors. The paper concludes by advocating for interdisciplinary approaches to advance inclusive and intuitive XR interaction paradigms, thereby supporting broader societal integration of immersive technologies.