Augmented Reality Interaction Based on Cross-Device Interaction Expansion
Yu Zhang, Jiansu Pu, He Yilei, Cheng Kehan · 2024
This study explores the application of smartphones in 3D interaction and proposes a cross-device interaction extension scheme based on inter-device information communication. For the 3D hand interaction prototype MARLP, the EWatch prototype is proposed to improve the interaction experience through smartwatch and eye tracking technology. The MARLP prototype frees both hands through a head-mounted stand, but prolonged suspension of the arms will lead to fatigue, which affects the experience. For this reason, EWatch combines the IMU of a smartwatch with OpenCV eye tracking technology to fine-tune the ray emission direction and enhance the interaction through gesture operation, which solves the operation problem when 3D hand interaction is not feasible, and is an effective complement to MARLP.