Augmented Reality-Based Robot Interaction and Modeling System: An Innovative Human-Machine Interaction Framework
Bo Fu, Hanbo Zhang, Erxin Wu · 2024
Traditional robot modeling approaches often lack intuitiveness and efficiency. To facilitate more convenient and intuitive complex robot design and modeling, this paper aims to design and implement an augmented reality-based robot interaction and modeling system. This system enables modeling and controlling robots using Meta Quest 3 controllers, and achieves interactive effects between virtual robots and the real environment through the headset. By integrating key technologies such as robot control algorithms, augmented reality rendering techniques, and physics engines, the system can precisely control robots and merge virtual content with the real environment. User study results indicate that the system effectively achieves humanoid robot control and modeling.