MultiVR: Digital Twin and Virtual Reality Based System for Multi-people Remote Control Unmanned Aerial Vehicles
Haodong Chen, Fen Liu, Yuanlin Yang, Wei Can Meng · 2022 17th International Conference on Control, Automation, Robotics and Vision (ICARCV) · 2022
The remote control of Unmanned Aerial Vehicles (UAVs) in emergency rescues, large-scale search, e-commerce and other fields is still a hot topic. The majority of current remote human-computer interaction techniques, such as joy-sticks, monitoring interfaces, or gesture control, lack flexibility, have weak immersion, and have poor interaction. The study proposes the development of a novel system for controlling multiple UAVs using virtual reality (VR). A virtual system and a physical system make up the control system. A VR application uses a head-mounted display (HMD) to show the user a digital twin environment of a drone and a faraway location. The operators pilot the quadcopters with a set of virtual reality handles. Control data is translated directly from VR to the real UAV in realtime. The experimental results showed a stable and convenient method of manipulation by the VR scene. With the support of the proposed system, ultra-remote control is possible, and immersive maneuvering makes controlling multiple drones easier.