A Virtual Reality Musical Instrument Integrated with a Remote Playing Robot System
Zhonghao Zhu, Weizhi Nai, Xin Wang, Yue Liu · 2024
Music education and performance are often constrained by geo-graphical limitations. To evaluate the effectiveness of remote music performance, we designed a virtual reality musical instrument system with a remote playing robot. The system comprises a virtual Irish tin whistle playing system and a remote playing robot system. In the virtual playing system, sensors capture the performer's gestures, translate them into corresponding tin whistle playing commands and produce the music. The playing robot is constructed with mechanical hands, and a data transmission module is programmed to facilitate communication between the virtual playing system and the robot, enabling remote simulated performances.