Design and exploration of a virtual reality-based human-computer interaction system
Jie Liu, Surng-Gahb Jahng · 2023
First, data gloves were made. The STM32 microcontroller was selected for the data glove to collect hand motion pose data from the MPU6050 sensor, and the data was transferred to the Unity3D engine via a wireless Bluetooth module. The experiments show that the data glove can provide data to the system stably and the system does not lag. The HMM-based dynamic gesture recognition method is proposed. The hidden Markov model is studied in depth, and the gesture interaction recognition model is established by adding noise and normalization to the data generated by the data glove. The proposed algorithm has a correct recognition rate of more than 90% for all the eight defined gestures. Finally, This paper is based on virtual reality even though the research and integration of human-computer interaction systems has made some progress and breakthroughs in the new field of virtual reality.