A Computer Vision and Vibrohaptic Glove-Based Piano Learning System for the Visually Impaired
I. Cho, Jin Kuen Park, Hosung Bae · 2025
The visually impaired are unable to enjoy leisure activities as much as ordinary people due to various limitations. To expand the scope of leisure activities for the visually impaired, we have developed a vibration glove-based system that helps with piano learning. Previous research used 88 infrared light-emitting diodes and gloves with infrared receivers to provide feedback to the user, but this method had many limitations. In particular, the inconvenient user experience and low accuracy were the biggest problems. Our method solves both problems using a camera and an image processing algorithm. As a result of testing the model on 20 piano images, it was shown that all keys were perfectly recognized in 75% of cases, and the gloves could be comfortably used in practice without any difficulty. Thus, our method presents a simpler user experience for the visually impaired, without requiring any special modifications to the piano.