1A1-M04 A Supporting System of Choral Singing for Visually Impaired Persons Using KINECT Sensor(Universal Design and Robotics & Mechatronics)
Yuhei Kaneishi, Takashi ASAKAWA, Nobuyuki Saito, Noriyuki Kawarazaki · The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec) · 2012
This paper provides a study on a supporting system of choral singing for visually impaired persons. This system is composed of an electric music baton with an acceleration sensor, a radio module, haptic interface devices, KINECT sensor and a PC. An electric music baton transmits a conductor's motion to visually impaired players based on a signal of acceleration sensor. Since a conductor has to give individual instruction to a target player, we use a KINECT sensor in order to recognize the direction of a conductor's music baton. The direction of a conductor's music baton is estimated based on the positions of a conductor's both shoulders. The effectiveness of our system is clarified by several experimental results.