SingMaster: A Sight-singing Evaluation System of "Shoot and Sing" Based on Smartphone
Wei Xu, Bowen Tian, Lijie Luo, Weiming Yang, Xianke Wang, Lei Wu · Proceedings of the 30th ACM International Conference on Multimedia · 2022
Based on the smart phone, this paper integrates OMR (Optical Music Recognition) with sight-singing evaluation, and develops a "shoot and sing" practice APP called SingMaster. This system is mainly composed of three modules: OMR, evaluation and user interface. The OMR module converts the score photographed in the real scene into a note reference sequence. The sight-sing evaluation module first completes the note transcription of the sound spectrum through onset detection and pitch extraction, then aligns the transcribed note sequence with the reference sequence, and performs the evaluation. Finally, the evaluation results are visually fed back to the practitioners through the user interface module. It can provide guidance for practitioners at any time, any place and on any score instead of a real teacher.