Issues in Evaluating Beat Tracking Systems
Masataka Goto, Yoichi Muraoka · 2005
This paper discusses the main issues in evaluating beat tracking systems and proposes a method of evaluating the accuracy of these systems ' output. Although there have been a few attempts to evaluate beat tracking systems, they have not sufficiently addressed quantitative evaluation of tracking accuracy, in particular for audio signals. Our method compares subjective hand-labeled beat positions with computer-parsed beat positions and enables us to quantitatively analyze the deviation error of the tracked rhythm (beats) not only at the quarter-note level but also at the half-note and measure levels. It also considers several typical errors such as half-tempo and doubletempo errors as well as correct parsing. In testing our beat tracking system for audio signals without drum-sounds on 40 popular songs sampled from compact discs, we used the proposed method to evaluate overall recognition rates and tracking quickness and accuracy. 1 Introduction A great deal of rese...