A New Evaluation Scheme for Vehicle Detectors Including a Traceability Concept
Jinhwan Jang, Namchul Baik, Hyoungsoo Kim · Transportation Research Board 88th Annual MeetingTransportation Research Board · 2009
Since baseline data from an evaluation device with possible error, even if a little, are employed as a proxy ground truth, the results might be under uncertainty. Traceability can be used to verify accuracy of a device relative to a known standard and refer to an unbroken chain of measurement comparisons. This study proposed a new evaluation scheme for vehicle detectors including the practical uncertainty of proxy ground truths that conventional methods have ignored. In order to evaluate vehicle detectors under the new evaluation scheme, we conducted an experiment to estimate errors and uncertainties of a baseline data source on the basis of an upper level standard measurement using tape switch sensors with an oscilloscope. Including the estimated errors and uncertainties of the baseline data source, a new evaluation method proposed in this study was applied to a video image detection system evaluation. As a result, the new evaluation scheme provided more reliable results due to its statistical ground, compared to the conventional method. This study is expected to contribute to improving evaluation systems on traffic devices.