A New Performance Evaluation Method Based on ROC Curve
Huaitie Xiao · Radar Science and Technology · 2007
The most commonly used evaluation measures in automatic target recognition(ATR) are classification accuracy(CA), precision, the probability of detection(PD), confusion matrix and so on. However, all of these measures have the shortcomings inherently. They are not robust to the prior probability of classes. Recently the ROC curve evaluation method is widely used and developed, because the evaluation conclusions based on the ROC curve is insensitive to the prior probability of classes and it overcomes the defects of the previous commonly used evaluation measures. It can be performed even without knowledge of the cost of incorrect classification, and most attractively it can give a multiple threshold evaluation. We firstly talk about the concept of the ROC curve and the way to plot the curve, and then talk about the measures based on the ROC curve in detail.