Multiple-reader studies, digital mammography, computer-aided diagnosis, and the Holy Grail of imaging physics: I
Robert F. Wagner, Sergey V. Beiden, Gregory Campbell · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2001
There are multiple sources of variability in clinical studies of imaging systems. The variation of the reader `mindset' establishes the need for ROC analysis to control for that fundamental variable. The demonstration of the range of reader skills in mammography shows the need for a multivariate approach to ROC analysis. The multiple-reader, multiple-case (MRMC) ROC experimental paradigm addresses this need and several practical solutions to the problem of analysis of MRMC data have been developed. We review the application of these methods to an important clinical comparison of digital and conventional mammography.