Perspective“Binary” and “Non-Binary” Detection Tasks: Are Current Performance Measures Optimal?
References (20)
- et al.
Computer-aided diagnosis for the detection and classification of lung cancers on chest radiographs ROC analysis of radiologists’ performance
Acad Radiol
(2006) - et al.
Independent versus sequential reading in ROC studies of computer-assist modalities: analysis of components of variance
Acad Radiol
(2002) - et al.
Comparison of independent double readings and computer-aided diagnosis (CAD) for the diagnosis of breast calcifications
Acad Radiol
(2006) - et al.
A contaminated binormal model for ROC data: part ISome interesting examples of binormal degeneracy
Acad Radiol
(2000) - et al.
A contaminated binormal model for ROC data: part IIA formal model
Acad Radiol
(2000) - et al.
A contaminated binormal model for ROC data: part IIIInitial evaluation with detection ROC data
Acad Radiol
(2000) - et al.
Continuous versus categorical data for ROC analysis: some quantitative considerations
Acad Radiol
(2001) - et al.
Improvement in radiologists’ characterization of malignant and benign breast masses on serial mammograms with computer-aided diagnosis: an ROC study
Radiology
(2004) - et al.
Classification of breast lesions with multimodality computer-aided diagnosis: observer study results on an independent clinical data set
Radiology
(2006) - et al.
Effects of luminance and resolution on observer performance
Radiology
(2000)
Cited by (16)
Reply
2011, Academic RadiologyThe Importance of ROC Data
2011, Academic RadiologyIs an ROC-type Response Truly Always Better Than a Binary Response in Observer Performance Studies?
2010, Academic RadiologyCitation Excerpt :The multicategory rating ROC approach allows for adjustments for the differences in latent thresholds during analysis and has been widely investigated and accepted as the preferred tool for assessing differences (if any) in performance summary indices between modes of operation. In one of our previous papers (20) we demonstrated the possible disadvantages that could result from forcing an “unnatural” multicategory rating scale onto a truly binary diagnostic task. However, there are tasks for which multicategory scales allow one to elicit information that can be useful for some purposes that could be only indirectly related to the question of interest.
Agreement of the Order of Overall Performance Levels Under Different Reading Paradigms
2008, Academic RadiologySelection of a Rating Scale in Receiver Operating Characteristic Studies: Some Remaining Issues
2008, Academic Radiology
Supported in part by Grants EB001694, EB002106, and EB003503 (to the University of Pittsburgh) from the National Institute for Biomedical Imaging and Bioengineering (NIBIB), National Institute of Health.