Improvement in radiologists' characterization of malignant and benign breast masses on serial mammograms with computer-aided diagnosis: an ROC study

Radiology. 2004 Oct;233(1):255-65. doi: 10.1148/radiol.2331030432. Epub 2004 Aug 18.

Abstract

Purpose: To evaluate the effects of computer-aided diagnosis (CAD) on radiologists' characterization of masses on serial mammograms.

Materials and methods: Two hundred fifty-three temporal image pairs (138 malignant and 115 benign) obtained from 96 patients who had masses on serial mammograms were evaluated. The temporal pairs were formed by matching masses of the same view from two different examinations. Eight radiologists and two breast imaging fellows assessed the temporal pairs with and without computer aid. The classification of accuracy was quantified by using the area under receiver operating characteristic curve (A(z)). The statistical significance of the difference in A(z) between the different reading conditions was estimated with the Dorfman-Berbaum-Metz method for analysis of multireader multicase data and with the Student paired t test for analysis of observer-specific paired data.

Results: The average A(z) for radiologists' estimates of the likelihood of malignancy was 0.79 without CAD and improved to 0.84 with CAD. The improvement was statistically significant (P =.005). The corresponding average partial area index was 0.25 without CAD and improved to 0.37 with CAD. The improvement was also statistically significant (P =.005). On the basis of Breast Imaging Reporting and Data System assessments, it was estimated that with CAD, each radiologist, on average, reduced 0.7% (0.8 of 115) of unnecessary biopsies and correctly recommended 5.7% (7.8 of 138) of additional biopsies.

Conclusion: CAD based on analysis of interval changes can significantly increase radiologists' accuracy in classification of masses and thereby may be useful in improving correct biopsy recommendations.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Adult
  • Aged
  • Aged, 80 and over
  • Area Under Curve
  • Biopsy
  • Breast Neoplasms / diagnostic imaging*
  • False Positive Reactions
  • Female
  • Humans
  • Image Processing, Computer-Assisted
  • Likelihood Functions
  • Mammography* / statistics & numerical data
  • Matched-Pair Analysis
  • Middle Aged
  • Observer Variation
  • ROC Curve
  • Radiographic Image Interpretation, Computer-Assisted*
  • Radiology* / statistics & numerical data
  • Retrospective Studies