CT colonography with computer-aided detection as a second reader: observer performance study

Radiology. 2008 Jan;246(1):148-56. doi: 10.1148/radiol.2453062161.

Abstract

Purpose: To evaluate the effect of computer-aided detection (CAD) as second reader on radiologists' diagnostic performance in interpreting computed tomographic (CT) colonographic examinations by using a primary two-dimensional (2D) approach, with segmental, unblinded optical colonoscopy as the reference standard.

Materials and methods: This HIPAA-compliant study was IRB-approved with written informed consent. Four board-certified radiologists analyzed 60 CT examinations with a commercially available review system. Two-dimensional transverse views were used for initial polyp detection, while three-dimensional (3D) endoluminal and 2D multiplanar views were available for problem solving. After initial review without CAD, the reader was shown CAD-identified polyp candidates. The readers were then allowed to add to or modify their original diagnoses. Polyp location, CT Colonography Reporting and Data System categorization, and reader confidence as to the likelihood of a candidate being a polyp were recorded before and after CAD reading. The area under the receiver operating characteristic (ROC) curve (AUC), sensitivity, and specificity were estimated for CT examinations with and without CAD readings by using multireader multicase analysis.

Results: Use of CAD led to nonsignificant average reader AUC increases of 0.03, 0.03, and 0.04 for patients with adenomatous polyps 6 mm or larger, 6-9 mm, and 10 mm or larger, respectively (P > or = .25); likewise, CAD increased average reader sensitivity by 0.15, 0.16, and 0.14 for those respective groups, with a corresponding decrease in specificity of 0.14. These changes achieved significance for the 6 mm or larger group (P < .01), 6-9 mm group (P < .02), and for specificity (P < .01), but not for the 10 mm or larger group (P > .16). The average reading time was 5.1 minutes +/- 3.4 (standard deviation) without CAD. CAD added an average of 3.1 minutes +/- 4.3 (62%) to each reading (supine and prone positions combined); average total reading time, 8.2 minutes +/- 5.8.

Conclusion: Use of CAD led to a significant increase in sensitivity for detecting polyps in the 6 mm or larger and 6-9 mm groups at the expense of a similar significant reduction in specificity.

Publication types

  • Research Support, N.I.H., Intramural

MeSH terms

  • Aged
  • Colonic Polyps / diagnosis
  • Colonic Polyps / diagnostic imaging*
  • Colonography, Computed Tomographic / methods*
  • Colonoscopy
  • Diagnosis, Computer-Assisted*
  • Female
  • Humans
  • Male
  • Middle Aged
  • Sensitivity and Specificity