Diagnostic Performance of Artificial Intelligence-Based Computer-Aided Detection Software for Automated Breast Ultrasound

Abstract

Rationale and objectives: This study aimed to evaluate the diagnostic performance of radiologists following the utilization of artificial intelligence (AI)-based computer-aided detection software (CAD) in detecting suspicious lesions in automated breast ultrasounds (ABUS).

Materials and methods: ABUS-detected 262 breast lesions (histopathological verification; January 2020 to December 2022) were included. Two radiologists reviewed the images and assigned a Breast Imaging Reporting and Data System (BI-RADS) category. ABUS images were classified as positive or negative using AI-CAD. The BI-RADS category was readjusted in four ways: the radiologists modified the BI-RADS category using the AI results (AI-aided 1), upgraded or downgraded based on AI results (AI-aided 2), only upgraded for positive results (AI-aided 3), or only downgraded for negative results (AI-aided 4). The AI-aided diagnostic performances were compared to radiologists. The AI-CAD-positive and AI-CAD-negative cancer characteristics were compared.

Results: For 262 lesions (145 malignant and 117 benign) in 231 women (mean age, 52.2 years), the area under the receiver operator characteristic curve (AUC) of radiologists was 0.870 (95% confidence interval [CI], 0.832-0.908). The AUC significantly improved to 0.919 (95% CI, 0.890-0.947; P = 0.001) using AI-aided 1, whereas it improved without significance to 0.884 (95% CI, 0.844-0.923), 0.890 (95% CI, 0.852-0.929), and 0.890 (95% CI, 0.853-0.928) using AI-aided 2, 3, and 4, respectively. AI-CAD-negative cancers were smaller, less frequently exhibited retraction phenomenon, and had lower BI-RADS category. Among nonmass lesions, AI-CAD-negative cancers showed no posterior shadowing.

Conclusion: AI-CAD implementation significantly improved the radiologists' diagnostic performance and may serve as a valuable diagnostic tool.

Keywords: Artificial intelligence; Automated breast ultrasound; Computer-aided detection; Diagnostic performance; Ultrasonography.