Inter-Reader Agreement of Diffusion-Weighted Magnetic Resonance Imaging for Breast Cancer Detection: A Multi-Reader Retrospective Study

Cancers (Basel). 2021 Apr 20;13(8):1978. doi: 10.3390/cancers13081978.

Abstract

Purpose: In order to evaluate the use of un-enhanced magnetic resonance imaging (MRI) for detecting breast cancer, we evaluated the accuracy and the agreement of diffusion-weighted imaging (DWI) through the inter-reader reproducibility between expert and non-expert readers.

Material and methods: Consecutive breast MRI performed in a single centre were retrospectively evaluated by four radiologists with different levels of experience. The per-breast standard of reference was the histological diagnosis from needle biopsy or surgical excision, or at least one-year negative follow-up on imaging. The agreement across readers (by inter-reader reproducibility) was examined for each breast examined using Cohen's and Fleiss' kappa (κ) statistics. The Wald test was used to test the difference in inter-reader agreement between expert and non-expert readers.

Results: Of 1131 examinations, according to our inclusion and exclusion criteria, 382 women were included (49.5 ± 12 years old), 40 of them with unilateral mastectomy, totaling 724 breasts. Overall inter-reader reproducibility was substantial (κ = 0.74) for expert readers and poor (κ = 0.37) for non- expert readers. Pairwise agreement between expert readers and non-expert readers was moderate (κ = 0.60) and showed a statistically superior agreement of the expert readers over the non-expert readers (p = 0.003).

Conclusions: DWI showed substantial inter-reader reproducibility among expert-level readers. Pairwise comparison showed superior agreement of the expert readers over the non-expert readers, with the expert readers having higher inter-reader reproducibility than the non-expert readers. These findings open new perspectives for prospective studies investigating the actual role of DWI as a stand-alone method for un-enhanced breast MRI.

Keywords: agreement; breast cancer; diffusion-weighted imaging; oncology; radiology; reproducibility.