Objectives: Artificial intelligence (AI) is expected to alleviate the negative consequences of rising case numbers for radiologists. Currently, systematic evaluations of the impact of AI solutions in real-world radiological practice are missing. Our study addresses this gap by investigating the impact of the clinical implementation of an AI-based computer-aided detection system (CAD) for prostate MRI reading on clinicians' workflow, workflow throughput times, workload, and stress.
Materials and methods: CAD was newly implemented into radiology workflow and accompanied by a prospective pre-post study design. We assessed prostate MRI case readings using standardized work observations and questionnaires. The observation period was three months each in a single department. Workflow throughput times, PI-RADS score, CAD usage and radiologists' self-reported workload and stress were recorded. Linear mixed models were employed for effect identification.
Results: In data analyses, 91 observed case readings (pre: 50, post: 41) were included. Variation of routine workflow was observed following CAD implementation. A non-significant increase in overall workflow throughput time was associated with CAD implementation (mean 16.99 ± 6.21 vs 18.77 ± 9.69 min, p = .51), along with an increase in diagnostic reading time for high suspicion cases (mean 15.73 ± 4.99 vs 23.07 ± 8.75 min, p = .02). Changes in radiologists' self-reported workload or stress were not found.
Conclusion: Implementation of an AI-based detection aid was associated with lower standardization and no effects over time on radiologists' workload or stress. Expectations of AI decreasing the workload of radiologists were not confirmed by our real-world study.
Pre-registration: German register for clinical trials https://drks.de/; DRKS00027391.
Keywords: Artificial intelligence; Magnetic resonance imaging; Prostate; Workflow.
Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved.