Phase recognition in contrast-enhanced CT scans based on deep learning and random sampling

Abstract

Purpose: A fully automated system for interpreting abdominal computed tomography (CT) scans with multiple phases of contrast enhancement requires an accurate classification of the phases. Current approaches to classify the CT phases are commonly based on three-dimensional (3D) convolutional neural network (CNN) approaches with high computational complexity and high latency. This work aims at developing and validating a precise, fast multiphase classifier to recognize three main types of contrast phases in abdominal CT scans.

Methods: We propose in this study a novel method that uses a random sampling mechanism on top of deep CNNs for the phase recognition of abdominal CT scans of four different phases: noncontrast, arterial, venous, and others. The CNNs work as a slicewise phase prediction, while random sampling selects input slices for the CNN models. Afterward, majority voting synthesizes the slicewise results of the CNNs to provide the final prediction at the scan level.

Results: Our classifier was trained on 271 426 slices from 830 phase-annotated CT scans, and when combined with majority voting on 30% of slices randomly chosen from each scan, achieved a mean F1 score of 92.09% on our internal test set of 358 scans. The proposed method was also evaluated on two external test sets: CTPAC-CCRCC (N = 242) and LiTS (N = 131), which were annotated by our experts. Although a drop in performance was observed, the model performance remained at a high level of accuracy with a mean F1 scores of 76.79% and 86.94% on CTPAC-CCRCC and LiTS datasets, respectively. Our experimental results also showed that the proposed method significantly outperformed the state-of-the-art 3D approaches while requiring less computation time for inference.

Conclusions: In comparison to state-of-the-art classification methods, the proposed approach shows better accuracy with significantly reduced latency. Our study demonstrates the potential of a precise, fast multiphase classifier based on a two-dimensional deep learning approach combined with a random sampling method for contrast phase recognition, providing a valuable tool for extracting multiphase abdomen studies from low veracity, real-world data.

Keywords: CT scans; deep learning; phase recognition.