A deep learning model with data integration of ultrasound contrast-enhanced micro-flow cines, B-mode images, and clinical parameters for diagnosing significant liver fibrosis in patients with chronic hepatitis B

Abstract

Objective: To develop and investigate a deep learning model with data integration of ultrasound contrast-enhanced micro-flow (CEMF) cines, B-mode images, and patients' clinical parameters to improve the diagnosis of significant liver fibrosis (≥ F2) in patients with chronic hepatitis B (CHB).

Methods: Of 682 CHB patients who underwent ultrasound and histopathological examinations between October 2016 and May 2020, 218 subjects were included in this retrospective study. We devised a data integration-based deep learning (DIDL) model for assessing ≥ F2 in CHB patients. The model contained three convolutional neural network branches to automatically extract features from ultrasound CEMF cines, B-mode images, and clinical data. The extracted features were fused at the backend of the model for decision-making. The diagnostic performance was evaluated across fivefold cross-validation and compared against the other methods in terms of the area under the receiver operating characteristic curve (AUC), with histopathological results as the reference standard.

Results: The mean AUC achieved by the DIDL model was 0.901 [95% CI, 0.857-0.939], which was significantly higher than those of the comparative methods, including the models trained by using only CEMF cines (0.850 [0.794-0.893]), B-mode images (0.813 [0.754-0.862]), or clinical data (0.757 [0.694-0.812]), as well as the conventional TIC method (0.752 [0.689-0.808]), APRI (0.792 [0.734-0.845]), FIB-4 (0.776 [0.714-0.829]), and visual assessments of two radiologists (0.812 [0.754-0.862], and 0.800 [0.739-0.849]), all ps < 0.01, DeLong test.

Conclusion: The DIDL model with data integration of ultrasound CEMF cines, B-mode images, and clinical parameters showed promising performance in diagnosing significant liver fibrosis for CHB patients.

Key points: • The combined use of ultrasound contrast-enhanced micro-flow cines, B-mode images, and clinical data in a deep learning model has potential to improve the diagnosis of significant liver fibrosis. • The deep learning model with the fusion of features extracted from multimodality data outperformed the conventional methods including mono-modality data-based models, the time-intensity curve-based recognizer, fibrosis biomarkers, and visual assessments by experienced radiologists. • The interpretation of the feature attention maps in the deep learning model may help radiologists get better understanding of liver fibrosis-related features and hence potentially enhancing their diagnostic capacities.

Keywords: Deep learning; Diagnosis, computer-assisted; Hepatitis B; Ultrasonography.