Background: Intracerebral hemorrhage (ICH) is a devastating stroke type that causes high mortality rates and severe disability among survivors. Many prognostic models are available for prognosticating patients with ICH. This study aimed to investigate whether clinical narratives can improve the performance for predicting functional outcomes after ICH.
Methods: This study used data from the hospital stroke registry and electronic health records. The study population (n = 1363) was randomly divided into a training set (75%, n = 1023) and a holdout test set (25%, n = 340). Five risk scores for ICH were used as baseline prognostic models. Using natural language processing (NLP), text-based markers were generated from the clinical narratives of the training set through machine learning (ML) and deep learning (DL) approaches. The primary outcome was a poor functional outcome (modified Rankin Scale score of 3 to 6) at hospital discharge. The predictive performance was compared between the baseline models and models enhanced by incorporating the text-based markers using the holdout test set.
Results: The enhanced prognostic models outperformed the baseline models, regardless of whether ML or DL approaches were used. The areas under the receiver operating characteristic curve (AUCs) of the baseline models were between 0.760 and 0.892. Adding the text-based marker to the baseline models significantly increased the model discrimination, with AUCs ranging from 0.861 to 0.914. The net reclassification improvement and integrated discrimination improvement indices also showed significant improvements.
Conclusions: Using NLP to extract textual information from clinical narratives could improve the predictive performance of all baseline prognostic models for ICH.
Keywords: Deep learning; Intracerebral hemorrhage; Machine learning; Prognosis; Risk assessment.
Copyright © 2023. Published by Elsevier B.V.