Development and Validation of an Automatic System for Intracerebral Hemorrhage Medical Text Recognition and Treatment Plan Output

Bo Deng; Wenwen Zhu; Xiaochuan Sun; Yanfeng Xie; Wei Dan; Yan Zhan; Yulong Xia; Xinyi Liang; Jie Li; Quanhong Shi; Li Jiang

doi:10.3389/fnagi.2022.798132

Development and Validation of an Automatic System for Intracerebral Hemorrhage Medical Text Recognition and Treatment Plan Output

Front Aging Neurosci. 2022 Apr 8:14:798132. doi: 10.3389/fnagi.2022.798132. eCollection 2022.

Authors

Bo Deng¹, Wenwen Zhu², Xiaochuan Sun¹, Yanfeng Xie¹, Wei Dan¹, Yan Zhan¹, Yulong Xia¹, Xinyi Liang¹, Jie Li², Quanhong Shi¹, Li Jiang¹

Affiliations

¹ Department of Neurosurgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China.
² School of Intelligent Technology and Engineering, Chongqing University of Science and Technology, Chongqing, China.

Abstract

The main purpose of the study was to explore a reliable way to automatically handle emergency cases, such as intracerebral hemorrhage (ICH). Therefore, an artificial intelligence (AI) system, named, H-system, was designed to automatically recognize medical text data of ICH patients and output the treatment plan. Furthermore, the efficiency and reliability of the H-system were tested and analyzed. The H-system, which is mainly based on a pretrained language model Bidirectional Encoder Representations from Transformers (BERT) and an expert module for logical judgment of extracted entities, was designed and founded by the neurosurgeon and AI experts together. All emergency medical text data were from the neurosurgery emergency electronic medical record database (N-eEMRD) of the First Affiliated Hospital of Chongqing Medical University, Chongqing Emergency Medical Center, and Chongqing First People's Hospital, and the treatment plans of these ICH cases were divided into two types. A total of 1,000 simulated ICH cases were randomly selected as training and validation sets. After training and validating on simulated cases, real cases from three medical centers were provided to test the efficiency of the H-system. Doctors with 1 and 5 years of working experience in neurosurgery (Doctor-1Y and Doctor-5Y) were included to compare with H-system. Furthermore, the data of the H-system, for instance, sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and the area under the receiver operating characteristics curve (AUC), were calculated and compared with Doctor-1Y and Doctor-5Y. In the testing set, the time H-system spent on ICH cases was significantly shorter than that of doctors with Doctor-1Y and Doctor-5Y. In the testing set, the accuracy of the H-system's treatment plan was 88.55 (88.16-88.94)%, the specificity was 85.71 (84.99-86.43)%, and the sensitivity was 91.83 (91.01-92.65)%. The AUC value of the H-system in the testing set was 0.887 (0.884-0.891). Furthermore, the time H-system spent on ICH cases was significantly shorter than that of doctors with Doctor-1Y and Doctor-5Y. The accuracy and AUC of the H-system were significantly higher than that of Doctor-1Y. In addition, the accuracy of the H-system was more closed to that of Doctor-5Y. The H-system designed in the study can automatically recognize and analyze medical text data of patients with ICH and rapidly output accurate treatment plans with high efficiency. It may provide a reliable and novel way to automatically and rapidly handle emergency cases, such as ICH.

Keywords: artificial intelligence (AI); intracerebral hemorrhage (ICH); natural language processing (NLP); neurosurgery emergency electrical medical record database (N-eEMRD); stroke.