Diagnostic Identification of Acute Brain Dysfunction in Pediatric Sepsis and Septic Shock in the Electronic Health Record: A Comparison of Four Definitions in a Reference Dataset

Alicia M Alcamo; Andrew E Becker; Gregory J Barren; Katie Hayes; Jeffrey W Pennington; Martha A Q Curley; Robert C Tasker; Fran Balamuth; Scott L Weiss; Julie C Fitzgerald; Alexis A Topjian

doi:10.1097/PCC.0000000000003529

Diagnostic Identification of Acute Brain Dysfunction in Pediatric Sepsis and Septic Shock in the Electronic Health Record: A Comparison of Four Definitions in a Reference Dataset

Pediatr Crit Care Med. 2024 May 13. doi: 10.1097/PCC.0000000000003529. Online ahead of print.

Authors

Alicia M Alcamo^{1

2

3}, Andrew E Becker¹, Gregory J Barren⁴, Katie Hayes^{3

5}, Jeffrey W Pennington⁴, Martha A Q Curley^{2

6}, Robert C Tasker^{7

8}, Fran Balamuth^{3

5}, Scott L Weiss⁹, Julie C Fitzgerald^{1

2

3}, Alexis A Topjian^{1

2}

Affiliations

¹ Division of Critical Care Medicine, Department of Anesthesiology and Critical Care, The Children's Hospital of Philadelphia, Philadelphia, PA.
² Department of Anesthesiology and Critical Care, The University of Pennsylvania Perelman School of Medicine, Philadelphia, PA.
³ Pediatric Sepsis Program, The Children's Hospital of Philadelphia, Philadelphia, PA.
⁴ Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, PA.
⁵ Division of Emergency Medicine, The Children's Hospital of Philadelphia, Philadelphia, PA.
⁶ Department of Family and Community Health, The University of Pennsylvania School of Nursing, Philadelphia, PA.
⁷ Department of Anesthesiology, Critical Care and Pain Medicine, Boston Children's Hospital, Boston, MA.
⁸ Selwyn College, Cambridge University, Cambridge, United Kingdom.
⁹ Division of Critical Care Medicine, Nemours Children's Hospital, Wilmington, DE.

PMID: 38738953
DOI: 10.1097/PCC.0000000000003529

Abstract

Objectives: Acute brain dysfunction (ABD) in pediatric sepsis has a prevalence of 20%, but can be difficult to identify. Our previously validated ABD computational phenotype (CPABD) used variables obtained from the electronic health record indicative of clinician concern for acute neurologic or behavioral change. We tested whether the CPABD has better diagnostic performance to identify confirmed ABD than other definitions using the Glasgow Coma Scale or delirium scores.

Design: Diagnostic testing in a curated cohort of pediatric sepsis/septic shock patients.

Setting: Quaternary freestanding children's hospital.

Subjects: The test dataset comprised 527 children with sepsis/septic shock managed between 2011 and 2021 with a prevalence (pretest probability) of confirmed ABD of 30% (159/527).

Measurements and main results: CPABD was based on use of neuroimaging, electroencephalogram, and/or administration of new antipsychotic medication. We compared the performance of the CPABD with three GCS/delirium-based definitions of ABD-Proulx et al, International Pediatric Sepsis Consensus Conference, and Pediatric Organ Dysfunction Information Update Mandate. The posttest probability of identifying ABD was highest in CPABD (0.84) compared with other definitions. CPABD also had the highest sensitivity (83%; 95% CI, 76-89%) and specificity (93%; 95% CI, 90-96%). The false discovery rate was lowest in CPABD (1-in-6) as was the false omission rate (1-in-14). Finally, the prevalence threshold for the definitions varied, with the CPABD being the definition closest to 20%.

Conclusions: In our curated dataset of pediatric sepsis/septic shock, CPABD had favorable characteristics to identify confirmed ABD compared with GCS/delirium-based definitions. The CPABD can be used to further study the impact of ABD in studies using large electronic health datasets.