Appropriateness of Alerts and Physicians' Responses With a Medication-Related Clinical Decision Support System: Retrospective Observational Study

Hyunjung Park; Minjung Kathy Chae; Woohyeon Jeong; Jaeyong Yu; Weon Jung; Hansol Chang; Won Chul Cha

doi:10.2196/40511

Appropriateness of Alerts and Physicians' Responses With a Medication-Related Clinical Decision Support System: Retrospective Observational Study

JMIR Med Inform. 2022 Oct 4;10(10):e40511. doi: 10.2196/40511.

Authors

Hyunjung Park^#¹, Minjung Kathy Chae¹, Woohyeon Jeong¹, Jaeyong Yu¹, Weon Jung¹, Hansol Chang^{1

2}, Won Chul Cha^#^{1

2

3}

Affiliations

¹ Department of Digital Health, Samsung Advanced Institute of Health Sciences & Technology, Sungkyunkwan University, Seoul, Republic of Korea.
² Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
³ Digital Innovation Center, Samsung Medical Center, Seoul, Republic of Korea.

^# Contributed equally.

PMID: 36194461
PMCID: PMC9579928
DOI: 10.2196/40511

Abstract

Background: Alert fatigue is unavoidable when many irrelevant alerts are generated in response to a small number of useful alerts. It is necessary to increase the effectiveness of the clinical decision support system (CDSS) by understanding physicians' responses.

Objective: This study aimed to understand the CDSS and physicians' behavior by evaluating the clinical appropriateness of alerts and the corresponding physicians' responses in a medication-related passive alert system.

Methods: Data on medication-related orders, alerts, and patients' electronic medical records were analyzed. The analyzed data were generated between August 2019 and June 2020 while the patient was in the emergency department. We evaluated the appropriateness of alerts and physicians' responses for a subset of 382 alert cases and classified them.

Results: Of the 382 alert cases, only 7.3% (n=28) of the alerts were clinically appropriate. Regarding the appropriateness of the physicians' responses about the alerts, 92.4% (n=353) were deemed appropriate. In the classification of alerts, only 3.4% (n=13) of alerts were successfully triggered, and 2.1% (n=8) were inappropriate in both alert clinical relevance and physician's response. In this study, the override rate was 92.9% (n=355).

Conclusions: We evaluated the appropriateness of alerts and physicians' responses through a detailed medical record review of the medication-related passive alert system. An excessive number of unnecessary alerts are generated, because the algorithm operates as a rule base without reflecting the individual condition of the patient. It is important to maximize the value of the CDSS by comprehending physicians' responses.

Keywords: alert fatigue; alert system; clinical decision support system; computerized physician order entry; decision-making support; health personnel; physician behavior; physician response.

©Hyunjung Park, Minjung Kathy Chae, Woohyeon Jeong, Jaeyong Yu, Weon Jung, Hansol Chang, Won Chul Cha. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 04.10.2022.