Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records

J Am Med Inform Assoc. 2017 Jul 1;24(4):697-708. doi: 10.1093/jamia/ocw168.

Abstract

Objective: We propose 2 Medical Dictionary for Regulatory Activities-enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy.

Matrials and methods: This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)-based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs ( n = 101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11 817 and 76 457 drug-ADR pairs, respectively.

Results: We demonstrate that MetaLAB (area under the curve, AUC = 0.61 ± 0.18) outperformed CLEAR (AUC = 0.55 ± 0.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69 ± 0.11; 0.62 ± 0.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database.

Discussion: The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles.

Conclusion: Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.

Keywords: adverse drug reactions; algorithms; laboratory abnormalities; pharmacovigilance; postmarketing surveillance; standard nursing statements.

MeSH terms

  • Adverse Drug Reaction Reporting Systems*
  • Algorithms*
  • Area Under Curve
  • Clinical Laboratory Information Systems*
  • Electronic Health Records
  • Humans
  • Nursing Records*
  • Pharmacovigilance*
  • ROC Curve