Evaluation of the clinical application effect of eSource record tools for clinical research

BMC Med Inform Decis Mak. 2022 Apr 11;22(1):98. doi: 10.1186/s12911-022-01824-7.

Abstract

Background: Electronic sources (eSources) can improve data quality and reduce clinical trial costs. Our team has developed an innovative eSource record (ESR) system in China. This study aims to evaluate the efficiency, quality, and system performance of the ESR system in data collection and data transcription.

Methods: The study used time efficiency and data transcription accuracy indicators to compare the eSource and non-eSource data collection workflows in a real-world study (RWS). The two processes are traditional data collection and manual transcription (the non-eSource method) and the ESR-based source data collection and electronic transmission (the eSource method). Through the system usability scale (SUS) and other characteristic evaluation scales (system security, system compatibility, record quality), the participants' experience of using ESR was evaluated.

Results: In terms of the source data collection (the total time required for writing electronic medical records (EMRs)), the ESR system can reduce the time required by 39% on average compared to the EMR system. In terms of data transcription (electronic case report form (eCRF) filling and verification), the ESR can reduce the time required by 80% compared to the non-eSource method (difference: 223 ± 21 s). The ESR accuracy in filling the eCRF field is 96.92%. The SUS score of ESR is 66.9 ± 16.7, which is at the D level and thus very close to the acceptable margin, indicating that optimization work is needed.

Conclusions: This preliminary evaluation shows that in the clinical medical environment, the ESR-based eSource method can improve the efficiency of source data collection and reduce the workload required to complete data transcription.

Keywords: Data collection; Data transcription; Electronic medical record; Interoperability; Real-world study; Source data; System usability scale; eSource.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Data Accuracy*
  • Data Collection / methods
  • Electronic Health Records*
  • Humans
  • Research Design
  • Workflow