Bias in Before-After Studies: Narrative Overview for Anesthesiologists

Anesth Analg. 2018 May;126(5):1755-1762. doi: 10.1213/ANE.0000000000002705.

Abstract

Before-after study designs are effective research tools and in some cases, have changed practice. These designs, however, are inherently susceptible to bias (ie, systematic errors) that are sometimes subtle but can invalidate their conclusions. This overview provides examples of before-after studies relevant to anesthesiologists to illustrate potential sources of bias, including selection/assignment, history, regression to the mean, test-retest, maturation, observer, retrospective, Hawthorne, instrumentation, attrition, and reporting/publication bias. Mitigating strategies include using a control group, blinding, matching before and after cohorts, minimizing the time lag between cohorts, using prospective data collection with consistent measuring/reporting criteria, time series data collection, and/or alternative study designs, when possible. Improved reporting with enforcement of the Enhancing Quality and Transparency of Health Research (EQUATOR) checklists will serve to increase transparency and aid in interpretation. By highlighting the potential types of bias and strategies to improve transparency and mitigate flaws, this overview aims to better equip anesthesiologists in designing and/or critically appraising before-after studies.

Publication types

  • Review

MeSH terms

  • Anesthesiologists / standards*
  • Clinical Trials as Topic / methods*
  • Clinical Trials as Topic / standards*
  • Humans
  • Prospective Studies
  • Retrospective Studies
  • Selection Bias