Time-dependent biases in observational studies of comparative effectiveness research in rheumatology. A methodological review

Ann Rheum Dis. 2019 Apr;78(4):562-569. doi: 10.1136/annrheumdis-2018-214544. Epub 2019 Feb 12.

Abstract

Objective: To assess to what extent time-dependent biases (ie, immortal time bias (ITB) and time-lag bias (TLB)) occur in the latest rheumatology observational studies, describe their main mechanisms and increase the awareness on this topic.

Methods: We searched PubMed for observational studies on rheumatic diseases published in leading medical journals in the last 5 years. Only studies with a time-to-event analysis exploring the association of one or more interventional strategies with an outcome were included. Each study was labelled as free from bias, at risk of TLB, at risk of misclassified ITB if the period of immortal time was incorrectly attributed to an intervention group, or at risk of excluded ITB if the immortal time was discarded from the analysis.

Results: We included 78 papers. Most studies were performed in Europe or North America (46% each), were not industry funded (62%) and had a safety primary outcome (59%). In total, 13 (17%) studies were considered at risk of time-dependent biases. Among the studies at risk of ITB (n=8; 10%), in 5 (6%), waiting time to receive treatment was wrongly attributed to the treatment exposure group, which indicated misclassified ITB. Five (6%) studies were at risk of TLB: patients on conventional synthetic disease-modifying antirheumatic drugs (DMARD; first-line drugs) were compared with patients on biologic DMARDs (second or third-line drugs) without accounting for disease duration or prior medication use.

Conclusions: One in six comparative effectiveness observational studies published in leading rheumatology journals is potentially flawed by time-dependent biases.

Keywords: autoimmune diseases; epidemiology; treatment.

Publication types

  • Review

MeSH terms

  • Antirheumatic Agents / therapeutic use
  • Bias
  • Biological Products / therapeutic use
  • Comparative Effectiveness Research / methods*
  • Comparative Effectiveness Research / standards
  • Humans
  • Observational Studies as Topic / methods*
  • Observational Studies as Topic / standards
  • Research Design
  • Rheumatic Diseases / therapy*
  • Time Factors

Substances

  • Antirheumatic Agents
  • Biological Products