Advances in methodologies of negative controls: a scoping review

Abstract

Objectives: Negative controls are considered an important tool to mitigate biases in observational studies. The aim of this scoping review was to summarize current methodologies of negative controls (both negative control exposure [NCE] and negative control outcome [NCO]).

Study design and setting: We searched PubMed, Web of Science, Embase, and Cochrane Library (up to March 9, 2023) for articles on methodologies of negative controls. Two reviewers selected eligible studies and collected relevant data independently and in duplicate. We reported total numbers and percentages, and summarized methodologies narratively.

Results: A total of 37 relevant methodological articles were included in our review. These publications covered NCE (n = 11, 29.8%), NCO (n = 13, 35.1%), or both (n = 13, 35.1%), with most focused on bias detection (n = 14, 37.8%), bias correction (n = 16, 43.3%), and P value or confidence interval (CI) calibration (n = 5, 13.5%). For the two remaining articles (5.4%), one discussed bias detection and P value or CI calibration and the other covered all the three functions. For bias detection, the existence of an association between the NCE (NCO) and outcome (exposure) variables of interest simply indicates that results may suffer from confounding bias, selection bias and/or information bias. For bias correction, however, the algorithms of negative control methods need more stringent assumptions such as rank preservation, monotonicity, and linearity.

Conclusion: Negative controls can be leveraged for bias detection, P value or CI calibration, and bias correction, among which bias correction has been the most studied methodologically. The current available methods need some stringent assumptions to detect or remove bias. More methodological research is needed to optimize the use of negative controls.

Keywords: Causal inference; Methodology; Negative control exposure; Negative control outcome; Scoping review; Unmeasured confounding.