The Bland-Altman method should not be used when one of the two measurement methods has negligible measurement errors

PLoS One. 2022 Dec 12;17(12):e0278915. doi: 10.1371/journal.pone.0278915. eCollection 2022.

Abstract

Background: The Bland-Altman limits of agreement (LoA) method is almost universally used to compare two measurement methods when the outcome is continuous, despite warnings regarding the often-violated strong underlying statistical assumptions. In settings where only a single measurement per individual has been performed and one of the two measurement methods is exempt (or almost) from any measurement error, the LoA method provides biased results, whereas this is not the case for linear regression.

Methods: Thus, our goal is to explain why this happens and illustrate the advantage of linear regression in this particular setting. For our illustration, we used two data sets: a sample of simulated data, where the truth is known, and data from a validation study on the accuracy of a smartphone image-based dietary intake assessment tool.

Results: Our results show that when one of the two measurement methods is exempt (or almost) from any measurement errors, the LoA method should not be used as it provides biased results. In contrast, linear regression of the differences on the precise method was unbiased.

Conclusions: The LoA method should be abandoned in favor of linear regression when one of the two measurement methods is exempt (or almost) from measurement errors.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Linear Models
  • Nutrition Assessment*

Grants and funding

A research grant (Performance de l'outil digital de suivi de consommation alimentaire MyFoodRepo) was attributed to S. G. N. from the Committee for health promotion and fight against addictions of the Canton of Vaud (Commission de promotion de la santé et de lutte contre les addictions https://www.vd.ch/themes/sante-soins-et-handicap/prevention-et-maladies/appel-a-projets/exemples-de-projets-finances/). The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.