Dealing with missing data in multi-informant studies: A comparison of approaches

Behav Res Methods. 2024 Feb 28. doi: 10.3758/s13428-024-02367-7. Online ahead of print.

Abstract

Multi-informant studies are popular in social and behavioral science. However, their data analyses are challenging because data from different informants carry both shared and unique information and are often incomplete. Using Monte Carlo Simulation, the current study compares three approaches that can be used to analyze incomplete multi-informant data when there is a distinction between reference and nonreference informants. These approaches include a two-method measurement model for planned missing data (2MM-PMD), treating nonreference informants' reports as auxiliary variables with the full-information maximum likelihood method or multiple imputation, and listwise deletion. The result suggests that 2MM-PMD, when correctly specified and data are missing at random, has the best overall performance among the examined approaches regarding point estimates, type I error rates, and statistical power. In addition, it is also more robust to data that are not missing at random.

Keywords: Auxiliary variables; Missing data; Multi-informant study; Planned missing data design models.