The peril of self-reported adherence in digital interventions: A brief example

Jayde A M Flett; Benjamin D Fletcher; Benjamin C Riordan; Tess Patterson; Harlene Hayne; Tamlin S Conner

doi:10.1016/j.invent.2019.100267

The peril of self-reported adherence in digital interventions: A brief example

Internet Interv. 2019 Aug 23:18:100267. doi: 10.1016/j.invent.2019.100267. eCollection 2019 Dec.

Authors

Jayde A M Flett^{1

2}, Benjamin D Fletcher¹, Benjamin C Riordan¹, Tess Patterson^{2

3}, Harlene Hayne¹, Tamlin S Conner¹

Affiliations

¹ Department of Psychology, University of Otago, P.O. Box 56, Dunedin 9054, New Zealand.
² Department of Psychological Medicine, School of Medicine, University of Otago, P.O. Box 56, Dunedin 9054, New Zealand.
³ Optentia Research Focus Area, North-West University, P.O. Box 1174, Vanderbijlpark, Gauteng, South Africa.

Abstract

Adherence is an important predictor of intervention outcomes, but not all measures of adherence are created equally. Here, we analyzed whether there was a discrepancy between self-report adherence and objective adherence in a digital mindfulness meditation randomised, controlled trial. A sample of 174 young adult undergraduate university students trialled either an app-based or email-based mindfulness meditation program (or an app-based attention control). Participants' adherence (number of sessions completed) and mental health was self-reported. Objective adherence data were provided by the owners of the digital mindfulness programs. We found evidence of inflated self-reported adherence to the app-based intervention and argue that the inflation was not explained by social desirability biases because participants were aware we would have access to object data and no remuneration was tied to adherence. We also comment on the different conclusions we would have drawn about the effectiveness of the digital interventions on mental health, had we used the self-reported adherence data rather than the objective adherence data. We use this example to suggest that it may be perilous to rely on self-reported measures of adherence when assessing the effectiveness of digital interventions.

Keywords: Adherence; Applications; Digital interventions; M, mean; Mobile phones; RCT, randomized, controlled trial; SD, standard deviation.