The Effect of Question Order on Outcomes in the Core Outcome Set for Brief Alcohol Interventions Among Online Help-Seekers: Protocol for a Factorial Randomized Trial

Marcus Bendtsen; Claire Garnett; Paul Toner; Gillian W Shorter

doi:10.2196/24175

The Effect of Question Order on Outcomes in the Core Outcome Set for Brief Alcohol Interventions Among Online Help-Seekers: Protocol for a Factorial Randomized Trial

JMIR Res Protoc. 2020 Nov 26;9(11):e24175. doi: 10.2196/24175.

Authors

Marcus Bendtsen^#¹, Claire Garnett^#², Paul Toner^#³, Gillian W Shorter^#³

Affiliations

¹ Department of Health, Medicine and Caring Sciences, Linköping University, Linköping, Sweden.
² Department of Behavioural Science and Health, University College London, London, United Kingdom.
³ Centre for Improving Health-Related Quality of Life, School of Psychology, Queen's University Belfast, Belfast, United Kingdom.

^# Contributed equally.

PMID: 33242024
PMCID: PMC7728524
DOI: 10.2196/24175

Abstract

Background: A core outcome set (COS) for trials and evaluations of the effectiveness and efficacy of alcohol brief interventions (ABIs) has recently been established through international consensus to address the variability of outcomes evaluated.

Objective: This is a protocol for studies to assess if there are order effects among the questions included in the COS.

Methods: The 10 items of the COS are organized into 4 clusters. A factorial design will be used with 24 arms, where each arm represents 1 order of the 4 clusters. Individuals searching online for help will be asked to complete a questionnaire, and consenting participants will be randomized to 1 of the 24 arms (double-blind with equal allocation). Participants will be included if they are 18 years or older. The primary analyses will (1) estimate how the order of the clusters of outcomes affects how participants respond and (2) investigate patterns of abandonment of the questionnaire.

Results: Data collection is expected to commence in November 2020. A Bayesian group sequential design will be used with interim analyses planned for every 50 participants completing the questionnaire. Data collection will end no more than 24 months after commencement, and the results are expected to be published no later than December 2023.

Conclusions: Homogenizing the outcomes evaluated in studies of ABIs is important to support synthesis, and the COS is an important step toward this goal. Determining whether there may be issues with the COS question order may improve confidence in using it and speed up its dissemination in the research community. We encourage others to adopt the protocol as a study within their trial as they adopt the ORBITAL (Outcome Reporting in Brief Intervention Trials: Alcohol) COS to build a worldwide repository and provide materials to support such analysis.

Trial registration: ISRCTN Registry ISRCTN17954645; http://www.isrctn.com/ISRCTN17954645.

International registered report identifier (irrid): PRR1-10.2196/24175.

Keywords: alcohol; brief alcohol intervention; effectiveness; efficacy; factorial trial; online intervention; order effects; outcomes; protocol; question order bias; randomized trial.

©Marcus Bendtsen, Claire Garnett, Paul Toner, Gillian W Shorter. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 26.11.2020.