The Framing Effect of Digital Textual Messages on Uptake Rates of Medical Checkups: Field Study

Abstract

Background: Health care authorities often use text messages to enhance compliance with medical recommendations. The effectiveness of different message framings has been studied extensively over the past 3 decades. Recently, health care providers have begun using digital media platforms to disseminate health-related messages.

Objective: This study aimed to examine the effectiveness of some of the most widely used message framings on the uptake rates of medical checkups.

Methods: This study used a large-scale digital outreach campaign conducted by Maccabi Healthcare Services (MHS) during 2020-2021, involving a total of 113,048 participants. MHS members aged 50-74 years were invited to take their recommended medical actions from the following list: human papillomavirus (HPV), mammography, abdominal aortic aneurysm, fecal occult blood test (FOBT), and pneumococcal vaccination. Each member was randomly assigned to receive 1 of 6 message framings: control (neutrally framed; n=20,959, 18.5%), gains (benefits of compliance; n=20,393, 18%), losses (negative consequences of noncompliance; n=15,165, 13.4%), recommendation (a recommendation by an authoritative figure, in this context by a physician; n=20,584, 18.2%), implementation intentions (linking potential outcomes to future reactions; n=20,701, 18.3%), and empowerment (emphasizing personal responsibility for maintaining good health; n=15,246, 13.5%). The time frames for measuring a successful intervention were 14 days for scheduling screenings (ie, HPV, mammography, or abdominal aortic aneurysm), 30 days for performing the FOBT, and 60 days for receiving pneumococcal vaccination. We also examined the effectiveness of media channels (text message or email) on uptake rates and whether the subject-line length is correlated with message-opening rates.

Results: No significant effect of message framing on uptake rates of medical checkups was observed. The rates of appointments for screening ranged from 12.9% to 14.1% across treatments. Based on a chi-square test, there was no evidence to reject the null hypothesis that these compliance rates are independent of the treatments (P=.35). The uptake rates for the FOBT and pneumococcal vaccination ranged from 23.3% to 23.8% across treatments, and we could not reject the hypothesis that they are independent of the treatments (P=.88). We also found that emails are more effective than text messages (P<.001) and that the subject-line length is negatively correlated with message-opening rates.

Conclusions: No evidence was found for an effect of the 5 message framings on uptake rates of medical checkups. To enhance compliance rates, public health officials may consider alternative framings. Furthermore, media channels and the subject-line length should be given careful consideration in the planning stages of health care campaigns.

Trial registration: AEA RCT Registry AEARCTR-0006317; https://www.socialscienceregistry.org/trials/6317/history/201365.

Keywords: behavior change; cancer screening; fecal occult blood test (FOBT); field experiment; framing; mammography; nudge; vaccination.