Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Geisinger Clinic | OTHER |
Not provided
Not provided
Not provided
Not provided
This research aims to identify which behavioral science strategies are most effective at increasing flu vaccination rates overall and based on patients' individual characteristics. Past behavioral science interventions have shown promise in increasing flu vaccinations. For example, successful interventions have encouraged people to make concrete plans for when they will get a flu vaccination (Milkman et al. 2011), sent automated calls or text messages reminding patients to get a flu vaccination (Cutrona et al. 2018; Regan et al. 2017), or provided financial incentives for getting vaccinated (Nowalk et al. 2010). Although these results are promising, these studies have been conducted in isolation on different populations, which makes it difficult to compare their interventions' effectiveness or to have enough power to reliably detect differing responses to interventions based on individual characteristics.
This research will simultaneously test 19 different SMS interventions to increase flu vaccinations in a "mega-study" and apply machine learning to identify which interventions work best for whom. The interventions are designed by behavioral science experts from the Behavior Change for Good Initiative (BCFG), Penn Medicine Nudge Unit (PMNU), and Geisinger Behavioral Insights Team (BIT). We expect to include at least 80,000 participants.
The specific aims of this research are to identify (1) which behavioral science strategies effectively increase flu vaccination rates overall, and (2) which strategies are most effective for different subgroups (e.g., based on age, gender, race).
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Holdout control | No Intervention | Participants will only receive the standard appointment reminders from their providers. | |
| Default Reservations Opt-Out Condition | Experimental | The day before their scheduled appointment, participants receive a text reading: "A flu shot has been reserved for you to receive at your appointment tomorrow. Reply Y if you want this shot held for you, N if you don't." The text will include a picture of a vial that says "Your Flu Shot" on it. |
|
| Default Reservations Opt-In Condition | Experimental | The day before their scheduled appointment, participants receive a text reading: "Reply Y if you would like to receive a flu shot at your appointment tomorrow, N if not." The text will include a picture of vial with no text on it. |
|
| Intergroup Competition Treatment Condition | Experimental | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind "another region" in flu shot rate last year ("your region" and "another region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. |
|
| Intergroup Competition Control Condition |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Flu shot text messages | Behavioral | Participants will receive text messages per descriptions listed in the arms. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Number of Participants With Flu Shot Receipt at or Before Appointment | Our field experiment will be conducted with Penn Medicine and Geisinger Health patients via SMS messages sent prior to their first primary care appointment during the study period, hereafter referred to as the "target appointment." The key dependent variable is whether participants receive a flu shot at or before their target appointment (as recorded in their electronic health records). If participants cancel or do not show up for their target appointment after they have been randomized to a treatment and then schedule a new appointment during the study period, their new primary care appointment becomes the target appointment. Participants who have been randomized to a treatment will be counted as not having received a flu shot if they cancel or do not show up for their target appointment and do not schedule a new appointment during the study period. Participants who receive a flu shot before they receive the SMS intervention will be excluded from the analyses. | The dependent variable will be assessed during a 4-day period after randomization starting three days prior to the participant's target primary care appointment through the date of the target appointment (including the date of the appointment) |
| Measure | Description | Time Frame |
|---|---|---|
| Number of Participants With Flu Shot Receipt Before March 31, 2021 | The secondary dependent variable is whether participants receive the flu shot at or before their target appointment or at any time after this appointment (by March 31, 2021), as recorded in their electronic health records. Participants who receive a flu shot before they receive the SMS intervention will be excluded from the analyses. |
Not provided
Penn Medicine and Geisinger patients will be included if they:
Inclusion Criteria:
Exclusion Criteria:
We will recruit as many patients as possible starting in September 2020. We will stop enrolling participants with appointments scheduled to occur after December 31, 2020 if we have reached 4,000 participants per condition. If we do not have 4,000 participants per condition by December 31, 2020, we will continue enrolling participants until we have reached 4,000 per condition, or until March 31, 2021 (discontinuing enrollment at whichever milestone arrives sooner - 4,000 people enrolled or 3/31/21).
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Geisinger Health | Danville | Pennsylvania | 17822 | United States | ||
| University of Pennsylvania Health System |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 29383550 | Background | Cutrona SL, Golden JG, Goff SL, Ogarek J, Barton B, Fisher L, Preusse P, Sundaresan D, Garber L, Mazor KM. Improving Rates of Outpatient Influenza Vaccination Through EHR Portal Messages and Interactive Automated Calls: A Randomized Controlled Trial. J Gen Intern Med. 2018 May;33(5):659-667. doi: 10.1007/s11606-017-4266-9. Epub 2018 Jan 30. | |
| 21670283 |
Not provided
Not provided
Aggregate data and code used for analyses conducted on participants enrolled from September through December is available at https://osf.io/tucjs/?view\_only=c491df37a33840abbdedda4e60176f34. This reflects the analyses and data included in this paper: https://www.pnas.org/content/118/20/e2101165118.
Researchers interested in using individual-level data to replicate our results should contact the Behavior Change for Good Initiative at the University of Pennsylvania (bcfg@wharton.upenn.edu) and must sign a standard medical data nondisclosure agreement to access the data on a protected medical server.
Not provided
Not provided
Not provided
A small number of patients in each experimental condition did not receive any intervention messages due to technical malfunctions. These patients are excluded from analyses since they were, for all practical purposes, not a part of of our study
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Holdout Control | Participants will only receive the standard appointment reminders from their providers. |
| FG001 | Default Reservations Opt-Out Condition | The day before their scheduled appointment, participants receive a text reading: "A flu shot has been reserved for you to receive at your appointment tomorrow. Reply Y if you want this shot held for you, N if you don't." The text will include a picture of a vial that says "Your Flu Shot" on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG002 | Default Reservations Opt-In Condition | The day before their scheduled appointment, participants receive a text reading: "Reply Y if you would like to receive a flu shot at your appointment tomorrow, N if not." The text will include a picture of vial with no text on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG003 | Intergroup Competition Treatment Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind "another region" in flu shot rate last year ("your region" and "another region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG004 | Intergroup Competition Control Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind the target flu shot rate of 70% last year ("your region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG005 | Flu Shot for You Symbolic Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity to dedicate getting the flu shot to someone by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG006 | Flu Shot for You Herd Immunity Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity of getting the flu shot to protect a vulnerable loved one by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG007 | Flu Shot for You Control Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also receive a reminder message on the day of the appointment. They will not receive any further information, nor will they be asked to respond with initials of an individual. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG008 | Prosocial Condition | The day before their scheduled appointment, participants will receive a message describing the pro-social benefits of getting a flu shot, and a reminder to ask for their flu shot. The described pro-social benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting loved ones from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting loved ones from serious complications from the flu). Participants will also receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG009 | Self-Oriented Condition | The day before their scheduled appointment, participants will receive a message describing the self-oriented benefits of getting a flu shot, and a reminder to ask for their flu shot. The described self-oriented benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting oneself from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting oneself from serious complications from the flu). Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG010 | Information Vivid Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain vivid information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG011 | Information Basic Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain basic information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG012 | Information Control Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain information about exercising. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG013 | Sharing Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. The message will include a joke about the flu and will encourage participants to share the joke with nurses, doctors, or pharmacists. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG014 | No Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG015 | Healthy Habits Easy Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of easy health behaviors (e.g., whether they walked 500 feet yesterday, at least two serving of fruits and vegetables in the last week, and slept at least 6 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG016 | Healthy Habits Difficult Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of difficult health behaviors (e.g., whether they walked 3 miles yesterday, ate 4-6 servings of fruits and vegetables yesterday, and slept at least 9 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG017 | Healthy Habits Control Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG018 | Just-In-Time Reminders 24-Hour Condition | Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 24 hours before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| FG019 | Just-In-Time Reminders 15-Minute Condition | Just-In-Time Reminders 15-Minute Condition: Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 15 minutes before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| Title | Milestones | Reasons Not Completed | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Overall Study |
|
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Holdout Control | Participants will only receive the standard appointment reminders from their providers. |
| BG001 | Default Reservations Opt-Out Condition | The day before their scheduled appointment, participants receive a text reading: "A flu shot has been reserved for you to receive at your appointment tomorrow. Reply Y if you want this shot held for you, N if you don't." The text will include a picture of a vial that says "Your Flu Shot" on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes |
|---|---|---|---|---|---|---|---|---|---|
| Age, Categorical | Count of Participants |
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Number of Participants With Flu Shot Receipt at or Before Appointment | Our field experiment will be conducted with Penn Medicine and Geisinger Health patients via SMS messages sent prior to their first primary care appointment during the study period, hereafter referred to as the "target appointment." The key dependent variable is whether participants receive a flu shot at or before their target appointment (as recorded in their electronic health records). If participants cancel or do not show up for their target appointment after they have been randomized to a treatment and then schedule a new appointment during the study period, their new primary care appointment becomes the target appointment. Participants who have been randomized to a treatment will be counted as not having received a flu shot if they cancel or do not show up for their target appointment and do not schedule a new appointment during the study period. Participants who receive a flu shot before they receive the SMS intervention will be excluded from the analyses. | Posted | Count of Participants | Participants | The dependent variable will be assessed during a 4-day period after randomization starting three days prior to the participant's target primary care appointment through the date of the target appointment (including the date of the appointment) |
9/20/20 - 3/31/21 -- A period of over six months
This is a minimal risk study, eligible for expedited IRB review in keeping with 45 CFR §46.110. All data is gathered from Electronic Health Records (EHR).
EHR data will report inputs and outcomes; we will therefore be unable to monitor this data for AE/SAEs. Data will be received at the end of the study and may also be received periodically over the course of the study. Even if we receive data periodically, however, we will not be able to monitor it for AE/SAEs
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Holdout Control | Participants will only receive the standard appointment reminders from their providers. |
Not provided
Not provided
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Dr. Joseph Kay | Behavior Change for Good initiative | 2157466609 | jskay@wharton.upenn.edu |
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot | Yes | No | No | Study Protocol | Jun 11, 2021 | Jul 14, 2021 | Prot_000.pdf |
| SAP | No | Yes | No | Statistical Analysis Plan | Jul 15, 2021 | Jul 15, 2021 | SAP_001.pdf |
Not provided
| ID | Term |
|---|---|
| D007251 | Influenza, Human |
| ID | Term |
|---|---|
| D012141 | Respiratory Tract Infections |
| D007239 | Infections |
| D009976 | Orthomyxoviridae Infections |
| D012327 | RNA Virus Infections |
Not provided
Not provided
Participants will be randomly assigned to the different arms. Randomization will be stratified by age (65+ vs. 18-64), vaccine receipt in 2019-2020 flu season (yes vs. no/unknown), and study site (Penn Medicine vs. Geisinger).
Not provided
Not provided
As treated participants will receive text messages, there is no scope for blinding. Care providers will not be made aware of subjects' participation in the study, or assigned treatment arms. The study team will only receive data on subjects' assigned arms at the end of the study.
| Experimental |
Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind the target flu shot rate of 70% last year ("your region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. |
|
| Flu Shot for You Symbolic Condition | Experimental | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity to dedicate getting the flu shot to someone by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. |
|
| Flu Shot for You Herd Immunity Condition | Experimental | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity of getting the flu shot to protect a vulnerable loved one by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. |
|
| Flu Shot for You Control Condition | Experimental | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also receive a reminder message on the day of the appointment. They will not receive any further information, nor will they be asked to respond with initials of an individual. |
|
| Prosocial Condition | Experimental | The day before their scheduled appointment, participants will receive a message describing the pro-social benefits of getting a flu shot, and a reminder to ask for their flu shot. The described pro-social benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting loved ones from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting loved ones from serious complications from the flu). Participants will also receive a reminder message on the day of the appointment. |
|
| Self-Oriented Condition | Experimental | The day before their scheduled appointment, participants will receive a message describing the self-oriented benefits of getting a flu shot, and a reminder to ask for their flu shot. The described self-oriented benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting oneself from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting oneself from serious complications from the flu). |
|
| Information Vivid Condition | Experimental | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain vivid information about getting the flu. Participants will also receive a reminder message the day before the appointment. |
|
| Information Basic Condition | Experimental | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain basic information about getting the flu. Participants will also receive a reminder message the day before the appointment. |
|
| Information Control Condition | Experimental | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain information about exercising. Participants will also receive a reminder message the day before the appointment. |
|
| Sharing Humor Condition | Experimental | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. The message will include a joke about the flu and will encourage participants to share the joke with nurses, doctors, or pharmacists. |
|
| No Humor Condition | Experimental | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. |
|
| Healthy Habits Easy Health Behavior Condition | Experimental | The day before their scheduled appointment, participants will be asked if they have completed a series of easy health behaviors (e.g., whether they walked 500 feet yesterday, at least two serving of fruits and vegetables in the last week, and slept at least 6 hours the previous night). They will then be encouraged to get a flu shot at their appointment. |
|
| Healthy Habits Difficult Health Behavior Condition | Experimental | The day before their scheduled appointment, participants will be asked if they have completed a series of difficult health behaviors (e.g., whether they walked 3 miles yesterday, ate 4-6 servings of fruits and vegetables yesterday, and slept at least 9 hours the previous night). They will then be encouraged to get a flu shot at their appointment. |
|
| Healthy Habits Control Condition | Experimental | The day before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. |
|
| Just-In-Time Reminders 24-Hour Condition | Experimental | Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 24 hours before their appointment. |
|
| Just-In-Time Reminders 15-Minute Condition | Experimental | Just-In-Time Reminders 15-Minute Condition: Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 15 minutes before their appointment. |
|
| Up to 6 months after randomization. |
| Philadelphia |
| Pennsylvania |
| 19104 |
| United States |
| Milkman KL, Beshears J, Choi JJ, Laibson D, Madrian BC. Using implementation intentions prompts to enhance influenza vaccination rates. Proc Natl Acad Sci U S A. 2011 Jun 28;108(26):10415-20. doi: 10.1073/pnas.1103170108. Epub 2011 Jun 13. |
| 29133488 | Background | Regan AK, Bloomfield L, Peters I, Effler PV. Randomized Controlled Trial of Text Message Reminders for Increasing Influenza Vaccination. Ann Fam Med. 2017 Nov;15(6):507-514. doi: 10.1370/afm.2120. |
| 20036102 | Background | Nowalk MP, Lin CJ, Toback SL, Rousculp MD, Eby C, Raymund M, Zimmerman RK. Improving influenza vaccination rates in the workplace: a randomized trial. Am J Prev Med. 2010 Mar;38(3):237-46. doi: 10.1016/j.amepre.2009.11.011. Epub 2009 Dec 24. |
| 35175346 | Derived | Buttenheim A, Milkman KL, Duckworth AL, Gromet DM, Patel M, Chapman G. Effects of Ownership Text Message Wording and Reminders on Receipt of an Influenza Vaccination: A Randomized Clinical Trial. JAMA Netw Open. 2022 Feb 1;5(2):e2143388. doi: 10.1001/jamanetworkopen.2021.43388. |
| BG002 | Default Reservations Opt-In Condition | The day before their scheduled appointment, participants receive a text reading: "Reply Y if you would like to receive a flu shot at your appointment tomorrow, N if not." The text will include a picture of vial with no text on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG003 | Intergroup Competition Treatment Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind "another region" in flu shot rate last year ("your region" and "another region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG004 | Intergroup Competition Control Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind the target flu shot rate of 70% last year ("your region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG005 | Flu Shot for You Symbolic Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity to dedicate getting the flu shot to someone by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG006 | Flu Shot for You Herd Immunity Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity of getting the flu shot to protect a vulnerable loved one by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG007 | Flu Shot for You Control Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also receive a reminder message on the day of the appointment. They will not receive any further information, nor will they be asked to respond with initials of an individual. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG008 | Prosocial Condition | The day before their scheduled appointment, participants will receive a message describing the pro-social benefits of getting a flu shot, and a reminder to ask for their flu shot. The described pro-social benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting loved ones from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting loved ones from serious complications from the flu). Participants will also receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG009 | Self-Oriented Condition | The day before their scheduled appointment, participants will receive a message describing the self-oriented benefits of getting a flu shot, and a reminder to ask for their flu shot. The described self-oriented benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting oneself from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting oneself from serious complications from the flu). Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG010 | Information Vivid Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain vivid information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG011 | Information Basic Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain basic information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG012 | Information Control Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain information about exercising. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG013 | Sharing Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. The message will include a joke about the flu and will encourage participants to share the joke with nurses, doctors, or pharmacists. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG014 | No Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG015 | Healthy Habits Easy Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of easy health behaviors (e.g., whether they walked 500 feet yesterday, at least two serving of fruits and vegetables in the last week, and slept at least 6 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG016 | Healthy Habits Difficult Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of difficult health behaviors (e.g., whether they walked 3 miles yesterday, ate 4-6 servings of fruits and vegetables yesterday, and slept at least 9 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG017 | Healthy Habits Control Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG018 | Just-In-Time Reminders 24-Hour Condition | Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 24 hours before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG019 | Just-In-Time Reminders 15-Minute Condition | Just-In-Time Reminders 15-Minute Condition: Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 15 minutes before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| BG020 | Total | Total of all reporting groups |
| Participants |
|
| Age, Continuous | Mean | Standard Deviation | years |
|
| Sex: Female, Male | Count of Participants | Participants |
|
| Race/Ethnicity, Customized | Count of Participants | Participants |
|
| ID | Title | Description |
|---|---|---|
| OG000 | Holdout Control | Participants will only receive the standard appointment reminders from their providers. |
| OG001 | Default Reservations Opt-Out Condition | The day before their scheduled appointment, participants receive a text reading: "A flu shot has been reserved for you to receive at your appointment tomorrow. Reply Y if you want this shot held for you, N if you don't." The text will include a picture of a vial that says "Your Flu Shot" on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG002 | Default Reservations Opt-In Condition | The day before their scheduled appointment, participants receive a text reading: "Reply Y if you would like to receive a flu shot at your appointment tomorrow, N if not." The text will include a picture of vial with no text on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG003 | Intergroup Competition Treatment Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind "another region" in flu shot rate last year ("your region" and "another region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG004 | Intergroup Competition Control Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind the target flu shot rate of 70% last year ("your region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG005 | Flu Shot for You Symbolic Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity to dedicate getting the flu shot to someone by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG006 | Flu Shot for You Herd Immunity Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity of getting the flu shot to protect a vulnerable loved one by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG007 | Flu Shot for You Control Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also receive a reminder message on the day of the appointment. They will not receive any further information, nor will they be asked to respond with initials of an individual. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG008 | Prosocial Condition | The day before their scheduled appointment, participants will receive a message describing the pro-social benefits of getting a flu shot, and a reminder to ask for their flu shot. The described pro-social benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting loved ones from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting loved ones from serious complications from the flu). Participants will also receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG009 | Self-Oriented Condition | The day before their scheduled appointment, participants will receive a message describing the self-oriented benefits of getting a flu shot, and a reminder to ask for their flu shot. The described self-oriented benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting oneself from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting oneself from serious complications from the flu). Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG010 | Information Vivid Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain vivid information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG011 | Information Basic Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain basic information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG012 | Information Control Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain information about exercising. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG013 | Sharing Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. The message will include a joke about the flu and will encourage participants to share the joke with nurses, doctors, or pharmacists. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG014 | No Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG015 | Healthy Habits Easy Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of easy health behaviors (e.g., whether they walked 500 feet yesterday, at least two serving of fruits and vegetables in the last week, and slept at least 6 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG016 | Healthy Habits Difficult Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of difficult health behaviors (e.g., whether they walked 3 miles yesterday, ate 4-6 servings of fruits and vegetables yesterday, and slept at least 9 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG017 | Healthy Habits Control Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG018 | Just-In-Time Reminders 24-Hour Condition | Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 24 hours before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
| OG019 | Just-In-Time Reminders 15-Minute Condition | Just-In-Time Reminders 15-Minute Condition: Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 15 minutes before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. |
|
|
| Secondary | Number of Participants With Flu Shot Receipt Before March 31, 2021 | The secondary dependent variable is whether participants receive the flu shot at or before their target appointment or at any time after this appointment (by March 31, 2021), as recorded in their electronic health records. Participants who receive a flu shot before they receive the SMS intervention will be excluded from the analyses. | Posted | Count of Participants | Participants | Up to 6 months after randomization. |
|
|
|
| 0 |
| 0 |
| 0 |
| 0 |
| 0 |
| 0 |
| EG001 | Default Reservations Opt-Out Condition | The day before their scheduled appointment, participants receive a text reading: "A flu shot has been reserved for you to receive at your appointment tomorrow. Reply Y if you want this shot held for you, N if you don't." The text will include a picture of a vial that says "Your Flu Shot" on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG002 | Default Reservations Opt-In Condition | The day before their scheduled appointment, participants receive a text reading: "Reply Y if you would like to receive a flu shot at your appointment tomorrow, N if not." The text will include a picture of vial with no text on it. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG003 | Intergroup Competition Treatment Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind "another region" in flu shot rate last year ("your region" and "another region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG004 | Intergroup Competition Control Condition | Three days before their scheduled appointment, participants will receive a text message with information about how much "your region" lagged behind the target flu shot rate of 70% last year ("your region" will depend on the study site and include realistic flu shot rates based on historical CDC data). Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG005 | Flu Shot for You Symbolic Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity to dedicate getting the flu shot to someone by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG006 | Flu Shot for You Herd Immunity Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also be told that they have the opportunity of getting the flu shot to protect a vulnerable loved one by texting back the initials of an individual. Participants will receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG007 | Flu Shot for You Control Condition | Three days before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. They will also receive a reminder message on the day of the appointment. They will not receive any further information, nor will they be asked to respond with initials of an individual. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG008 | Prosocial Condition | The day before their scheduled appointment, participants will receive a message describing the pro-social benefits of getting a flu shot, and a reminder to ask for their flu shot. The described pro-social benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting loved ones from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting loved ones from serious complications from the flu). Participants will also receive a reminder message on the day of the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG009 | Self-Oriented Condition | The day before their scheduled appointment, participants will receive a message describing the self-oriented benefits of getting a flu shot, and a reminder to ask for their flu shot. The described self-oriented benefits will vary whether they emphasize the COVID-19 pandemic (e.g., protecting oneself from the risk of hospital-acquired COVID-19 infection) or not (e.g., protecting oneself from serious complications from the flu). Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG010 | Information Vivid Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain vivid information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG011 | Information Basic Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain basic information about getting the flu. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG012 | Information Control Condition | Three days before their scheduled appointment, participants will receive a message inviting them to watch a 2-minute wellness video and answer some related questions, as well as encouragement to get the flu shot. In this condition, the video will contain information about exercising. Participants will also receive a reminder message the day before the appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG013 | Sharing Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. The message will include a joke about the flu and will encourage participants to share the joke with nurses, doctors, or pharmacists. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG014 | No Humor Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get the flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG015 | Healthy Habits Easy Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of easy health behaviors (e.g., whether they walked 500 feet yesterday, at least two serving of fruits and vegetables in the last week, and slept at least 6 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG016 | Healthy Habits Difficult Health Behavior Condition | The day before their scheduled appointment, participants will be asked if they have completed a series of difficult health behaviors (e.g., whether they walked 3 miles yesterday, ate 4-6 servings of fruits and vegetables yesterday, and slept at least 9 hours the previous night). They will then be encouraged to get a flu shot at their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG017 | Healthy Habits Control Condition | The day before their scheduled appointment, participants will receive a text message encouraging them to get a flu shot. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG018 | Just-In-Time Reminders 24-Hour Condition | Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 24 hours before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG019 | Just-In-Time Reminders 15-Minute Condition | Just-In-Time Reminders 15-Minute Condition: Seventy-two hours before their appointment, participants will receive a text message alerting them to the availability of the flu vaccine at their upcoming appointment. Participants will be told they'll receive a reminder, which they can opt-out from receiving. The text message reminder will be sent 15 minutes before their appointment. Flu shot text messages: Participants will receive text messages per descriptions listed in the arms. | 0 | 0 | 0 | 0 | 0 | 0 |
Not provided
Not provided
Not provided
| D014777 | Virus Diseases |
| D012140 | Respiratory Tract Diseases |