Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| R33AG068945 | U.S. NIH Grant/Contract | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| National Institute on Aging (NIA) | NIH |
| University of Washington | OTHER |
Not provided
Not provided
Not provided
Not provided
This study will be a multisite, cluster randomized, pragmatic trial to evaluate the effectiveness of personalized nudges to clinicians and patients, relative to a control, to increase flu vaccination rates among older adults in accordance with CDC guidelines. This will include clinician and patient level nudge interventions, with an additional, intensified nudge intervention for patients identified as high risk for not receiving a flu vaccine. Among the intervention clinics, patients will receive pre-visit text message reminders about the flu vaccine, and clinicians will receive a default pended order in the visit encounter in the EHR, along with monthly peer comparison feedback about their flu vaccine completion rate. Patients identified as high risk for noncompletion will be individually randomized to receive an additional bidirectional text message nudge or the standard text messaging.
Many older adults are at risk of illness, hospitalization, and death from vaccine-preventable diseases. More than half of older adults in the United States are not vaccinated for flu which has remained relatively constant over the past decade, and there are racial, ethnic, and socioeconomic disparities in care. In this study, we will evaluate personalized nudges to clinicians and patients to help increase flu vaccination rates during primary care visits among older adults, with a particular focus on population subgroups at high risk for vaccine noncompletion. In a partnership between Penn Medicine and University of Washington (UW) Medicine, this will be a 6-month, multisite, cluster randomized, pragmatic trial with an additional intensification arm for high-risk patients.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Control | No Intervention | Clinics randomized to the control arm will receive standard of care. | |
| Intervention Arm | Experimental | Clinics randomized to the intervention arm will receive the toolkit of clinician and patient facing nudges. Patient nudges will be pre-visit text message reminders (standard messaging content). Clinician nudges will be monthly peer comparison feedback and default pended orders. |
|
| High Risk Intensification Arm | Experimental | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine will be randomized 1:1 to receive the high risk intensification arm or remain in the standard intervention arm. Patients in the high risk intensification arm will receive an additional bidirectional texting component. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Pre-visit patient text messaging | Behavioral | Patients will be sent text message reminders 3 days and 24 hours prior to their scheduled primary care visit. The messages will inform the patient that a flu shot has been reserved for them at their upcoming appointment and encouraging the patient to ask their provider about receiving the vaccine. |
| Measure | Description | Time Frame |
|---|---|---|
| Proportion of Patients Who Receive the Flu Vaccine at the Visit | The primary outcome is flu vaccination completion during the first eligible primary care visit. | 4 days from enrollment, at the eligible visit |
| Measure | Description | Time Frame |
|---|---|---|
| Proportion of Patients Who Receive the Flu Vaccine Within 3 Months After the Visit | The secondary outcome is flu vaccination completion within 3 months after the first eligible primary care visit. | 3 months |
Not provided
Patient Inclusion Criteria:
All patients must meet the following criteria to be eligible:
For the high risk intensification nudge, at least one of the following criteria must be met to be considered high risk and randomized to receive the intensification nudge:
Patient Exclusion Criteria:
Clinician Inclusion Criteria:
Clinicians must meet the following criteria to be eligible to receive peer comparison feedback:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Shivan Mehta, MD,MBA,MSHP | University of Pennsylvania | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| University of Pennsylvania Health System | Philadelphia | Pennsylvania | 19104 | United States | ||
| University of Washington |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 41490010 | Derived | Mehta SJ, Waddell KJ, Linn KA, Brophy C, Liang J, Park SH, Reitz C, Williams K, Couzens C, Staloff J, White AA, Rhodes C, Liao JM, Navathe AS. Nudges to Clinicians and Patients for Influenza Vaccines During Visits: The BE IMMUNE Randomized Clinical Trial. JAMA Intern Med. 2026 Mar 1;186(3):304-310. doi: 10.1001/jamainternmed.2025.7133. | |
| 39557547 | Derived | Waddell K, Mehta SJ, Navathe A, Linn K, Park SH, White A, Staloff J, Rhodes C, Couzens C, Goel K, McDonald C, Reitz C, Williams K, Liao JM. Behavioural economics to improve and motivate vaccination in primary care using nudges through the electronic health record: rationale and design of the BE IMMUNE randomised clinical trial. BMJ Open. 2024 Nov 18;14(11):e086698. doi: 10.1136/bmjopen-2024-086698. |
Not provided
Not provided
We will share our analytical code(s).
Within one year of trial completion
All inquiries related to the code should be directed to the PI.
Not provided
Clinics were randomized 2:1 to intervention and control. Patients seen at an intervention clinic and identified as high risk were further randomized 1:1 to standard messaging or an intensification nudge. The high risk individual randomization is nested within the intervention arm resulting in an overlap of patients where high risk individuals (41,909 of the 52,526) contribute both to estimation of the overall intervention effect and comparison of text messaging intensity among high risk patients
Waiver of informed consent obtained. Patients were identified via Epic Clarity Query 4 days prior to their eligible primary care visit between September 25, 2023 - February 20, 2024. Patients were only counted once within the study window at their first primary care visit. Total protocol enrollment: 80,039 patients.
| ID | Title | Description |
|---|---|---|
| FG000 | Control | Patients in clinics randomized to the control arm will receive standard of care. |
| FG001 | Intervention | Patients in clinics randomized to the intervention arm will receive the toolkit of clinician and patient facing nudges. Patient nudges will be pre-visit text message reminders (standard messaging content). Clinician nudges will be monthly peer comparison feedback and default pended orders. |
| FG002 | High Risk - Standard Messaging | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine were randomized 1:1 to receive the high risk intensification messaging or remain in the standard messaging arm. Patients in the high risk standard messaging arm received the same standard messaging as average risk patients. |
| FG003 | High Risk - Intensification Messaging | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine were randomized 1:1 to receive the high risk intensification messaging or remain in the standard messaging arm. Patients in the high risk intensification group received an additional bidirectional texting component in addition to the standard messaging. |
| FG004 | High Risk - Not Individually Randomized | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine who were not individually randomized as a result of an automation issue. These patients still received the clinician nudges (default pended orders and peer comparison feedback) but did not receive any standard or intensification messaging. |
| Title | Milestones | Reasons Not Completed | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Clinic Level Randomization |
| |||||||||||||
| Individual Level Randomization |
|
Baseline characteristics are reported for the Main Study Period only - Clinic Level Randomization (Control and Intervention). Patients in the High Risk arms are accounted for in the Intervention arm as a whole, but were additionally randomized at the Individual Level, as noted in the Participant Flow.
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Control | Patients in clinics randomized to the control arm will receive standard of care. |
| BG001 | Intervention | Patients in clinics randomized to the intervention arm will receive the toolkit of clinician and patient facing nudges. Patient nudges will be pre-visit text message reminders (standard messaging content). Clinician nudges will be monthly peer comparison feedback and default pended orders. |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes |
|---|---|---|---|---|---|---|---|---|---|
| Age, Continuous | Mean |
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Proportion of Patients Who Receive the Flu Vaccine at the Visit | The primary outcome is flu vaccination completion during the first eligible primary care visit. | Posted | Count of Participants | Participants | 4 days from enrollment, at the eligible visit |
|
Each patient was monitored for adverse events for 3 months. Adverse events were collected mid-way through the trial at 3 months for all participants enrolled through the end of December 2023 and again at the end of the trial follow up period, 3 months after enrollment ended (May 2024), for all enrolled participants.
Per our DSMB-approved DSMP, severe adverse events will not include death as no reasonable evidence exists to suggest death would result from outreach or communication to encourage standard clinical care for flu vaccination. Therefore, All-Cause Mortality was not assessed. Adverse events are assessed for the Main Study Period arms only - Control (except Messaging, see footnote) and Intervention - as the patients in the High Risk arms are already accounted for in the Intervention arm total.
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Control | Patients in clinics randomized to the control arm will receive standard of care. |
| Term | Organ System | Source Vocabulary | Assessment Type | Notes | Statistical Information |
|---|---|---|---|---|---|
| Flu Vaccine Reaction | Injury, poisoning and procedural complications | Systematic Assessment | Reaction requiring emergency department or hospital care. |
| Term | Organ System | Source Vocabulary | Assessment Type | Notes | Statistical Information |
|---|---|---|---|---|---|
| Messaging Opt-out | Social circumstances | Systematic Assessment | Patient frustration with messaging or outreach. Messaging opt-out was not assessed for control patients as they did not receive any messaging. |
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Dr. Shivan Mehta | University of Pennsylvania | 2679726027 | shivan.mehta@pennmedicine.upenn.edu |
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot | Yes | No | No | Study Protocol | Oct 7, 2024 | Feb 10, 2025 | Prot_000.pdf |
| SAP | No | Yes | No | Statistical Analysis Plan | Jan 7, 2025 | Feb 10, 2025 | SAP_001.pdf |
Not provided
| ID | Term |
|---|---|
| D015438 | Health Behavior |
| D007251 | Influenza, Human |
| ID | Term |
|---|---|
| D001519 | Behavior |
| D012141 | Respiratory Tract Infections |
| D007239 | Infections |
| D009976 | Orthomyxoviridae Infections |
Not provided
Not provided
We will randomize primary care clinics 2:1 to the intervention arm or control arm using covariate-constrained randomization. Patients identified as at high-risk for non-completion of the flu vaccine will be additionally randomized 1:1 at the individual level to receive an additional intensification nudge compared with the multi-component nudge intervention alone.
Not provided
Not provided
Not provided
|
| Default pended order | Behavioral | A default pended order for the flu vaccine will be pended to the patient's upcoming primary care encounter and will be visible to the provider during the visit encounter. Clinical staff will have the option of signing the order or dismissing it if they deem it inappropriate for a given patient. |
|
| Monthly peer comparison feedback | Behavioral | Each month, clinicians will be sent an email containing what percent of their eligible patients received the flu vaccine and how that compares to other peer clinicians in the intervention. |
|
| High risk bidirectional pre-visit text messaging | Behavioral | High risk patients randomized to receive the high risk intensification nudge will receive a bidirectional text messaging component prior to their visit. This intervention will query the patient about common questions or concerns about receiving the flu vaccine. If the patient responds, it will provide additional educational materials based on the patient's specific concern(s). |
|
| Seattle |
| Washington |
| 98195 |
| United States |
| COMPLETED |
|
| NOT COMPLETED |
|
| BG002 | Total | Total of all reporting groups |
| years |
|
| Sex/Gender, Customized | Count of Participants | Participants |
|
| Race (NIH/OMB) | Count of Participants | Participants |
|
| Race/Ethnicity, Customized | Count of Participants | Participants |
|
| Lowest Quartile Income by Zip Code | Count of Participants | Participants |
|
| OG002 | High Risk - Standard Messaging | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine were randomized 1:1 to receive the high risk intensification messaging or remain in the standard messaging arm. Patients in the high risk standard messaging arm received the same standard messaging as average risk patients. |
| OG003 | High Risk - Intensification Messaging | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine were randomized 1:1 to receive the high risk intensification messaging or remain in the standard messaging arm. Patients in the high risk intensification group received an additional bidirectional texting component in addition to the standard messaging. |
| OG004 | High Risk - Not Individually Randomized | Patients in the intervention clinics identified as high risk for noncompletion of the flu vaccine who were not individually randomized as a result of an automation issue. These patients still received the clinician nudges (default pended orders and peer comparison feedback) but did not receive any standard or intensification messaging. |
|
|
| Secondary | Proportion of Patients Who Receive the Flu Vaccine Within 3 Months After the Visit | The secondary outcome is flu vaccination completion within 3 months after the first eligible primary care visit. | Posted | Count of Participants | Participants | 3 months |
|
|
|
| 0 |
| 0 |
| 0 |
| 27,513 |
| 5 |
| 27,513 |
| EG001 | Intervention | Patients in clinics randomized to the intervention arm will receive the toolkit of clinician and patient facing nudges. Patient nudges will be pre-visit text message reminders (standard messaging content). Clinician nudges will be monthly peer comparison feedback and default pended orders. Includes all intervention arm patients, including high risk. | 0 | 0 | 1 | 52,526 | 817 | 52,526 |
|
|
| Duplicate Vaccination | Surgical and medical procedures | Systematic Assessment | Duplicate flu vaccination within the recommended interval. |
|
Not provided
Not provided
| D012327 |
| RNA Virus Infections |
| D014777 | Virus Diseases |
| D012140 | Respiratory Tract Diseases |