Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
This trial is taking place in Los Angeles, CA among patients from primary care practices within the UCLA Health System.
Despite the Advisory Committee on Immunization Practices (ACIP) recommendation in 2010 that all people above 6 months of age should receive an annual flu vaccine, vaccination rates remain low. The investigators will assess the effectiveness of message-framing (gain-framed, loss-framed messages, no messages), as well as the effectiveness of a pre-commitment prompt (pre-commitment prompt, no prompt) asking about a patient's intention to get the influenza vaccination, using a 3 x 2 factorial design.
Sub-optimal vaccination rates are a significant problem in the U.S., despite their effectiveness in preventing morbidity and mortality from vaccine-preventable illness. For influenza specifically, annual epidemics of influenza cause substantial morbidity in the U.S. with up to 40,00-80,000 deaths/year and many hospitalizations, emergency and outpatient visits, and significant costs.
Reminder/recall (R/R), sent by phone, mail or other modality, can improve child and adult influenza vaccination rates. However, the majority of pediatric or adult primary care practices to not conduct R/R. Barriers are lack of finances, personnel, and algorithms to identify eligible patients.
A technological breakthrough that might overcome these barriers involves patient portals-- secure, web-based communication systems, embedded within electronic health records (EHRs), for patients and providers to communicate with each other via email and the internet. Portals are used by about half of Americans and half of UCLA patients.
There has been considerable research on how best to communicate about vaccines with families. A number of studies have examined the impact of gain-framed (messages emphasizing the benefits of vaccination) versus loss-framed (messages emphasizing the risks of not getting vaccinated); however, the findings have been inconsistent across studies and by sub-population.
In addition to framing, another potential influence on the decision to vaccinate is pre-commitment. Previous studies suggest that, upon being prompted, indicating an intention to do something increases the likelihood of following through. Therefore, a pre-commitment prompt is being asked of half the participants in each arm to evaluate its impact on influenza vaccination.
The purpose of this randomized controlled trial is to evaluate the impact of gain-framed and loss-framed reminder-recall messages sent via the patient portal, pre-commitment prompts sent via the patient portal, and the interactions between the two type of messages and pre-commitment on influenza vaccination among UCLA Health System's primary care patients aged 6 months and older.
The proposed design of this randomized-controlled trial is a 3 x 2 factorial design.
Standard of care control (no reminder messages, no pre-commitment prompt) No portal messages, pre-commitment prompt Gain-framed portal messages, pre-commitment prompt Gain-framed portal messages, no pre-commitment prompt Loss-framed portal messages, pre-commitment prompt Loss-framed portal messages, no pre-commitment prompt
Hyp 1. Vaccination rates will differ by receipt of no reminders, gain-framed reminders and loss-framed reminders.
1a. Vaccination rates will be higher among patients receiving gain-framed reminders than among patients receiving no reminders.
1b. Vaccination rates will be higher among patients receiving loss-framed reminders than among patients receiving no reminders.
1c. Vaccination rates will be higher among patients receiving gain-framed reminders than among patients receiving loss-framed reminders.
Hyp 2. Vaccination rates will be higher among patients receiving a pre-commitment prompt than among patients not receiving any prompt.
For relevant study arms, the first R/R messages will be sent in October 2019.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Gain-framed portal reminders + Pre-commitment Prompts | Active Comparator | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
|
| Gain-framed portal reminders + No pre-commitment prompt | Active Comparator | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
|
| Loss-framed portal reminders + Pre-commitment prompt | Active Comparator | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
|
| Loss-framed portal reminders + No pre-commitment prompt | Active Comparator | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Portal Reminders for Influenza Vaccination: Gain-framed | Behavioral | Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
| Measure | Description | Time Frame |
|---|---|---|
| Receipt of the Annual Influenza Vaccine Among Index Patients. | Receipt of the annual influenza vaccination (between 10/2/19 - 4/1/20) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. Index patients will be randomly selected individuals within an included household, eligible for the following groups (<18, 18-64 non-diabetic, 65+ non-diabetic, and 18+ diabetic). One index patient per group may be selected from each household. The index patients must also be an active UCLA Health MyChart user (>= 1 login over the last 12 months from 8/1/19, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis. | 6 months |
Not provided
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Peter G Szilagyi, MPH, MD | University of California, Los Angeles | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| University of California LA | Los Angeles | California | 99095 | United States |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 34472020 | Derived | Szilagyi PG, Albertin CS, Casillas A, Valderrama R, Duru OK, Ong MK, Vangala S, Tseng CH, Humiston SG, Evans S, Sloyan M, Bogard JE, Fox CR, Lerner C. Effect of Personalized Messages Sent by a Health System's Patient Portal on Influenza Vaccination Rates: a Randomized Clinical Trial. J Gen Intern Med. 2022 Feb;37(3):615-623. doi: 10.1007/s11606-021-07023-w. Epub 2021 Sep 1. | |
| 34321338 | Derived | Lerner C, Albertin C, Casillas A, Duru OK, Ong MK, Vangala S, Humiston S, Evans S, Sloyan M, Fox CR, Bogard JE, Friedman S, Szilagyi PG. Patient Portal Reminders for Pediatric Influenza Vaccinations: A Randomized Clinical Trial. Pediatrics. 2021 Aug;148(2):e2020048413. doi: 10.1542/peds.2020-048413. |
Not provided
Not provided
Not provided
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Gain-framed Portal Reminders + Pre-commitment Prompts | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| Title | Milestones | Reasons Not Completed | |||||
|---|---|---|---|---|---|---|---|
| Overall Study |
|
Not provided
Not provided
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot_SAP | Yes | Yes | No | Study Protocol and Statistical Analysis Plan | Oct 9, 2019 |
Not provided
Not provided
Not provided
Not provided
Not provided
|
| No portal reminder + Pre-commitment prompt | Active Comparator | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal but do receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
|
| No portal reminders + No pre-commitment prompt | No Intervention | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal and do not receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
| Portal Reminders for Influenza Vaccination: Loss-framed | Behavioral | Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
|
| Pre-commitment prompt | Behavioral | Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
|
| FG001 | Gain-framed Portal Reminders + No Pre-commitment Prompt | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
| FG002 | Loss-framed Portal Reminders + Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| FG003 | Loss-framed Portal Reminders + No Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
| FG004 | No Portal Reminder + Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal but do receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| FG005 | No Portal Reminders + No Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal and do not receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
| Patients Who Met Inclusion |
|
| COMPLETED |
|
| NOT COMPLETED |
|
|
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Gain-framed Portal Reminders + Pre-commitment Prompts | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| BG001 | Gain-framed Portal Reminders + No Pre-commitment Prompt | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
| BG002 | Loss-framed Portal Reminders + Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| BG003 | Loss-framed Portal Reminders + No Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. |
| BG004 | No Portal Reminder + Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal but do receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination |
| BG005 | No Portal Reminders + No Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal and do not receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season |
| BG006 | Total | Total of all reporting groups |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Age, Categorical | Count of Participants | Participants |
| ||||||||||||||||
| Sex/Gender, Customized | Count of Participants | Participants |
| ||||||||||||||||
| Race/Ethnicity, Customized | Count of Participants | Participants |
| ||||||||||||||||
| Region of Enrollment | Number | participants |
| ||||||||||||||||
| Insurance Type | Count of Participants | Participants |
| ||||||||||||||||
| Adults with diabetes | Count of Participants | Participants |
|
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Receipt of the Annual Influenza Vaccine Among Index Patients. | Receipt of the annual influenza vaccination (between 10/2/19 - 4/1/20) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. Index patients will be randomly selected individuals within an included household, eligible for the following groups (<18, 18-64 non-diabetic, 65+ non-diabetic, and 18+ diabetic). One index patient per group may be selected from each household. The index patients must also be an active UCLA Health MyChart user (>= 1 login over the last 12 months from 8/1/19, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis. | Each row represents a combination of intervention conditions in our factorial design. Each column represents patient subpopulations which received different versions of the intervention. The number analyzed in each cell is the number from that column's subpopulation assigned to that row's intervention combination. | Posted | Count of Participants | Participants | 6 months |
|
|
|
|
We did not collect information regarding adverse events.
We did not collect adverse event information. We monitored whether reminder recall through the portal was effective at increased influenza vaccination rates. Because influenza vaccination is recommended by the Advisory Committee on Immunization Practices and is part of the U.S. recommended vaccine schedule, we did not collect adverse event data.
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Gain-framed Portal Reminders + Pre-commitment Prompts | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination | 0 | 0 | 0 | 0 | 0 | 0 |
| EG001 | Gain-framed Portal Reminders + No Pre-commitment Prompt | Participants receive gain-framed reminder/recall messages regarding influenza vaccination via the patient portal and no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Gain-framed: Patients receive gain-framed reminder/recall messages via the patient portal to get an influenza vaccination. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG002 | Loss-framed Portal Reminders + Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination | 0 | 0 | 0 | 0 | 0 | 0 |
| EG003 | Loss-framed Portal Reminders + No Pre-commitment Prompt | Participants receive loss-framed reminder/recall messages regarding influenza vaccination via the patient portal and a no pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Portal Reminders for Influenza Vaccination: Loss-framed: Patients receive loss-framed reminder/recall messages via the patient portal to get an influenza vaccination. | 0 | 0 | 0 | 0 | 0 | 0 |
| EG004 | No Portal Reminder + Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal but do receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season Pre-commitment prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination | 0 | 0 | 0 | 0 | 0 | 0 |
| EG005 | No Portal Reminders + No Pre-commitment Prompt | Participants do not receive any reminder/recall messages regarding influenza vaccination via the patient portal and do not receive a pre-commitment prompt asking if they plan to receive the influenza vaccine in the upcoming season | 0 | 0 | 0 | 0 | 0 | 0 |
Not provided
Not provided
Not provided
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Principal Investigator | UCLA | 310-206-6328 | pszilagyi@mednet.ucla.edu |
| Nov 14, 2021 |
| Prot_SAP_000.pdf |
| ID | Term |
|---|---|
| D007251 | Influenza, Human |
| D012141 | Respiratory Tract Infections |
| ID | Term |
|---|---|
| D007239 | Infections |
| D009976 | Orthomyxoviridae Infections |
| D012327 | RNA Virus Infections |
| D014777 | Virus Diseases |
| D012140 | Respiratory Tract Diseases |
Not provided
Not provided
| Between 18 and 65 years |
|
| >=65 years |
|
| Male |
|
| Other |
|
| Unknown |
|
| Black/African American |
|
| Asian |
|
| Other/Unknown |
|
| Public |
|
| Other/UNK |
|
|
| Loss-framed reminders and no pre-commitment |
|
|
| Gain-frame reminders and no pre-commitment |
|
|
| No reminders and pre-commitment |
|
|
| Loss-frame reminders and pre-commitment |
|
|
| Gain-frame reminders and pre-commitment |
|
|
| Risk Ratio (RR) |
| 1.00 |
| 2-Sided |
| 95 |
| 0.99 |
| 1.01 |
These results compare the arm receiving a pre-commitment prompt to the arm receiving no pre-commitment prompt. |
| Superiority |
| Risk Ratio (RR) | 1.01 | 2-Sided | 95 | 0.99 | 1.03 | These results compare the arm receiving a pre-commitment prompt to the arm receiving no pre-commitment prompt. | Superiority |
| Risk Ratio (RR) | 1.02 | 2-Sided | 95 | 1.00 | 1.04 | These results compare the arm receiving a pre-commitment prompt to the arm receiving no pre-commitment prompt. | Superiority |
| Risk Ratio (RR) | 0.99 | 2-Sided | 95 | 0.98 | 1.01 | These results compare the arm receiving gain-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 0.99 | 2-Sided | 0.95 | 0.97 | 1.02 | These results compare the arm receiving gain-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 0.99 | 2-Sided | 95 | 0.97 | 1.01 | These results compare the arm receiving gain-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 1.01 | 2-Sided | 95 | 0.98 | 1.05 | These results compare the arm receiving gain-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 1.01 | 2-Sided | 95 | 0.99 | 1.02 | These results compare the arm receiving loss-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 1.00 | 2-Sided | 95 | 0.98 | 1.02 | These results compare the arm receiving loss-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 0.99 | 2-Sided | 95 | 0.97 | 1.02 | These results compare the arm receiving loss-framed reminders to the arm receiving no reminders. | Superiority |
| Risk Ratio (RR) | 1.02 | 2-Sided | 95 | 1.00 | 1.04 | These results compare the arm receiving loss-framed reminders to the arm receiving no reminders. | Superiority |