Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Agency for Healthcare Research and Quality (AHRQ) | FED |
| Teladoc Health | INDUSTRY |
Not provided
Not provided
Not provided
Not provided
Appropriate use of antibiotics reduces resistance and protects patients from unnecessary harm. Important advances in antibiotic stewardship have been achieved in outpatient settings, but little is known about stewardship in the rapidly growing telehealth sector. Prior pragmatic randomized trials have shown that Centers for Disease Control (CDC) Core Element interventions constructed using insights from decision and social psychology can greatly reduce inappropriate prescribing in outpatient settings.
In a randomized trial, the investigators will adapt and test two aspects of CDC Core Elements in a telehealth environment (Teladoc®), each with two levels of intensity. Teladoc® clinicians will be randomized to the following interventions: 1) Performance Feedback (Trending, Benchmark Peer Comparison), 2) Commitment (Private, Public), or 3) Control. All randomization occurs at the provider level, with the exception of the Public Commitment arm, which requires patient-facing content that is determined by patient state. Clinicians and members will see the same messages across all pages, all channels & all consults during the 12-month study period. The primary outcome is to assess change in antibiotic prescribing rate for qualifying acute respiratory infection visits (ARIs).
In a 3 x 3 (Performance Feedback x Commitment) randomized trial, the investigators will adapt and test two aspects of Core Elements in a telehealth environment (Teladoc®), each with two variations. Qualifying visits include pediatric and adult telehealth visits for acute respiratory infections, including sinusitis, bronchitis, influenza, otitis media, pharyngitis, nonspecific upper respiratory infections, and COVID-19.
All randomization occurs at the provider level, with the exception of the Public Commitment arm, which requires patient-facing content that is determined by patient state. Allocation will be stratified to ensure balance across baseline characteristics including visit volume (consults per year), antibiotic prescribing rate for acute respiratory infections and COVID-19, and average member satisfaction (percent of responses "Outstanding" or "Good").
Performance Feedback (Trending, Benchmark Peer Comparison, Control). Performance Feedback is based on regional performance benchmarks; physicians with antibiotic prescribing rates in the lowest 3 deciles are designated top performers. The electronic health record (EHR) metrics and messaging are designed to align with enterprise-wide performance feedback practices. A minimum of 8 qualifying visits is required for a provider to see a message.
Providers randomized to Performance Feedback interventions will see one of two feedback messages in the EHR:
Commitment (Private, Public, Control). Clinicians assigned to the Private Commitment arm will make a personal commitment to evidence-based use of antibiotics that is not shared with their patients, while those assigned to Public Commitment will make a commitment to evidence-based use of antibiotics that is shared with their patients. For both arms, this commitment is displayed on the clinician's personal provider dashboard.
Providers randomized to the Commitment interventions will be asked to complete one of two commitments:
Patients in states assigned to Public Commitment will see the clinician's commitment at the end of their visit request. Patients will select: 1) I understand the provider's commitment OR 2) I do not understand and need more information. Clinicians in this arm will be notified about the patient response in the EHR during the visit.
The primary outcome is to assess the change in antibiotic prescribing rate for qualifying acute respiratory infection visits.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Trending Feedback + Private Commitment | Experimental | Clinicians receive both Trending Feedback + Private Commitment interventions. |
|
| Trending Feedback + Public Commitment | Experimental | Clinicians receive both Trending Feedback + Public Commitment interventions. |
|
| Trending Feedback + Commitment Control | Experimental | Clinicians receive Trending Feedback intervention + Commitment Control. |
|
| Benchmark Peer Comparison Feedback + Private Commitment | Experimental | Clinicians receive both Benchmark Peer Comparison Feedback + Private Commitment interventions. |
|
| Benchmark Peer Comparison Feedback + Public Commitment | Experimental | Clinicians receive both Benchmark Peer Comparison Feedback + Public Commitment interventions. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Trending Feedback | Behavioral | Clinicians randomized to Trending Feedback will receive monthly feedback on the provider dashboard page. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Change in antibiotic prescribing rate for Acute Respiratory Infections | Change in antibiotic prescribing rate for acute respiratory infection visits based on the International Statistical Classification of Diseases, version 10 (ICD-10) codes including: non-specific upper respiratory infections, otitis media, sinusitis, pharyngitis, bronchitis, influenza, and COVID-19. | 12 months |
| Measure | Description | Time Frame |
|---|---|---|
| Change in inappropriate antibiotic prescribing rate for Acute Respiratory Infections | Change in inappropriate antibiotic prescribing rate for acute respiratory infections where antibiotics are never appropriate based on International Statistical Classification of Diseases, version 10 (ICD-10) codes as well as COVID-19 (U07.1) | 12 months |
Not provided
Inclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Daniella Meeker, PhD | University of Southern California | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Teladoc Health | Dallas | Texas | 75244 | United States |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 30651273 | Background | Chua KP, Fischer MA, Linder JA. Appropriateness of outpatient antibiotic prescribing among privately insured US patients: ICD-10-CM based cross sectional study. BMJ. 2019 Jan 16;364:k5092. doi: 10.1136/bmj.k5092. | |
| 24474434 | Background | Meeker D, Knight TK, Friedberg MW, Linder JA, Goldstein NJ, Fox CR, Rothfeld A, Diaz G, Doctor JN. Nudging guideline-concordant antibiotic prescribing: a randomized clinical trial. JAMA Intern Med. 2014 Mar;174(3):425-31. doi: 10.1001/jamainternmed.2013.14191. |
Not provided
Not provided
Not provided
Participants are randomly assigned to one of three levels of commitment interventions and one of three levels of feedback interventions, for a total of 9 study arms (3 X 3). One level in each factor is "control" which entails "no intervention".
Not provided
Not provided
Patients are blinded to all study arms with the exception of Public Commitment where, by design, patients are exposed to physicians' commitment. Physicians cannot be blinded to interventions that, by design, impact the electronic medical record display.
| Benchmark Peer Comparison Feedback + Commitment Control | Experimental | Clinicians receive Benchmark Peer Comparison Feedback intervention + Commitment Control. |
|
| Public Commitment + Feedback Control | Experimental | Clinicians receive Public Commitment intervention + Feedback Control. |
|
| Private Commitment + Feedback Control | Experimental | Clinicians receive Private Commitment intervention + Feedback Control. |
|
| Commitment Control + Feedback Control | No Intervention | Clinicians receive no intervention. |
| Benchmark Peer Comparison Feedback | Behavioral | Clinicians randomized to Benchmark Peer Comparison Feedback will receive monthly feedback on the provider dashboard page. |
|
| Private Commitment | Behavioral | Clinicians assigned to the Private Commitment will be prompted in the provider dashboard to make a personal commitment to evidence-based use of antibiotics that will not be shared with their patients. |
|
| Public Commitment | Behavioral | Clinicians assigned to Public Commitment will be prompted in the provider dashboard to make a commitment to evidence-based use of antibiotics that will be shared with their patients. |
|
| 26864410 | Background | Meeker D, Linder JA, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, Knight TK, Hay JW, Doctor JN. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA. 2016 Feb 9;315(6):562-70. doi: 10.1001/jama.2016.0275. |
| 27832047 | Background | Sanchez GV, Fleming-Dutra KE, Roberts RM, Hicks LA. Core Elements of Outpatient Antibiotic Stewardship. MMWR Recomm Rep. 2016 Nov 11;65(6):1-12. doi: 10.15585/mmwr.rr6506a1. |
| 29049577 | Background | Linder JA, Meeker D, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, Doctor JN. Effects of Behavioral Interventions on Inappropriate Antibiotic Prescribing in Primary Care 12 Months After Stopping Interventions. JAMA. 2017 Oct 10;318(14):1391-1392. doi: 10.1001/jama.2017.11152. |
| 35724841 | Derived | McCabe BK, Linder JA, Doctor JN, Friedberg M, Fox CR, Goldstein NJ, Knight TK, Kaiser K, Tibbels J, Haenchen S, Persell SD, Warberg R, Meeker D. The protocol of improving safe antibiotic prescribing in telehealth: A randomized trial. Contemp Clin Trials. 2022 Aug;119:106834. doi: 10.1016/j.cct.2022.106834. Epub 2022 Jun 18. |