Ontario Healthcare Implementation Laboratory: A Learning Health System Approach That Leverages Data to Improve Quality in Primary Care: Stage 1
Ontario Healthcare Implementation Laboratory: A Learning Health System Approach That Leverages Data to Improve Quality in Primary Care: Stage 1
Antibiotic overuse occurs in multiple jurisdictions and is associated with rising rates of antimicrobial resistance. Mailing letters to the highest antibiotic prescribing physicians is a potentially effective method to optimize antibiotic use. The objectives of this study are to improve enrollment to Health Quality Ontario's Primary Care Practice report and reduce unnecessary antibiotic use. The investigators are conducting a randomized controlled trial recruiting the 3500 highest antibiotic prescribing primary care physicians in Ontario. The investigators have incorporated behavioural science theory into designing letters to modify prescribing behaviour. Letter 1 is testing change ideas related to antibiotic initiation and letter 2 is testing change ideas related to antibiotic duration. There will be 1500 physicians receiving letter 1, 1500 receiving letter 2, and 500 will serve as controls. Twelve months later all 3500 physicians will receive a letter.
Background: Antibiotic overuse is the major driver of rising antimicrobial resistance rates. Unnecessary antibiotic use is associated with adverse medication side effects and rising rates of resistance. Mailing letters to high antibiotic prescribers in other countries have shown variables effects on reducing antibiotic prescribing.1-3
Objective: To evaluate the impact of a letter to the 25% of primary care physicians who prescribe the most antibiotics in Ontario on increasing enrollment for HQO primary care practice reports.
Secondary objectives: To test the impact of different formats of a notification letter on antibiotic prescribing. Our primary hypothesis is that notifying physicians that antibiotic use is being monitored will decrease use of antibiotics. The investigators further hypothesize that targeted change ideas on antibiotic initiation or duration will have varying impacts on these different prescribing behaviours highlighting the importance of targeted messaging.
Methods: The effect of letter mail outs to the top 25% prescribing primary care physicians will be evaluated using a randomized controlled trial (RCT) design. The investigators will allocate physicians to intervention versus control arms in a 3:3:1 ratio to maximize the number of physicians exposed to the intervention. The investigators are using the IQVIA Xponent database from March 2017 to February 2018 to identify the top 25% of primary care physician antibiotic prescribers in Ontario (family physicians or general practitioners) defined by total numbers of antibiotic prescriptions. They will be mailed a letter to indicate that they prescribe more antibiotics than 75% of Ontario primary care physicians, based on total numbers of antibiotic prescriptions per year. The letter will encourage them to sign up for HQO My Practice primary care reports which in the future may include antibiotic indicators.
The letter was designed using proven theoretical frameworks of behaviour change to improve antibiotic prescribing by physicians. Most physicians are aware of the global public health threat of antimicrobial resistance, however many underestimate its importance locally. Furthermore, unnecessary antibiotic prescribing is frequently attributed to external factors out of their control, such as patient expectations and patient adherence to medication.4 For this intervention the investigators focused on two behaviour change theories previously demonstrated to be associated with prescribing behaviour; Theory of Planned Behaviour (TBP) and Operant Learning Theory (OLT).5 The letter will provide some social normative comparison by indicating to these physicians that they prescribe more antibiotics than their peers (TPB). By providing change ideas and information on the consequences of unnecessary antibiotic use, the investigators are attempting to change the physicians' risk perception (TPB) and anticipated consequences (OLT) of prescribing antibiotics for acute respiratory tract infections. This letter represents a form of persuasive communication behaviour change technique (BCT). This form of BCT has shown to be effective in modifying OLT driven behaviours.6, 7
To test different change ideas, the investigators will simultaneously evaluate two types of letters to be randomly distributed to the physicians in the top 25% of prescribers allocated in 3:3:1 ratios; a) Providing change ideas from Choosing Wisely Canada on appropriate initiation of antibiotics for acute respiratory conditions; b) Providing change ideas on appropriate duration of antibiotics.
Designs of the letters went through user testing and were iteratively refined by a sample of Ontario primary care physicians. The letters will be co-branded with the Ontario Medical Association (OMA) Section of General and Family Practice and Choosing Wisely Ontario. The letters were also reviewed by the Ontario College of Family Physicians, HQO and members of the study team to provide input and edits to the language and content. Based on the trial results the investigators will send a letter to all 3500 physicians the following year (12 months later).
Sample Size: Sample size calculations are based on Antibiotic outcome 1. A total of 3500 primary care physicians will be included in the randomized controlled trial: 3000 will receive a letter and 500 will not receive a letter. In an analysis of covariance (ANCOVA), sample sizes of 500, 1500, and 1500 physicians achieve >80% power to detect a 1% absolute difference in the primary antibiotic outcome between the average of the three intervention arms versus control using an F-Test at the 5% level of significance. The calculations assumed a standard deviation of 12 calculated using routinely collected data available within March 1 2017 and February 28 2018, and accounted for the baseline measure of the primary outcome assuming a correlation of 0.8.
The primary outcome will be an intention to treat analysis of the RCT at 12 months for both outcomes 1 and 2. The unit of analysis will be the physician. The primary analysis will use the modified robust Poisson regression approach of Zou and Donner.(Zou and Donner 2013) The dependent variable will be the numerator for each outcome, with the log of the denominator specified as an offset term. The distribution will be Poisson and the link function will be the log-link. The model will include a fixed term for time (pre/post), and the interaction between time and group (intervention). Note that, in order to constrain the differences between the arms at baseline to 0, the model will omit the main effect for the intervention. Pairwise least square mean differences will be obtained from the model (each intervention arm versus control) and expressed as Relative Risk (RR) and 97.5% confidence intervals. Statistical significance will be assessed at the Bonferroni-corrected level of 0.05/3. Robust standard errors will be used, with the correlation structure specified as Exchangeable. Secondary pairwise comparisons will also be obtained from the model (e.g., the average of the two letter versus control, and direct comparison between the two letters).
The investigators will use the same approach for the quarterly data, except that the least square mean pairwise differences will be obtained at the first, second, third and final quarters after randomization, to examine short and long-term effects of the intervention. The investigators will evaluate subgroups including baseline physician prescribing (>90th %ile vs 75-90th %ile), years in medical practice (<10y, 11-24y, vs 25y), physician gender (M vs F), rural vs urban practice, and patient age/sex groupings (<18yM, <18yF, 18-64yM, 18-64yF, 65+M, and 65+F) using IQVIA data.
A secondary outcome will be new physician enrollment into HQO primary care practice reports. Working with HQO, the investigators will track physicians in our study that sign up in response to receiving the letter from Public Health Ontario (PHO) by February 28, 2019. Physicians will be invited to sign up via a special weblink created for this study. The primary analysis will calculate the absolute difference between the proportions of new sign ups in the two intervention arms versus the control arm together with 95% confidence interval. Multiplicity-adjusted pairwise comparisons will also be made between each of the intervention arms versus the control and between the different versions of the letters. The investigators will evaluate predictor variables of new enrollment including baseline physician prescribing (>90th %ile vs 75-90th %ile), years in medical practice (<10y, 11-24y, vs 25y), physician gender (M vs F), rural vs urban practice, and patient age/sex groupings (<18yM, <18yF, 18-64yM, 18-64yF, 65+M, and 65+F) using logistic regression analysis.
To evaluate the overall effect of receiving any letter, compared to no letter, on prescribing outcomes in Ontario, The investigators will use a regression discontinuity design (RDD) by including antibiotic prescribing data from the rest of Ontario's primary care physicians. In the traditional RDD, subjects are assigned to treatment or control based on a cut-off value of a continuous assignment variable. The investigators will use the 3000 primary care physicians who received letters (excluding the 500 physicians in the control arm) as the treatment group and compare them to the remainder of Ontario physicians as controls. The assignment variable in our design is the antibiotic prescription rate (defined as antibiotics per 100 total medications over the year before the intervention).The investigators will present effects graphically by plotting the continuous assignment variable on the x-axis and the continuous outcome variable (antibiotic prescription rate over the year after the intervention) on the y-axis. Different regression lines are then fit to the data on each site of the cut-off. If the intervention is effective, there will be a discontinuity in the regression lines at the value of the cut-off. The intervention effect is expressed as the vertical displacement at the point of discontinuity.8 The investigators will also conduct this analysis for antibiotic duration.
Limitations: The investigators can only monitor antibiotics prescribed per 100 total medications with this dataset, instead of per patient volume. This measure appears to be a reasonable antibiotic use measure within a physician as it is stable over time in high prescribing physicians in our datasets.
Ethical considerations: Antimicrobial stewardship and combating antimicrobial resistance is a provincial and national priority. The Xponent database with prescribing data at an individual prescriber level is already held by PHO and is kept in a secure location. The agreement with IQVIA allows PHO to provide direct feedback to physicians. The letters will be addressed to the physician and marked confidential. The only data within them will be that they have been identified as a high antibiotic prescriber. No specific prescription counts or any patient-level data are being provided.
The investigators have designed this study to maximize HQO sign up and potential impact through a 6:1 allocation. Furthermore, the investigators will send a debrief and follow-up letter to all physicians the following year so that all high prescribing physicians will have the opportunity to receive this information and sign up for HQO reports. Physicians will be given an email address to contact PHO with any questions or concerns regarding the letter. All results will be aggregated and reports will not divulge any prescriber details.
A waiver of consent for this study was provided. This intervention involves minimal risk and burden to participants (letters are sent to physicians from government agencies routinely; these letters do not require an immediate response). There is no anticipated impact on the welfare of physicians by receiving this letter. The intervention would be impractical if consent were required. A consent process even if feasible, would likely create selection bias and make it impossible to answer the research question posed. In addition, the consent process would include a greater burden to physicians than this single letter intervention itself. This quality improvement initiate has the potential to benefit physicians by providing helpful recommendations on optimal antibiotic prescribing practices. A PHO contact email will be provided on the letter to provide physicians the opportunity to contact PHO and opt-out of future letters.
Inclusion Criteria:
Exclusion Criteria: