Improving Safe Antibiotic Prescribing in Telehealth

In a 3 x 3 (Performance Feedback x Commitment) randomized trial, the investigators will adapt and test two aspects of Core Elements in a telehealth environment (Teladoc®), each with two variations. Qualifying visits include pediatric and adult telehealth visits for acute respiratory infections, including sinusitis, bronchitis, influenza, otitis media, pharyngitis, nonspecific upper respiratory infections, and COVID-19.

All randomization occurs at the provider level, with the exception of the Public Commitment arm, which requires patient-facing content that is determined by patient state. Allocation will be stratified to ensure balance across baseline characteristics including visit volume (consults per year), antibiotic prescribing rate for acute respiratory infections and COVID-19, and average member satisfaction (percent of responses "Outstanding" or "Good").

Performance Feedback (Trending, Benchmark Peer Comparison, Control). Performance Feedback is based on regional performance benchmarks; physicians with antibiotic prescribing rates in the lowest 3 deciles are designated top performers. The electronic health record (EHR) metrics and messaging are designed to align with enterprise-wide performance feedback practices. A minimum of 8 qualifying visits is required for a provider to see a message.

Providers randomized to Performance Feedback interventions will see one of two feedback messages in the EHR:

• Trending Feedback Message: If the clinician's mean monthly antibiotic prescribing rate for acute respiratory infections is below the 3rd decile, where better performance is indicated by a position in a lower decile, providers will see the following message with a link to the clinical practice guidelines: "Your antibiotic prescribing rate is X%. Stay in the growing number of providers in your group that have stopped inappropriate antibiotic prescribing." If the clinician's mean monthly antibiotic prescribing rate for ARIs is above the 3rd decile where better performance is indicated by a position in a lower decile, providers will see the following message with a link to the clinical practice guidelines: "Your antibiotic prescribing rate is Y% (where Y% is the prescribing rate of the third decile). Don't be left behind! Join the growing number of providers in your group who prescribe antibiotics only when clearly indicated."
• Benchmark Peer Comparison Feedback Message: If the clinician's mean monthly antibiotic prescribing rate for ARIs is below the 3rd decile, where better performance is indicated by a position in a lower decile, providers will receive the following message: "You are a Top Performer. Your antibiotic prescribing rate is X%. Top performers in your group typically prescribe antibiotics in X% of visits." If the clinician prescribing rate is above the 3rd decile, where better performance is indicated by a position in a lower decile, providers will receive the following message: "You are not a Top Performer. Top performers in your group typically prescribe antibiotics in Y% of visits."

Commitment (Private, Public, Control). Clinicians assigned to the Private Commitment arm will make a personal commitment to evidence-based use of antibiotics that is not shared with their patients, while those assigned to Public Commitment will make a commitment to evidence-based use of antibiotics that is shared with their patients. For both arms, this commitment is displayed on the clinician's personal provider dashboard.

Providers randomized to the Commitment interventions will be asked to complete one of two commitments:

• Private Commitment: Providers will be given the following options:1) Record my commitment or 2) Do not include me in the commitment, followed by a text box to type their name. For clinicians who choose option 1, their commitment is displayed on their personal provider dashboard at the time of each login.
• Public Commitment: Providers will be given the following options:1) Record and share my commitment with my patients OR 2) I am not committed to the new guidelines, followed by a text box to type their name. For clinicians who opt in, the commitment is displayed on their personal dashboard at each login.

Patients in states assigned to Public Commitment will see the clinician's commitment at the end of their visit request. Patients will select: 1) I understand the provider's commitment OR 2) I do not understand and need more information. Clinicians in this arm will be notified about the patient response in the EHR during the visit.

The primary outcome is to assess the change in antibiotic prescribing rate for qualifying acute respiratory infection visits.

Inclusion criteria

• Clinicians with prescribing privileges and one or more Acute Respiratory Infection visit
• Eligible encounters include pediatric and adult telehealth visits for Acute Respiratory Infections, including Sinusitis, Bronchitis, Influenza, Otitis Media, Nasopharyngitis, Upper Respiratory Infections, and COVID-19.