AI Tool to Reduce Clinician Documentation Burden

Cognitive load measured using the Physician Task Load (PTL) scale, adapted from the National Aeronautics and Space Administration (NASA) Task Load Index. The PTL includes four items-mental demand, physical demand, effort, and time pressure-each rated on a 0-100 scale with reference to a typical clinical workday during the past 1-2 weeks. Item scores will be summed to produce a continuous composite score ranging from 0 to 400, with higher scores indicating greater cognitive workload. The primary outcome is the clinician-level change in PTL score from baseline to the end of Study Month 2, analyzed under an intention-to-treat framework.

Epic Signal-derived time spent in clinical review, capturing time spent reviewing patient charts and clinical information.

Epic Signal-derived time spent outside scheduled work hours, including evenings and unscheduled days where available.

Self-reported time spent preparing for clinic, during scheduled and outside scheduled work hours (minutes per half-day clinic).

Self-reported time spent reviewing and summarizing a new patient's record prior to clinic.

Change in clinician burnout assessed using a validated single-item self-report measure. The item asks clinicians to rate their current level of burnout on a 5-point ordinal scale ranging from 1 (no symptoms of burnout) to 5 (completely burned out). Higher scores indicate greater burnout. The outcome is the clinician-level change in this single-item burnout rating from baseline to the end of Study Month 2.

Total number of times the AI clinical summarization tool (Evidently) was invoked by each clinician during the study period, as recorded by vendor-provided system logs. Reported as a count aggregated at the clinician level (intervention arm only).

Total number of unique patients for whom the AI clinical summarization tool (Evidently) was used by each clinician during the study period, as recorded by vendor-provided system logs. Reported as a count aggregated at the clinician level (intervention arm only).

Proportion of eligible outpatient visits during the study period for which the AI clinical summarization tool (Evidently) was used by each clinician, as derived from vendor-provided system logs and scheduling data. Reported as a percentage aggregated at the clinician level (intervention arm only).

System-generated data describing clinical contexts in which Evidently was used (e.g., new versus return visits, specialty workflows), supplemented by structured survey items where necessary (intervention arm only).

Usability and fit are assessed using a study-specific Likert agreement questionnaire comprising three statements about Evidently, each rated on a 5-point Likert agreement scale scored from 1 (Strongly disagree) to 5 (Strongly agree); higher scores indicate more favorable usability and fit. The statements are: Evidently is easy to use; Evidently was easy to learn; Evidently fits the chart review and summarization needs of my specialty. Item-level distributions and/or summary scores (e.g., mean or median per item) will be reported at Study Month 2 (intervention arm only).

Perceived accuracy and trust are assessed using a study-specific Likert agreement questionnaire comprising four statements, each rated on a 5-point Likert agreement scale scored from 1 (Strongly disagree) to 5 (Strongly agree); higher scores indicate more favorable perceptions of accuracy and trust. The statements address whether Evidently-generated summaries are generally accurate; whether Evidently highlights clinically relevant information; whether Evidently surfaces relevant information the respondent may not have found independently; and whether summaries from Evidently are at least as good as summaries the respondent would otherwise prepare. Item-level distributions and/or summary scores will be reported at Study Month 2 (intervention arm only).

Single-item measure assessed using a 5-point Likert agreement scale scored from 1 (Strongly disagree) to 5 (Strongly agree); higher scores indicate stronger agreement that Evidently helps the clinician get through their clinical day more easily. The item prompt is: Evidently helps me get through my clinical day more easily. Distribution of responses will be reported at Study Month 2 (intervention arm only).

Self-reported perceived time savings per half-day clinic attributable to Evidently (intervention arm only).

Single-item measure assessed using a 5-point Likert agreement scale scored from 1 (Strongly disagree) to 5 (Strongly agree); higher scores indicate stronger agreement that Evidently helps the clinician provide better patient care. The item prompt is: Using Evidently helps me provide better patient care. Distribution of responses will be reported at Study Month 2 (intervention arm only).

Overall satisfaction with the AI clinical summarization tool (Evidently) is assessed using a single-item measure on a 5-point Likert agreement scale scored from 1 (Strongly disagree) to 5 (Strongly agree); higher scores indicate greater overall satisfaction. The item prompt is: Overall, I am satisfied with Evidently. The outcome is reported as the distribution of responses (frequency and percentage per category) at Study Month 2 (intervention arm only).

Qualitative open-ended feedback collected via a single optional free-text item on the end-of-study questionnaire (no numeric scale is used for this measure). The item invites additional narrative feedback about Evidently, including what worked well, where Evidently was most helpful, what was frustrating or less useful than expected, and suggestions for improvement or new functionality. Responses will be analyzed using qualitative content or thematic analysis. Results will be reported as major themes with counts or proportions of respondents whose responses were assigned to each theme where appropriate, plus representative anonymized quotations. If concise enough, a tabulation of the most common paraphrased response categories may be presented; lengthy narrative responses will be summarized thematically rather than as a ranked list of full verbatim answers (intervention arm only).