Skip to main content
OpenTrials
Not Yet Recruiting

NCT Number: NCT07222644

Clinical Language Evaluation With AI for Residents

The purpose of this study is to refine and test existing enterprise-grade large language model (LLM) based on generative artificial intelligence (AI), to assess the feasibility and acceptability of LLM-based feedback, to assess the ability of LLM-based feedback to improve residents' communications,to explore the ability of standardized patients to assess residents' communication and to explore the ability of residents to self-assess their communication complexity

Not Yet Recruiting

Trial opening soon.

Get Notified

Key information

Conditions

Patient Communication

Age range

18 year–50 year

Sex eligibility

All sexes

Study type

Interventional

Phase

Not applicable

Primary location

Who can participate

Healthy volunteers accepted: Yes

Only the study team can determine whether someone qualifies for participation.

Inclusion criteria

  • McGovern Medical School (MMS) general surgery residents
  • postgraduate year (PGY) 1-5

Treatment and study plan

educational LLM-based feedback tool

Behavioral

Participants will have their verbal communications with standardized patients (SP) regarding 3 different scenarios recorded, transcribed, and analyzed in real-time by the large language model (LLM) and will receive feedback as suggestions and alternative scripts. These will be reviewed by residents between SP scenarios

Primary outcomes

  1. Readability discernment as assessed by a survey

    Time frame: end of intervention ( 1 hour after baseline)

    This will be scored by the by Cohen's Kappa values from 1-5. Higher Cohen's kappa scores mean better outcome

  2. Quality discernment as assessed by a survey

    Time frame: end of intervention ( 1 hour after baseline)

    This will be scored by the by Cohen's Kappa values from 1-5. Higher Cohen's kappa scores mean better outcome

  3. Correctness of recommendations as assessed by a survey

    Time frame: end of intervention ( 1 hour after baseline)

    This will be reported on a 5 point Likert scale form 1 very incorrect to 5 very correct

  4. Applicability of recommendations as assessed by a survey

    Time frame: end of intervention ( 1 hour after baseline)

    This will be reported on a 5 point Likert scale form 1 very inapplicable to 5 very applicable

  5. Perceived readability of resident-standardized patient (SP) interactions as assessed by a survey: schooling level

    Time frame: end of intervention ( 1 hour after baseline)

    This will be categorically reported in the following categories:

    Elementary middle high college graduate

  6. confidence in communication ability

    Time frame: end of intervention ( 1 hour after baseline)

    This is scored from 1( very unconfident) to 5 (very confident)

  7. usefulness of the LLM

    Time frame: end of intervention ( 1 hour after baseline)

    This is scored from 1( very useless) to 5 (very useful)

  8. acceptability of future use

    Time frame: end of intervention ( 1 hour after baseline)

    This is scored from 1( very unlikely) to 5 (very likely)

Secondary outcomes

  1. Survey feedback on the LLM interface

    Time frame: end of intervention ( 1 hour after baseline)

    This is scored from 1( very unrealistic) to 5 (very realistic)

  2. readability grade level of resident-SP transcripts as assessed by the Flesch-Kincaid Grade Level (FKGL) readability tool

    Time frame: end of intervention ( 1 hour after baseline)

    Readability of resident-SP encounter transcripts will be assessed using the Flesch-Kincaid Grade Level formula, which estimates the U.S. school grade level required to understand the text. Higher scores indicate a higher reading grade level (i.e., lower readability).

    Formula used:

    Grade level= 0.39(total words/total sentences) + 11.8 (total syllables/total words)-15.59

  3. Quality based on Ensuring Quality Information for Patients (EQIP) score of resident-SP transcripts

    Time frame: end of intervention ( 1 hour after baseline)

    Percentage score based on a validated questionnaire This has 20 questions and each is scored from 1(yes), 0.5(partly), 0 (no) and question is removed if it does not apply.Scores are reported as a percentage and higher percentage score indicates better quality

  4. Perceived readability of SP-resident interactions as assessed by a standardized survey

    Time frame: end of intervention ( 1 hour after baseline)

    This will be categorically reported in the following categories:

    Elementary middle high college graduate

  5. confidence in communication ability

    Time frame: end of intervention ( 1 hour after baseline)

    This is scored from 1( very unconfident) to 5 (very confident)

Study contacts

Contact information is provided by the study sponsor or research team.

Krislynn M Mueck, MD, MS, MPH

CONTACT

[email protected]

(713) 500-7409

William D Rieger

CONTACT

[email protected]

(713) 500-7300

Sponsors and collaborators

Lead sponsor

The University of Texas Health Science Center, Houston

Other

Collaborators

  • Health Science Education Small Grants Program

Registry information

Official study title

Clinical Language Evaluation With AI for Residents (CLEAR2) - A Pilot Randomized Controlled Trial

Acronym: CLEAR2

Important dates

Study start
2025
Primary completion
2026
Study completion
2026
First posted
Oct 30, 2025
Registry last updated
Oct 30, 2025

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.