Recruiting

NCT Number: NCT07505862

Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination

This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility.

The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.

Recruiting

Interested in participating?

Request Info

Key information

Conditions

AI (Artificial Intelligence)

Age range

18 year–60 year

Sex eligibility

All sexes

Study type

Observational

Primary location

Guangdong Provincial People's Hospital

Guangzhou, Guangdong, China

Location status: Recruiting

Location contact

ZhuoYi Chen MD

CONTACT

[email protected]

+86 18737552662

Who can participate

Healthy volunteers accepted: Yes

Only the study team can determine whether someone qualifies for participation.

Inclusion criteria

1.Professional Status: Medical students currently enrolled in a Standardized Residency Training (SRT) program.

2.Educational Background: Holders of a Bachelor of Medicine degree or higher, with foundational clinical knowledge.

3.Informed Consent: Voluntarily participate in the study and provide written informed consent.

4.Technical Competency: Proficient in using digital platforms to complete assessments and scoring.

Exclusion criteria

1.Conflict of Interest: Individuals involved in the AI model training, prompt engineering, or the creation of the human-authored question bank for this study.

2.Inability to Complete: Presence of visual/auditory impairments or severe illness that precludes completion of the assessment within the specified time.

3.Investigator's Discretion: Any other condition that, in the opinion of the investigator, renders the participant unsuitable for the study.

Treatment and study plan

Primary outcomes

Comparative Analysis of Item Accuracy

Time frame: Baseline

The investigators will evaluate the average accuracy rates coefficients of AI-generated items compared to human-generated items

Study contacts

Contact information is provided by the study sponsor or research team.

Zhuoyi Chen MD

CONTACT

[email protected]

+86 18737552662

Sponsors and collaborators

Lead sponsor

Guangdong Provincial People's Hospital

Other

Registry information

Official study title

Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination: An Empirical Analysis Based on the "Answering-Generating" Closed Loop and Transformation of Competency Assessment

Important dates

Study start: 2025
Primary completion: 2026
Study completion: 2026
First posted: Apr 1, 2026
Registry last updated: Apr 1, 2026

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.

Published trials that share one or more normalized conditions with this study.

Recruiting