AI prediction (binary)
BehavioralAI decision support based on cervical ultrasound providing a binary classification (preterm birth before 37 weeks or term birth) in addition to standard clinical information.
NCT Number: NCT07402668
The goal of this randomized questionnaire-based study is to evaluate how different presentations of artificial intelligence (AI) decision support influence clinical judgment among medical doctors working in obstetrics and gynecology when assessing the risk of spontaneous preterm birth using clinical case vignettes with cervical ultrasound images. The study specifically compares two AI presentation formats: a binary classification (preterm vs term birth) and an individualized risk estimate of preterm birth.
The main questions it aims to answer are:
* Which AI presentation format leads to better alignment between clinicians' confidence and decision accuracy (diagnostic calibration)? * Do different AI presentation formats lead to helpful or harmful changes in clinical decisions?
Participants will complete an online questionnaire in which they review clinical cases, make diagnostic and management decisions, rate their diagnostic confidence before and after seeing the AI output, and report their trust in the AI.
Interested in participating?
Request InfoAll sexes
Interventional
Not applicable
South Jutland Hospital, Aabenraa, Denmark
Healthy volunteers accepted: Yes
Only the study team can determine whether someone qualifies for participation.
Inclusion criteria
Exclusion criteria
AI decision support based on cervical ultrasound providing a binary classification (preterm birth before 37 weeks or term birth) in addition to standard clinical information.
AI decision support based on cervical ultrasound providing an estimate of preterm birth risk (%) in addition to standard clinical information.
Time frame: Immediately after AI exposure during a single questionnaire session (approximately 20 minutes).
Agreement between post-AI decision correctness (0/1) and post-AI confidence rating (0-10) will be quantified using the Brier score. Confidence will be rescaled to 0-1 and squared differences between confidence and correctness will be averaged across cases to produce a participant-level score. Lower scores indicate better diagnostic calibration. Results will be compared between randomized arms.
Time frame: Baseline (pre-AI) and immediately after AI exposure during a single questionnaire session (approximately 20 minutes).
Proportion of cases with helpful and harmful switches calculated for each participant and compared between study arms.
Helpful switch = incorrect pre-AI decision changing to correct post-AI decision.
Harmful switch = correct pre-AI decision changing to incorrect post-AI decision.
Time frame: Baseline (pre-AI) and immediately after AI exposure during a single questionnaire session (approximately 20 minutes).
Within-participant change from pre-AI to post-AI in decision accuracy (proportion of correct decisions), confidence rating, and diagnostic calibration. Differences will be compared between randomized arms and stratified by AI correctness.
Time frame: Immediately after AI exposure during a single questionnaire session (approximately 20 minutes).
Self-rated trust in the AI output will be measured using a numeric rating scale (0-10) after AI exposure for each case. Behavioral reliance will be quantified as the proportion of post-AI decisions concordant with the AI output. The relationship between trust ratings and behavioral reliance, including concordance when the AI is correct and incorrect, will be evaluated at the participant level and compared between randomized arms.
Time frame: Baseline (pre-AI) and immediately after AI exposure during a single questionnaire session (approximately 20 minutes).
Proportion of cases in which clinicians plan an additional cervical ultrasound (yes/no), summarized per participant and compared pre-post AI and between randomized arms.
Contact information is provided by the study sponsor or research team.
Rigshospitalet, Denmark
Other
OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.
View the official ClinicalTrials.gov record (opens in a new tab)This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.
Published trials that share one or more normalized conditions with this study.
NCT07598097
Artificial Intelligence (AI) in Diagnosis, Female Urogenital Diseases and Pregnancy Complications
Copenhagen, Denmark
View Trial DetailsNCT05703425
Female Urogenital Diseases and Pregnancy Complications, Obstetric Labor Complications
New Brunswick, New Jersey, United States
View Trial DetailsNCT07458802
Antenatal Care, Antenatal Health
Gaborone, Botswana
View Trial DetailsNCT05787509
Female Urogenital Diseases and Pregnancy Complications, Obstetric Labor Complications
Guangzhou, China
View Trial Details