Skip to main content
OpenTrials
Completed

NCT Number: NCT03530098

Validation of an Artificial Intelligence-based Algorithm for Skeletal Age Assessment

The purpose of this study is to understand the effects of using an Artificial Intelligence algorithm for skeletal age estimation as a computer-aided diagnosis (CADx) system. In this prospective real-time study, the investigators will send de-identified hand radiographs to the Artificial Intelligence algorithm and surface the output of this algorithm to the radiologist, who will incorporate this information with their normal workflows to make an estimation of the bone age. All radiologists involved in the study will be trained to recognize the surfaced prediction to be the output of the Artificial Intelligence algorithm. The radiologists' diagnosis will be final and considered independent to the output of the algorithm.

Completed

Looking for future studies?

Notify Me

Key information

Conditions

Sex eligibility

All sexes

Study type

Interventional

Phase

Not applicable

Primary location

Stanford University, Stanford, California, United States

Loading trial locations.

About this study

The investigators are targeting to study the effect of their Artificial Intelligence algorithm on the radiologists' estimation of skeletal age. Currently, radiologists make the estimation using only the radiographic images and health records. As part of this study, the radiologists will estimate skeletal age from radiographic images, health records, and the output of the CADx algorithm. The investigators wish to understand how radiologists using the Artificial Intelligence algorithm compare to radiologists who do not for the specific task of estimating skeletal age.

This study is organized as a multi-institutional randomized control trial with two arms - experiment (receiving the Artificial Intelligence algorithm's output) and control (no intervention). Both of these arms will be compared to a clinical reference standard ("gold standard") composed of a panel of radiologists. The metric of comparison will be Mean Absolute Distance (MAD). The investigators plan to use statistical tests such as the t-test to determine any statistically-significant difference in skeletal age estimation between the two groups.

The investigators have recruited and analyzed data from a sample size of 1600 exams. Patients getting these exams will not undergo any research procedures that deviate from the current standard practices.

Who can participate

Healthy volunteers accepted: No

Only the study team can determine whether someone qualifies for participation.

Exams that meet the following inclusion criteria will be included: (1) exams read by radiologists who interpret pediatric skeletal age exams and verbally consent to participate (2) exams that contain a procedure code or study description indicative of a skeletal age exam.

Exams containing more than one radiograph will not be included. Exams for which a trainee provides a preliminary interpretation will be excluded. No further exclusion criteria will be applied on the basis of image quality metrics or manufacturers. No exclusion criteria will be applied on the basis of patient chronological age.

Treatment and study plan

BoneAgeModel

Device

BoneAgeModel is an Artificial Intelligence tool that takes in a hand radiograph and gender, and outputs the skeletal (bone) age. The intervention involves using this tool as a factor in the clinical decision making process of the participating radiologists. The radiologist's decision will be considered final.

Primary outcomes

  1. Paired Difference of Skeletal Age Estimate

    Time frame: Up to 10 minutes to acquire the scan; up to 2 days to complete diagnosis review

    Mean absolute difference between dictated final impressions (baseline measure by Radiologist) and the consensus determination of a panel of radiologists following review.

Secondary outcomes

  1. Time for Diagnosis

    Time frame: Up to approximately 4 minutes

    Amount of time taken by radiologists when using the BoneAgeModel as compared to when they are not.

Sponsors and collaborators

Lead sponsor

Stanford University

Other

Registry information

Official study title

Prospective, Multi-Center, Randomized Controlled Trial for Skeletal Age Assessment AI Model

Important dates

Study start
2018
Primary completion
2019
Study completion
2019
First posted
May 21, 2018
Registry last updated
Jun 9, 2021

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.

Published trials that share one or more normalized conditions with this study.