Skip to main content
OpenTrials
Active, Not Recruiting

NCT Number: NCT03938610

Do Script Concordance Tests Correlate With Family Medicine Standardized Tests and Failing Rotation Grades?

Delayed or poor identification and remediation of clinical reasoning difficulties can lead to clinician underperformance and can ultimately compromise patient care. To date, no research has been done to see if SCTs correlate with current grading standards (ITE, ABFM certification exam score, ACGME milestones, or failing clinical rotation grades) in Family Medicine Residents. If investigators can identify that an SCT correlates with current standardized testing of Family medicine residents, it could be possible to identify struggling learners prior to poor scores on the ITE, ACGME milestones, or clinical rotations. If a learner does poorly on an SCT early in the academic year the learner can begin a remediation plan to improve their deficits before receiving a failing grade, poor ITE or ACGME milestone scores.

Active, Not Recruiting

This study is active but is not currently recruiting participants.

Key information

Conditions

Knowledge, Attitudes, Practice Behavior

Sex eligibility

All sexes

Study type

Observational

Primary location

Mike O'Callaghan Military Medical Center

Las Vegas, Nevada, 89191, United States

About this study

This study is a longitudinal observation study. A panel of experts (numbering 15-20) consisting of Family Medicine attendings who have been out of residency greater than 3 years will complete the SCT. They will be provided an Informational Consent. Their willingness to be a panel member is their implied consent to be part of the research study.

The basic idea behind SCT is to compare residents' performance with a group of persons who are representatives of the profession (or the specialty) to which they wish to belong. Therefore, panels are made up of physicians with good overall clinical experience in the field rather than experts from narrow parts of the field. Panel composition also depends on the assessment goal.

This study will determine if a Script Concordance Test (SCT) correlates with Family Medicine In Training Exam (ITE) scores, American Board of Family Medicine (ABFM) certification exam scores, Accreditation Council for Graduate Medical Education (ACGME) medical knowledge and patient care milestones, and failing family medicine inpatient clinical rotation grades.

The SCT will be given to PGY1, 2, and 3 residents each year during the Residents three year residency, in June or July.

Who can participate

Healthy volunteers accepted: No

Only the study team can determine whether someone qualifies for participation.

**Patients must be able to get care at Nellis Air Force Base (a military installation) in order to participate in this study**

Inclusion criteria

--Family Medicine resident at 99MDG

Exclusion criteria

-- N/A

Treatment and study plan

Primary outcomes

  1. SCT scores compared to ITE scores

    Time frame: year 1

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  2. SCT scores compared to ITE scores

    Time frame: year 2

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  3. SCT scores compared to ITE scores

    Time frame: year 3

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  4. SCT scores compared to ABFM scores

    Time frame: year 1

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  5. SCT scores compared to ABFM scores

    Time frame: year 2

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  6. SCT scores compared to ABFM scores

    Time frame: year 3

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  7. SCT scores compared to family medicine rotation grades

    Time frame: year 1

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  8. SCT scores compared to family medicine rotation grades

    Time frame: year 2

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  9. SCT scores compared to family medicine rotation grades

    Time frame: year 3

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  10. SCT scores compared to ACGME milestones.

    Time frame: year 1

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  11. SCT scores compared to ACGME milestones.

    Time frame: year 2

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  12. SCT scores compared to ACGME milestones.

    Time frame: year 3

    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.

  13. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones.

    Time frame: year 1

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  14. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones.

    Time frame: year 2

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  15. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones.

    Time frame: year 3

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  16. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades.

    Time frame: year 1

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  17. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades.

    Time frame: year 2

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  18. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades.

    Time frame: year 3

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  19. Binomial SCT classification derived from each interval SCT scores compared to ITE

    Time frame: year 1

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  20. Binomial SCT classification derived from each interval SCT scores compared to ITE

    Time frame: year 2

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  21. Binomial SCT classification derived from each interval SCT scores compared to ITE

    Time frame: year 3

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  22. Binomial SCT classification derived from each interval SCT scores compared to ABFM

    Time frame: year 1

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  23. Binomial SCT classification derived from each interval SCT scores compared to ABFM

    Time frame: year 2

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

  24. Binomial SCT classification derived from each interval SCT scores compared to ABFM

    Time frame: year 3

    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

Sponsors and collaborators

Lead sponsor

Pamela Hughes

Fed

Registry information

Important dates

Study start
2019
Primary completion
2026
Study completion
2026
First posted
May 6, 2019
Registry last updated
Jul 23, 2025

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.

Related clinical trials

Published trials that share one or more normalized conditions with this study.