Skip to main content
OpenTrials
Completed

NCT Number: NCT04096274

Working to Implement and Sustain Digital Outcome Measures

This study will investigate the effects of an organizational implementation strategy called Leadership and Organizational Change for Implementation (LOCI), relative to training and technical assistance only, on fidelity to, and youth service outcomes of, a well-established digital measurement-based care intervention called the Outcomes Questionnaire-Analyst in outpatient community mental health clinics.

Completed

Looking for future studies?

Notify Me

Key information

Age range

4 year and older

Sex eligibility

All sexes

Study type

Interventional

Phase

Not applicable

Primary location

University of California, San Diego, San Diego, California, United States

Loading trial locations.

About this study

Using a cluster randomized, controlled, hybrid type III effectiveness-implementation design, this trial will investigate the effects of LOCI on the fidelity and and clinical outcomes of a digital measurement-based care (MBC) system called the Outcomes Questionnaire Analyst (OQ-A). The trial will enroll up to 22 outpatient mental health clinics that serve youth and randomly assign them using covariate constrained randomization to either LOCI or training and technical assistance only. Within each clinic, up to 2 first level leaders will be recruited (max N of 40 total) and a minimum of 3 clinicians will be recruited per site (60 total). Data on youth outpatients who receive services will be collected in two phases. In each phase, a unique cohort of 360 caregivers of youth who participate in services will be sampled from the participating clinics. Caregivers will report on the service outcomes and experiences of eligible youth who receive services. The total caregiver enrollment for two phases will be 720 (360*2).

Who can participate

Healthy volunteers accepted: Yes

Only the study team can determine whether someone qualifies for participation.

Participants for this project will fall into four groups: 1) clinic executives and upper leaders (i.e., Chief Executive Officer, Executive Directors, program administrators, n=20), 2) clinic first-level leaders (i.e. clinical supervisors, n=20), 3) clinicians serving children with emotional and behavioral disorders (n=120), and 4) caregivers of children with emotional and behavioral disorders who receive outpatient mental health services within participating clinics (n=720). Caregivers will be recruited in two distinct cohorts of 360 each.

Inclusion criteria

for all groups of participants are intentionally broad in line with the pragmatic nature of the trial.

Inclusion criteria

for Clinics

  • Provide outpatient psychotherapy services to children ages 4 to 18 who have emotional and/ or behavioral disorders and their families
  • Have at least 3 full time equivalent clinicians on staff
  • Not currently implementing a digital measurement-based care system clinic wide

Inclusion criteria

for Executives and Upper Leaders

  • Identified as Chief Executive Officer, Executive Director, or high-level administrator at an enrolled clinic

Inclusion criteria

for first-level leaders

  • Identified as a clinical supervisor or clinical work-group supervisor/ leader at an enrolled clinic

Inclusion criteria

for Clinicians

  • Employed as staff at participating clinic
  • Provides outpatient mental health services (psychotherapy) to youth clients

Inclusion criteria

for Caregivers of Youth Who Receive Services at Participating Clinics

  • Child is ages 4 to 18 years at intake,
  • Child has been diagnosed with an emotional or behavioral disorder by clinic staff
  • Clinical staff at the site determined that the youth's treatment needs can be appropriately addressed by the clinic

Treatment and study plan

Leadership for Organization Change and Implementation (LOCI)

Behavioral

LOCI is a multicomponent implementation strategy that engages organizational executives and first-level leaders (i.e., those who administratively supervise clinicians) to build an organizational climate to support the implementation of a focal evidence-based practice (EBP) with fidelity. In this study, the focal EBP is the OQ-A system. LOCI includes two overarching components: (1) monthly organizational strategy meetings between executives and LOCI consultants/trainers to develop and embed policies, procedures, and practices that support implementation of a focal EBP, and (2) training and coaching for first-level leaders, to develop their skills in leading implementation. The aim of these components is to develop an organizational implementation climate in which clinicians' perceive that use of the OQ-A with high fidelity is expected, supported, and rewarded.

Training and Technical Assistance Only

Behavioral

All leaders and clinicians in participating clinics will receive standardized OQ-A training and technical assistance provided by the OQ-A purveyor organization. This includes an initial, 6-hr, in-person OQ-A training; two, live, virtual, 1-hr booster trainings, offered 3 and 5 months after the initial training; and, year-round technical assistance from the OQ-A purveyor organization. Technical assistance includes virtual training sessions, online library of training videos, and customer care representative for technical support.

In addition, to encourage participation in the study, a set of four 1-hr, web-based general leadership seminars will be offered to leaders in the control condition. These will cover topics ranging from effective leadership, to giving effective feedback.

Primary outcomes

  1. Percentage Fidelity to the OQ-A System Experienced by the Youth (0-100%)

    Time frame: 0-6 months after youth's baseline/ entry into treatment

    Fidelity to the OQ-A will be measured by using electronic meta-data from the OQ-A system combined with caregiver reported information on the number of sessions the youth attended. For each youth, a fidelity index will be generated that represents the product of two quantities: (a) the youth's completion rate (i.e., number of measures administered relative to the number of sessions attended within the 6-month observation period), and (b) the youth's viewing rate (i.e., the number of feedback reports viewed by the clinician relative to the number of measures administered). Note that this product is equivalent to the ratio of viewed feedback reports to total sessions; it represents an events/trials proportion. MBC fidelity index scores summarize the level of MBC fidelity experienced by each youth (range=0-1). Higher scores indicate the youth experienced greater fidelity to MBC.

  2. Change From Baseline to 6-months in Youth Total Problems Score on the Short Form Assessment for Children (SAC) - Phase I Cohort

    Time frame: 0-6 months after youth's baseline/ entry into treatment

    The SAC Total Problem Score is a 48-item measure of youth internalizing (e.g., anxious, depressed) and externalizing (e.g., aggressive, noncompliant, overactive) behaviors (range=0-96) completed by caregivers of youth. Total Problem Score was assessed at baseline (youth's entry into treatment) and monthly for 6 months, change from baseline to month 6 is reported.

  3. Change From Baseline to 6-months in Youth Total Problems Score on the Short-form Assessment for Children (SAC) - Phase II Cohort

    Time frame: 0-6 months after youth's baseline/ entry into treatment

    The SAC Total Problem Score is a 48-item measure of youth internalizing (e.g., anxious, depressed) and externalizing (e.g., aggressive, noncompliant, overactive) behaviors (range=0-96) completed by caregivers of youth. Total Problem Score was assessed at baseline (youth's entry into treatment) and monthly for 6 months, change from baseline to month 6 is reported.

Sponsors and collaborators

Lead sponsor

Boise State University

Other

Collaborators

  • National Institute of Mental Health (NIMH)
  • University of California, San Diego
  • University of Central Florida
  • University of Pennsylvania

Registry information

Official study title

Randomized Trial of a Leadership and Organizational Change Strategy to Improve the Implementation and Sustainment of Digital Measurement-based Care in Youth Mental Health Services

Acronym: WISDOM

Important dates

Study start
2019
Primary completion
2022
Study completion
2022
First posted
Sep 19, 2019
Registry last updated
Feb 20, 2024

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.

Published trials that share one or more normalized conditions with this study.