Youth FORWARD Phase 2 YRI and EPP Study

Scale-up Study Objectives

We propose to implement and test an evidence-based intervention called the Youth Readiness Intervention (YRI) alongside GIZ's youth entrepreneurship training (EPP). This scale-up study expects to enroll 1200 youth across three treatment arms (control, EPP, YRI+EPP) across GIZ's three target districts. Typically, GIZ targets youth considered to be underemployed or unemployed and youth with low literacy levels. While that criteria will remain, given the socioemotional aims of the YRI, youth must also demonstrate impaired functioning and emotional dysregulation as assessed by a screening tool (see section 4b for more information regarding inclusion criteria). Together, this model is intended to improve the mental health and functioning of vulnerable Sierra Leonean youth while demonstrating the capacity for a technical behavioral change intervention to be delivered via an alternative delivery platform like employment programs. Past implementation of the YRI in Sierra Leone has led to the creation of an evidence-informed intervention that is both relevant and culturally responsive. Most importantly, however, the previous implementation of the YRI RCT within education relied on trained counselors. By demonstrating that the YRI can be delivered by service professionals who may not have clinical training while integrated into employment programming the ability for Youth FORWARD to be adopted for scale-up across Sierra Leone and other LMICs is further strengthened. Specifically, the objects and aims of this scale up study are:

AIM 1 (Implementation Impact Evaluation): To utilize an innovative Collaborative Team Approach (CTA) to scaling and sustaining the YRI in terms of feasibility of this approach, facilitator preparedness and sense of satisfaction and impacts on fidelity and sustainment of delivery of YRI.

AIM 2 (Implementation Process Evaluation): To identify internal and external factors influencing the integration of the YRI into the youth EPP programs via a process evaluation documenting barriers and facilitators to effective implementation and integration.

AIM 3 (Clinical Effectiveness): To compare clinical effectiveness of YRI when delivered via the EPP platform to results of our previous randomized control trial (RCT) of YRI as measured by improved mental health and reduced functional impairments among high-risk youth. Emotion regulation will be examined as a major mechanism by which the YRI improves behavior of treated youth and their functioning in the EPP.

Subjects

The total sample size across sites is 3630. The breakdown of study participants by size and target population is as follows: 1200 youth participants, 2400 third-party reporters, 20 YRI facilitators, and 10 agency stakeholders.

Study Design and Methods

The scale-up study reflects a Hybrid Type 2 Effectiveness-Implementation Cluster Randomized three-arm trial which simultaneously evaluates the use of a CTA for service delivery, supervision, intervention fidelity monitoring, and sustainment of evidence-based practices. The study will be conducted in three rural districts in Sierra Leone and involve a total sample size across sites of 3630: 1200 youth participants, 2400 third-party reporters, 20 facilitators, and 10 agency leaders. The 1200 youth (50% females, ages 18-30 years) will be randomized into three study arms: 1) control (n=400 youth); 2) EPP-only (n=400 youth); 3) YRI+EPP (n=400 youth). Data will be collected at baseline, post-YRI (sub-sample of youth randomized to receive the YRI+EPP), post-EPP, and 12-months follow-up.

Study location The scale-up study will be conducted in the districts of Kono, Koinadugu and Kailhun in Sierra Leone, as GIZ's country programming operates exclusively in these locations. The most commonly used language in these districts is Krio and all study related materials for the field will be translated to Krio.

Program delivery The YRI is organized into 12, 90-minute group meetings or sessions to be delivered over the course of 12 weeks. The YRI is designed to be delivered by a range of lay workers in LMICs.

GIZ will use a competitive bidding process to hire service provision agencies that will design and implement the youth EPP training modules. A selection of individuals from the agencies will be trained as YRI facilitators.

Training and supervision Facilitators will receive an intensive training regarding all YRI components. This training will be delivered by local experts who have received previous training from Youth FORWARD leadership and who have been integral into the creation of the YRI

Data collection IPA will oversee the youth participant quantitative data collection while the Caritas Freetown research team will oversee qualitative data collection as well as the quantitative data collection regarding the third-party reporters. IPA's local research assistants will conduct all screening, baseline, and post-intervention quantitative assessments. Youth will be asked to complete the quantitative assessment battery at baseline, post-YRI (sub-sample of youth), post-EPP 12-months follow-up (from baseline).

To strengthen youth self-report and provide more insight into youths' psychosocial functioning, we will utilize a third-party reporter to gain further insight into programmatic effects. Two third-party reporters will be selected per each youth across all study arms (control, EPP and YRI+EPP) from a list provided by the youth participant, and quantitatively surveyed at four time points (baseline, post-YRI (sub-sample of youth), post-EPP, and 12 months). The surveys administered to the third-party reporter include questions related to youth participant emotional regulation, workplace performance and interpersonal functioning.

Study Procedures

Step 1. Youth who apply and meet the eligibility criteria for the EPP will be contacted by our research team. Information about our study will be provided and appointments for in-person meetings with research team members will be scheduled.

Step 2. Consent. Consent forms will be available in Krio. The consent form will be read out loud to participants to ensure illiteracy does not interfere with the consenting process.

Step 3. Once consent is obtained, information for the third-party reporters will be collected and youth will be screened to determine if they have elevated t-scores on functional impairment based on thresholds from our previous research using questions adapted from the World Health Organization Disability Assessment Schedule (WHODAS) (scoring at least a 1 on this scale) and have elevated t-scores (62.5 or above) on the Disturbances in Emotion Regulation Scale (DERS) as determined through previously validated screening procedures.

Step 4. Youth who meet our study criteria and are interested in participating will be collated into one list. The locations of the residences of these youth will inform our clustering approach. Clusters of youth will be assigned to one of the three study arms.

Step 5. Youth will be contacted and informed of their assigned study arm. The entire intervention is expected to last six months with the YRI delivered during the first three months and the EPP delivered during the second half of the intervention period.

Step 6. Youth participants across all treatment arms will be asked to complete quantitative assessment batteries at baseline, post-YRI (sub-sample of youth), post-EPP and 12, follow-up. The assessment batteries will be used for research purposes. The intervention is delivered both for the treatment of the subjects' condition and research purposes.

Inclusion criteria

Youth aged 18-30 will be included in the Youth FORWARD scale-up study based upon eligibility to the employment program, focusing specifically on socioeconomic status and willingness and interest in participation in an employment program, as well as mental health screening, which will include questions on daily functioning and emotional regulation.

Specifically, inclusion criteria for the youth sample is:

• be Sierra Leonean,
• be female or male aged 18-26,
• be considered a vulnerable youth who is disengaged from both education and employment programs,
• have elevated t-scores on functional impairment based on thresholds from our previous research using questions adapted from the World Health Organization Disability Assessment Schedule (WHODAS)54 and,
• have elevated t-scores (62.5 or above) on the Disturbances in Emotion Regulation Scale (DERS).55

Inclusion criteria

for agencies in this study is:

• be a "service provision agency" in Sierra Leone,
• have a minimum of two experts employed, one with subject-specific knowledge and; experience, and another with pedagogical experience in adult education and working with youth with low literacy, and
• sign a Memorandum Of Understanding (MOU) with Boston College (BC) regarding intellectual property of the YRI.

Inclusion criteria

for facilitators in this study is:

• be employed by one of the agencies selected in GIZ's competitive bidding process, and
• agree to participation in the ICTA which utilizes an enhanced supervision structure throughout the intervention.

Inclusion criteria

for third-party reporters in this study is:

• be over age 18,
• be nominated by the youth participant,
• provide oral consent to participate in the quantitative assessments, and
• have daily to weekly contact with the youth participant throughout the duration of this scale-up study, which will be assess via verbal confirmation when obtaining oral consent.

Inclusion criteria

for agency leaders is:

• must be a part of one of the agencies selected in GIZ's competitive bidding process and,
• must hold a leadership position in the agency.

Exclusion criteria

Exclusion criteria

for the youth:

Youth will be excluded from the study if they do not fulfill the inclusion criteria or:

• present with severe mental illness (e.g., psychosis), or
• developmental disability that precludes comprehension of the intervention content and assessments.

Specifically, mental health exclusion criteria are:

• severe, active suicidality or psychosis as assessed via the MINI-KID diagnostic assessment administered by a study social worker and,
• serious cognitive impairments that might preclude one's ability to comprehend informed consent and complete study assessments as determined by a study social worker.

Youth who report active suicidality or symptoms of psychosis requiring more intensive mental health care will be referred for immediate individual mental health services

Exclusion criteria

for the agencies:

Agencies will be excluded from participation if:

• they are not considered a "service provision agency", and
• if they do not have a minimum of two experts employed: one with subject-specific knowledge and experience, and another with pedagogical experience in adult education and working with youth with low literacy.

Those holding leadership positions within the agencies selected to deliver the intervention will be excluded from participation in the qualitative interviews if:

• they are not employed at the agencies selected, or
• are not considered to be in a leadership position within the agency.

Exclusion criteria

for the facilitators:

Facilitators will be excluded from participation in delivering the intervention if:

• they are unable to deliver core components of the YRI and EPP intervention, and
• if they are unable to meet the logistical demands of the ICTA

Exclusion criteria

for the third-party reporters:

The third-party reporter will be excluded from the study if:

• they are under age 18,
• present with severe mental illness (e.g., psychosis), or
• developmental disability that precludes comprehension of the intervention content and assessments (as determined by a study social worker), and
• if the third-party reporter does not have at least monthly contact with the youth participant