Student Outcomes of Integrative Mental Health Services

The Behavior and Feelings Survey-Youth and Caregiver Report (BFS-Youth and Caregiver) is a no-cost, 12-item, youth- and caregiver-report measure of internalizing and externalizing problems. The BFS-Youth and Caregiver showed robust factor structure, internal consistency, test-retest reliability, and slopes of change indicating efficacy in monitoring treatment progress during psychotherapy in four samples of youths aged 7-15 years. The BFS-Youth and Caregiver is administered weekly.

The Behavior and Feelings Survey-Teacher Report (BFS-Teacher) is a no-cost, 12-item, teacher-report measure of internalizing and externalizing problems. The BFS-Teacher showed robust factor structure, internal consistency, test-retest reliability, and slopes of change indicating efficacy in monitoring treatment progress during psychotherapy in four samples of youths aged 7-15 years. The BFS-Teacher is administered monthly.

The Top Problems Assessment-Youth and Caregiver Report (TPA- Youth and Caregiver) is a brief idiographic instrument designed to help identify and monitor youth problems that are especially important from the perspectives of the youth and caregiver. The TPA- Youth and Caregiver were shown to complement standardized measures and offer incremental utility, with evidence of test- retest reliability, convergent and discriminant validity, and sensitivity to change during treatment. The TPA-Youth and Caregiver is administered weekly.

The Top Problems Assessment-Teacher Report (TPA-Teacher) is a brief idiographic instrument designed to help identify and monitor youth problems that are especially important from the perspectives of the youth's teacher. The TPA-Teacher has not yet been examined psychometrically. The TPA-Youth and Caregiver is administered monthly.

Academic outcomes as obtained through class grades and standardized school testing.

The National Survey of American Families (NSAF-Youth and Caregiver) School Engagement Scale is a youth- and caregiver-reported is a measure of behavioral, emotional, and cognitive engagement in school. Respondents rate youth on a four-point scale on items assessing whether the youth cares about doing well in school, only works on schoolwork when forced to, does just enough schoolwork to get by, and always does their homework

The National Survey of American Families (NSAF-Teacher) School Engagement Scale is a measure of behavioral, emotional, and cognitive engagement in school. Respondents rate youth on a four-point scale on items assessing whether the youth cares about doing well in school, only works on schoolwork when forced to, does just enough schoolwork to get by, and always does their homework. NSAF-Teacher is administered monthly.

Self-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The YSR is supported by extensive psychometric evidence. Youth complete the YSR at baseline, post-treatment, and 6 month follow-up.

Caregiver-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The CBCL is supported by extensive psychometric evidence. Caregivers complete the CBCL at baseline, post-treatment, and 6 month follow-up.

Teacher-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The TRF is supported by extensive psychometric evidence.

This 38-item measure is widely-used to assess child post-traumatic stress symptoms. Part I is a brief lifetime trauma screen. If the participant identifies significant trauma, Part II assesses Diagnostic and Statistical Manual-IV (DSM-IV) PTSD symptoms related to the trauma. Part III assesses frequency of post-traumatic stress symptoms during the past month. The UCLA Post-traumatic Stress Disorder Reaction Index is administered separately to youth and their caregivers at baseline, post-treatment, and 6 month follow-up.

To assess whether treatment reduced the need for other services, a modified version of the Services Assessment for Children and Adolescents (SACA), a standardized parent-report interview assessing use of multiple mental health services (e.g., medication for a behavioral or emotional problem, inpatient psychiatric hospitalization) will be administered. At pre-treatment, the reporting time frame will be the previous 6 months, to establish a baseline for each student; at post-treatment, the time frame will be the period when treatment was received; at follow-up, the time frame will be the 6 months since treatment ended.

To assess whether medication influenced students' intervention response, we ask caregivers a series of questions to assess medications, dosage, and reasons for the medications--adapted from the SCA-PI (a standardized parent-report interview). The SCA-PI has particular strength in medication assessment, including start dates, end dates, and dosage. The medication questionnaire is administered at baseline, post-treatment, and at 6-month follow-up.

Youth and caregivers will be given the TASC, to assess the quality of the youth's working alliance with the therapist.This 7-item scale comes in both a youth-report form and a parent-report form (parents reporting on their youth's relationship with the therapist).

Caregivers complete the Caregiver Satisfaction Questionnaire at post-treatment, assessed up to 40 weeks after baseline. The Caregiver Satisfaction Questionnaire is 8 questions (e.g., "How would you rate the quality of the counseling services that were provided?").

The Youth Satisfaction Questionnaire consists of 8 questions (e.g., "Overall, how happy are you with the help you got?") assessing the youth's satisfaction with mental health services.

Therapists complete the TSI at the completion of treatment. The TSI is a 16-item measure that assesses whether therapists liked the treatment approach they used, whether the approach made them feel effective, whether they believe it allowed them to individualize treatment to fit the needs of the client, and whether it seems appropriate for the kinds of children they most often see.

The ERC is a 24-item questionnaire using a 4-point Likert scale that assesses the caregiver's perceptions of their children's ability to manage emotion. This measure yields two empirically derived scales: (a) Emotion Regulation that assesses situationally appropriate affective displays and emotional self-awareness, and (b) Lability/Negativity, which measures mood lability and culturally inappropriate affective displays. Internal consistency has been established for this measure as well as support for its construct validity. Caregivers complete the ERC at baseline, post-treatment, and 6-month follow-up.

Caregivers complete this 53-item, self-report measure of adult symptomatology at baseline. This measure generates scores on nine dimensions (e.g., Depression, Anxiety, Hostility) and a General Severity Index (GSI).

The CEMS assesses children's self-report of sadness, anger, and worry regulation. Children indicate the frequency with which they engage in a variety of emotion management strategies using a Likert scale of 1 (hardly ever), 2 (sometimes), or 3 (often). Three subscales have been identified for each emotion: (a) Inhibition (four items),(b) Dysregulated Expression (three items), and (c) Emotion Regulation Coping (five items for sadness scale and four items for anger scale). Examination of the reliability of the CEMS anger and sadness scales indicate coefficient alphas that range from .62 to .77 and test-retest reliability ranging from .61 to .80 for the individual subscales. Children complete the CEMS at baseline, post-treatment, and 6 month follow-up.

The CRSQ is modeled after Nolen-Hoeksema's Response Styles Questionnaire and consists of 25 items, each of which describes a particular response to symptoms of depression. The items are grouped into three scales: (1) Ruminative Response subscale (CRSQ-Rumination); (2) Distracting Response subscale (CRSQ-Distraction); and (3) Problem-Solving subscale (CRSQ-Problem solving). For each item, youth are asked to indicate how often they respond in this way when they are feeling sad (almost never = 0,sometimes = 1, often = 2, or almost always = 3). Scores range from 0 to 39 on the Ruminative Response subscale, from 0 to 21 on the Distracting Response subscale, and from 0 to 15 on the Problem Solving subscale. Higher scores on each subscale indicate a greater tendency to engage in that particular response style.Children complete the CRSQ at baseline, post-treatment, and at 6 month follow-up.

The PCSC assesses perceived ability to exert primary control -that is, to influence or alter objective events or conditions through one's own effort. Youth rate agreement with statements about their ability to exert primary control, with half the items worded in a positive direction (e.g., "I can do well on tests if I study hard.") and half in a negative direction (e.g., "I cannot get other kids to like me no matter how hard I try."). Responses can range from "very true" to "very false." This scale has shown acceptable internal consistency (α=0.88) and six-month test-retest reliability (r=0.57) as well as a strong inverse relation to depressive symptoms (r=0.58 with Children's Depression Inventory scores).

This 20-item scale was designed to assess perceived ability to exert secondary control-that is, to influence the personal psychological impact of objective conditions on oneself, by adjusting oneself to fit those conditions. The item content reflects response patterns associated with secondary control in the two-process model, for example, finding a silver lining, adjusting cognition, avoiding rumination, and generic secondary control. To discourage response sets, half the items are worded in a positive direction and half in a negative direction. Respondents rate their agreement with each item (on a 4-point scale, from "very false" to "very true").

The RAVS measures the frequency of reporting aggressive behaviors or of being victimized during the previous week prior to the survey. The scales are composed of six items each. Each point represents one instance of aggression or victimization reported by the child. The RAVS is administered at baseline, post-treatment, and 6 month follow-up.

This study includes a new scale adapted from Dweck's work on implicit theories for intelligence to measure implicit theories regarding thoughts, emotions, and behaviors. The ITEB-Q contains twelve items; four items each address implicit theories regarding thoughts, feelings, and behavior. Items on each subscale present extreme incremental theory beliefs (e.g., "When I try, I can control how I feel," "When I feel bad, I can make myself feel better"). Responses are measured using a four-point scale ranging from 1 ("Very False") to 4 ("Very True"). The higher participants' summed scores on the full ITEB-Q, the less they believe thoughts, emotions, and behavior are fixed entities.

The Children's Alexithymia Scale is based on the original Toronto Alexithymia Scale 20 that assesses alexithymia in adults.The Alexithymia Questionnaire for Children consists of 20 items that represent the three factors: Difficulty identifying feelings, Difficulty describing feelings and Externally oriented thinking. The item response format is: strongly disagree to strongly agree.

The EBPAS consists of 15 items measured on a 5-point scale ranging from 0 (Not at all) to 4 (To a very great extent). The EBPAS is comprised of four subscales (Appeal, Requirements, Openness, and Divergence) and a total scale score, which represents respondents' global attitude toward adoption of EBPs. Cronbach's alpha reliability for the EBPAS is good (alpha = 0.77), with subscale alphas ranging from 0.59 to 0.90.

School functioning in the classroom will be assessed via the Academic Competence Evaluation Scales (ACES) is a 60-item, teacher-reported scale which assesses youth Academic Skills (including Reading/Language Arts, Mathematics, and Critical Thinking) and Academic Enablers (including Interpersonal Skills, Engagement, Motivation, and Study Skills). The ACES has demonstrated internal consistency and test-retest reliability.

The School Engagement Measure-MacArthur Network is a youth-self report measure of three components of youth engagement that have been supported in factor analysis; these are: Behavioral, Emotional and Cognitive. The Cognitive subscale has not fared so well psychometrically, so only the two psychometrically stronger subscales: Behavioral and Emotional Engagement, will be administered to youth. Youth complete this measure at baseline, post-treatment, and 6 month follow-up.