Impact Trial of Helping Educational Leaders Mobilize Evidence

The Tiered Fidelity Inventory (TFI) is a 45-item tool used to provide a valid, reliable, and efficient measure of the extent to which school personnel are applying the core features of PBIS. The TFI is a group-assessment completed by a schoolwide system planning team with external facilitation with strong internal consistency. The scoring criteria for each individual item ranges from 0-3 (0=Not Implemented, 1=Partially Implemented, 3=Fully Implemented); higher scores indicate better outcome.

The SILS has 24 items loading onto 8 subscales: Proactive, Knowledgeable, Supportive, Perseverant, Communication, Vision, Available, and Distributed Leadership. The scoring criteria for each individual item ranges from 0-4; higher scores indicate better outcome.

The SICS includes 21 items loading onto 7 subscales: Focus on EBP, Educational Support for EBP, Recognition for EBP, Rewards for EBP, Use of Data to Support EBP, Existing Supports for EBP, and EBP Integration. The scoring criteria for each individual item ranges from 0-4; higher scores indicate better outcome.

This survey asks educators how much time they spent on study-related procedures each week. Inputs will include time, supplies, travel, overhead, and costs associated with HELM training/coaching meetings, including pre-work, scheduling, and attending meetings; as well as costs associated with PBIS training and delivery.

The DBR will be used in which teachers observe and rate their classroom's overall academic engagement (i.e., actively or passively participating in the classroom activity, 0-100%), disruptive behavior (i.e., interrupting activities, 0-100%), and prosocial behavior (i.e., following directions, 0-100%; Chafouleas et al., 2012).

Standardized academic test scores will be derived from administrative records.

Number of office discipline referrals, suspensions, and expulsions will be derived from administrative records.

Student attendance rates will be derived from administrative records.

As a manipulation check to document HELM intervention delivery, we will assess HELM fidelity using the HELM fidelity checklist (based on observations of recorded HELM trainings). HELM coaches will complete a standardized measure of dates specific steps were completed. Schools that achieve 80% or higher of the maximum possible score on all HELM fidelity criteria will be considered having received a full dose of HELM training and coaching.