Helping Educational Leadership Mobilize Evidence

The School Implementation Leadership Scale (SILS) is an 25-item scale that assesses the degree to which a school's leader is perceived to engage in eight specific behaviors that are supportive of EBP implementation which both principals and educators complete. The eight subscales include: 1) supportive; 2) perseverant; 3) communication; 4) proactive; 5) availability; 6) knowledgeable; 7) vision/mission; and 8) distributed leadership.

The School Implementation Climate Scale (SICS) is an 21-item scale for principals' and educators' shared perceptions of the policies, practices, and procedures that are expected, rewarded, and supported. The six subscales include: 1) focus on EBPs; 2) educational support for EBPs; 3) recognition for EBPs; 4) use of data to support EBPs; 5) existing supports to deliver EBPs; and 6) integration of EBPs.

The School Implementation Citizenship Behavior Scale (SICBS) is a 12-item rating scale that measures principals' and educators' perceptions regarding how educators engage with EBPs within their specific school context. The four subscales include: 1) helping others; 2) keeping informed; 3) taking Initiative; and 4) advocacy.

A modified version of the 8-item Commitment to Organizational Change Scale (COCS) will measure principals' and educators' perceptions of implementation initiative stability. Subscales include: Affective Commitment and Normative Commitment.

Assitant principals will be trained to conduct PGD fidelity observations and complete three PGD observations biweekly (October - December) and monthly (January - May) over the course of the school year. Minimum Score 0, Maximum Score 6. Higher Scores mean better outcome.

A self-report fidelity rating scale will be used to capture adherence to delivering core PGD practices as planned. Educators will complete the rating scale at the mid-year and end-of-year assessments. Minimum Score 0, Maximum Score 4. Higher Scores mean better outcome.

Reach will be computed using the fidelity data to determine the proportion of students who are receiving PGD practices. The number of general education teachers who are implementing PGD divided by the total number of teachers who have received PGD training.

A qualitative interview for HELM participants will explore: (1) potential changes to HELM (e.g., "What parts of HELM could be improved to increase its appropriateness to schools?"); (2) opportunity costs of participating (e.g., "Were there any activities you wanted to do but could not because of participation in HELM?"); and (3) unintended consequences.

Costs of (1) delivering the HELM intervention to augment PGD implementation, as well as (2) implementation as usual, will be calculated using standard average weighted cost metrics. Inputs will include time, supplies, travel, overhead, and costs associated with HELM training/coaching meetings, including pre-work, scheduling, and attending meetings.

Schools will complete a survey on student educational outcomes for the year, including questions related to grades (GPA) and standardized test scores. There is no reporting on a scale.

Modified Direct Behavior Rating Scale - A modified version of the Direct Behavior Rating Scale will be given to educators to assess their classroom's on-task behavior, prosocial behavior, ability to follow directions the first time, and disruptive behavior. These questions all are part of the same scale that ask the proportion of time their students spent doing each in the first five minute of class (0-100%) and proportion of time their students spent doing each the whole day (0-100%).