Evaluation Study of Talk Parenting Skills

The Positive Encouragement and Coercive Parenting subscales of the Parenting and Family Adjustment Scales (PAFAS) are used to measure parents' positive encouragement and coercive parenting. The Positive Encouragement subscale is measured with three items, answered on a 4-point scale (0=Not at all; 3=Very much); summed scores range from 0 to 9, with higher scores indicating worse outcomes. The Coercive Parenting subscale is measured with five items, answered on the same 4-point scale; summed scores range from 0 to 15, with higher scores indicating worse outcomes. Each subscale shows good internal consistency and construct validity.

The Positive Encouragement and Coercive Parenting subscales of the Parenting and Family Adjustment Scales (PAFAS) are used to measure parents' positive encouragement and coercive parenting. The Positive Encouragement subscale is measured with three items, answered on a 4-point scale (0=Not at all; 3=Very much); summed scores range from 0 to 9, with higher scores indicating worse outcomes. The Coercive Parenting subscale is measured with five items, answered on the same 4-point scale; summed scores range from 0 to 15, with higher scores indicating worse outcomes. Each subscale shows good internal consistency and construct validity.

The Child Adjustment and Parent Efficacy Scale (CAPES) measures children's behaviors and emotional adjustment. The Behavior Problems subscale consists of 16 problematic and 8 reverse-coded positive behaviors. Respondents answer on a 4-point scale (0=Not at all; 3=Very much); the summed scores range from 0 to 72, with higher scores indicating worse outcomes. The Emotional Maladjustment subscale has 3 items. Respondents answer on the same 4-point scale; the summed scores range from 0 to 9, with higher scores indicating worse outcomes. The CAPES is also used to measure parents' self-efficacy; parents rate their confidence that they can successfully deal with each of the 19 negative behaviors/emotions on the CAPES. Respondents answer on a 10-point scale (1=Certain I can't do it; 10=Certain I can do it); the summed scores range from 19-190, with higher scores indicating better outcomes.

The Child Adjustment and Parent Efficacy Scale (CAPES) measures children's behaviors and emotional adjustment. The Behavior Problems subscale consists of 16 problematic and 8 reverse-coded positive behaviors. Respondents answer on a 4-point scale (0=Not at all; 3=Very much); the summed scores range from 0 to 72, with higher scores indicating worse outcomes. The Emotional Maladjustment subscale has 3 items. Respondents answer on the same 4-point scale; the summed scores range from 0 to 9, with higher scores indicating worse outcomes. The CAPES is also used to measure parents' self-efficacy; parents rate their confidence that they can successfully deal with each of the 19 negative behaviors/emotions on the CAPES. Respondents answer on a 10-point scale (1=Certain I can't do it; 10=Certain I can do it); the summed scores range from 19-190, with higher scores indicating better outcomes.

Children's bedtime/sleep problems is measured with the Short-Form Children's Sleep Habits Questionnaire (SF-CSHQ), a 23-item version of the widely used Children's Sleep Habits Questionnaire (CSHQ). Respondents answer on a 5-point scale (1=never; 5=always); average scores range from 1 to 5, with higher scores indicating worse outcomes. The SF-CSHQ shows good validity against the original CSHQ, external validity, internal reliability, and sensitivity to change.

Frequency of parents' engagement in the parenting practices targeted by the intervention, and parents' self-efficacy for doing so, are measured by the Program-Targeted Parenting Practices measure. Created by the Investigators, 14 items ask parents to report the frequency with which they have engaged in target parenting practices related to bedtime in the past 4 weeks, on a 6-point scale (0=Never in past month; 5=Every day in past month); average scores range from 0 to 5, higher scores indicating better outcomes. Then parents are asked to rate how confident they are in doing 12 of these target parenting practices, on a 10-point scale (1=Not at all confident; 10=Highly confident); average scores range from 1 to 10, higher scores indicating better outcomes. Finally, 3 items ask parents for their satisfaction with how child's bedtime is going, on a 10-point scale (0=Not at all satisfied; 10=Very satisfied); average scores range from 1 to 10, higher scores indicating better outcomes.

Frequency of parents' engagement in the parenting practices targeted by the intervention, and parents' self-efficacy for doing so, are measured by the Program-Targeted Parenting Practices measure. Created by the Investigators, 14 items ask parents to report the frequency with which they have engaged in target parenting practices related to bedtime in the past 4 weeks, on a 6-point scale (0=Never in past month; 5=Every day in past month); average scores range from 0 to 5, higher scores indicating better outcomes. Then parents are asked to rate how confident they are in doing 12 of these target parenting practices, on a 10-point scale (1=Not at all confident; 10=Highly confident); average scores range from 1 to 10, higher scores indicating better outcomes. Finally, 3 items ask parents for their satisfaction with how child's bedtime is going, on a 10-point scale (0=Not at all satisfied; 10=Very satisfied); average scores range from 1 to 10, higher scores indicating better outcomes.

Frequency of parents' engagement in the parenting practices targeted by the intervention, and parents' self-efficacy for doing so, are measured by the Program-Targeted Parenting Practices measure. Created by the Investigators, 14 items ask parents to report the frequency with which they have engaged in target parenting practices related to bedtime in the past 4 weeks, on a 6-point scale (0=Never in past month; 5=Every day in past month); average scores range from 0 to 5, higher scores indicating better outcomes. Then parents are asked to rate how confident they are in doing 12 of these target parenting practices, on a 10-point scale (1=Not at all confident; 10=Highly confident); average scores range from 1 to 10, higher scores indicating better outcomes. Finally, 3 items ask parents for their satisfaction with how child's bedtime is going, on a 10-point scale (0=Not at all satisfied; 10=Very satisfied); average scores range from 1 to 10, higher scores indicating better outcomes.

The Child-Parent Relationship Scale - Short Form (CPRS-SF) is used to measure the degree of closeness and conflict in the parent-child relationship. The CPRS-SF is comprised of 15 parent-report items that ask the parent for their assessment of the child-parent relationship, the child's emotional stance toward the parent, and the parent's feelings toward the child. Two subscales are derived: Conflicts and Positive Aspects/Closeness. The Conflicts subscale is measured by 7 items on a 5-point scale (1=Definitely does not apply; 5=Definitely applies); average scores range from 1 to 5, with higher scores indicating worse outcomes. The Closeness subscale is measured with 7 items on the same 5-point scale; average scores range from 1 to 5, with higher scores indicating better outcomes. The CPRS-SF has been validated with parents of preschoolers and first graders and shows good internal consistency.

The Child-Parent Relationship Scale - Short Form (CPRS-SF) is used to measure the degree of closeness and conflict in the parent-child relationship. The CPRS-SF is comprised of 15 parent-report items that ask the parent for their assessment of the child-parent relationship, the child's emotional stance toward the parent, and the parent's feelings toward the child. Two subscales are derived: Conflicts and Positive Aspects/Closeness. The Conflicts subscale is measured by 7 items on a 5-point scale (1=Definitely does not apply; 5=Definitely applies); average scores range from 1 to 5, with higher scores indicating worse outcomes. The Closeness subscale is measured with 7 items on the same 5-point scale; average scores range from 1 to 5, with higher scores indicating better outcomes. The CPRS-SF has been validated with parents of preschoolers and first graders and shows good internal consistency.

Skill usability is measured with the System Usability Scale (SUS), a commonly used 10-item scale that measures subjective perceptions of usability. Items are answered on a 5-point scale (1=Strongly disagree; 5=Strongly agree). The value of one is subtracted from odd numbered items (1, 3, 5, 7, and 9) and the even number items (2, 4, 6, 8, and 10) are subtracted from the value of five. Scores are then summed and multiplied by 2.5 resulting in scores on a scale that ranges from 1 to 100, with higher scores indicating better usability.

Program acceptability was measured with 7 items at T2, 4 weeks after baseline, asking the extent to which primary parents found the Talk Parenting skill useful, enjoyable, whether it addressed important topics, helped make bedtime more positive, enjoyment of use by child, how much use of bedtime strategies, and how much bedtime strategies helped the child and family. Respondents answer items on a 7-point scale (1=Not at all; 7=Very much); average scores range from 1 to 7, with higher scores indicating better satisfaction.

The Self-Efficacy for Parenting Tasks Index - Toddler Scale - Short Form (SEPTI-TS-SF) is used to measure parents' self-efficacy for a discipline- and routines-related parenting tasks. The Discipline and Routines subscales are measured with 6 items each. Respondents answer on a 6-point scale (1=Agree strongly; 6=Disagree strongly); average scores range from 1 to 6, with higher scores indicating better outcomes. These SEPTI-TS-SF subscales show good internal consistency, construct validity, and discriminant validity, and sensitivity to change.

The Self-Efficacy for Parenting Tasks Index - Toddler Scale - Short Form (SEPTI-TS-SF) is used to measure parents' self-efficacy for a discipline- and routines-related parenting tasks. The Discipline and Routines subscales are measured with 6 items each. Respondents answer on a 6-point scale (1=Agree strongly; 6=Disagree strongly); average scores range from 1 to 6, with higher scores indicating better outcomes. These SEPTI-TS-SF subscales show good internal consistency, construct validity, and discriminant validity, and sensitivity to change.

The Parental Stress Scale (PSS) is used to measure parents' stress level. The PSS is comprised of 18 items that ask about positive (emotional benefits, personal development) and negative (demands on resources, restrictions) themes of parenthood. Respondents answer on a 5-point scale (1=Strongly disagree; 5=Strongly agree); summed scores range from 18 to 90, with higher scores indicating worse outcomes. The PSS shows good internal consistency, test-retest reliability, discriminant validity, and construct validity and has been validated across cultures and languages, with families of typically developing children, and with families of children with emotional/ behavioral problems, developmental disabilities, and chronic health conditions.

Families' usage of the TP skill is measured through usage metrics and transcripts collected on the back-end database, including number of families that activated the skill, number of times skill was used, number of steps a family used, length of bedtime routine in minutes, and number of families that listened to a podcast. Higher levels for all metrics indicate greater skill use.

Families' usage of the TP skill is measured through usage metrics and transcripts collected on the back-end database, including number of families that activated the skill, number of times skill was used, number of steps a family used, length of bedtime routine in minutes, and number of families that listened to a podcast. Higher levels for all metrics indicate greater skill use.

Families' usage of the TP skill is measured through usage metrics and transcripts collected on the back-end database, including number of families that activated the skill, number of times skill was used, number of steps a family used, length of bedtime routine in minutes, and number of families that listened to a podcast. Higher levels for all metrics indicate greater skill use.

Families' usage of the TP skill is measured through usage metrics and transcripts collected on the back-end database, including number of families that activated the skill, number of times skill was used, number of steps a family used, length of bedtime routine in minutes, and number of families that listened to a podcast. Higher levels for all metrics indicate greater skill use.

Families' usage of the TP skill is measured through usage metrics and transcripts collected on the back-end database, including number of families that activated the skill, number of times skill was used, number of steps a family used, length of bedtime routine in minutes, and number of families that listened to a podcast. Higher levels for all metrics indicate greater skill use.