A: The Programme

advertisement
Programme: Across Ages
A: The Programme
Programme Type:
Across Ages is a preventative program designed to reduce or delay the
use of alcohol, tobacco and other drugs, by enhancing the protective
factors for high risk students.
Brief Description:
Across Ages employs senior adults to act as mentors for “at risk” youth,
both at school and within the community. Activities within the
programme are focused on five domains: the individual, the family, the
school, the community and peer groups. Building relationships between
the mentors, who act as role models, friends, advocates, challengers and
nurturers, and the “at risk” children, can boost awareness, self-confidence
and skills, all of which help young people to resist drugs and overcome
other obstacles.
Scope:
National (US), since 1991, 30-40 students per year have participated in
the programme in 54 sites across the US.
Target Population:
Elementary and middle school students (ages 9-13).
Longer Description:
The Across Ages programme is a 12 month intervention and is designed
with a focus on several aims; to improve academic achievement, attitudes
to school and behaviour; to strengthen relationships with adults and
peers; and enhance problem solving and decision making skills of
students enrolled on the programme. Across Ages incorporates these
aims within four types of activity; mentoring, curriculum, family
participation and community service.
Mentors (who are provided with a small monthly wage) are paired with
one or two programme participants with whom they engage in a variety
of activities, including helping with schoolwork and community service
activities. Mentors spend a minimum of 4 hours per week out-of-school
with their allocated young people, and meet at least twice a week during
the school year.
Participants are required to take part in a Positive Youth Development
Curriculum which is a 26 session course based on a Social Problem-
1
Solving model that increases knowledge and skills concerning stress
management, self-esteem, problem solving, substance use, health
information and social networks.
Across Ages also encourages the participation of families in a variety of
specifically designed activities aimed at providing opportunities for
interaction between youth, mentors and parents. Examples include meals
and entertainment, with added incentives such as free transportation.
Finally, community service activities are scheduled twice a week and
comprise of one hour visits to nursing homes. Children, accompanied by
their mentor, are encouraged to talk, and get involved in activities, with
residents of the homes. The young people are also required to keep a
journal of their visits which they reflect upon in group sessions.
Risks targeted by the programme:
- Few positive adult role models.
- Poor academic performance.
- Too much unsupervised time with limited opportunities for engaging in
positive activities outside of school.
- Possible association with drug using activity in their neighbourhood.
- Poor impulse control and limited decision-making skills, which lead to
disruptive behaviour in the classroom and suspension from school.
Outputs and outcomes sought by the programme:
- Significant improvement in knowledge about and reaction to drug
abuse.
- Significant decrease in substance use.
- Significant improvement in school-related behaviour as measured by
increased school attendance, decreased suspensions from school and
improved grades.
- Significant improvements in attitudes toward school and the future.
- Significant improvement in attitudes toward adults in general and older
adults in particular.
- Improvement in self esteem and well-being.
- Increased family participation in school related activities.
- More positive parental communication with children.
- Engaged in more positive family activities.
- Family gained more access to community resources and expanded
support networks.
Specified LM or Theory of Change:
2
Hypothesised LM or ToC:
This programme targets many risk factors. The provision of a senior
adult mentor, creates a positive adult role model for the at risk child and
fosters increased self-confidence and awareness in order for them to be
able to overcome obstacles.
The programme provides opportunities for supervised activities outside of
school that are pro-social and have positive benefits for the child. This
fosters a sense personal responsibility for self and community and should
therefore reduce the likelihood of the programme participants engaging in
anti-social behaviour.
The curriculum activities better equip the child with the knowledge and
decision-making skills needed to avoid activities such as substance
misuse.
Links to Other Programmes:
Quality of Programme: Very Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
3
(B) The Evaluation
Brief Description:
An RCT evaluation of 562 students (from three middle schools in
Philadelphia) over a three year period (1991-1994) revealed a positive
impact on selected measures, e.g. resistance to drugs and alcohol, and
attitudes towards school, the future and older people, as a result of
participation on the Across Ages programme.
Evaluation Type:
The evaluation team randomly allocated sixth grade students from the
selected schools into three groups; (1) the control group who received no
intervention (n=189); (2) the curriculum-only group who participated in
the programme but who did not receive mentoring (n=193); (3) the
mentoring group who participated fully in all aspects of the programme
(n=180). There were no significant differences in the demographic
characteristics of students in each of the conditions. Data was collected
from each of the groups at pre-test and post-test on a range of measures
that reveal information about the children’s attitudes and skills. The data
was analysed using ANOVA.
Comparison Group Received:
Control group – no intervention
Curriculum only group – the across ages program minus the mentoring
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Positive attitudes towards school and the future,
Positive reactions to situations involving drug use,
Positive reactions to stress and anxiety,
Problem solving skills
Knowledge about substance abuse.
Positive attitudes towards elders
Sense of well-being
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
When compared to the comparison groups:
4
The mentoring group spent significantly fewer days absent from school
(15.4 days; 19.9 days for curriculum only group; 21.8 days for the
control group, p=.01).
The mentoring group reported significantly better (p=.42) reactions to
situations involving drug use. “Better” in terms of children having more
resistance skills and more options for refusal.
The mentoring group had significantly better attitudes towards school,
future and elders (p=.002 when compared to curriculum-only group;
p=.038 when compared to the control group).
The mentoring group had significantly better attitudes towards older
people than the control group (p=0.005) and the curriculum-only group
(p=0.12).
The mentoring group had significantly higher scores on a measure of wellbeing compared to control group (p=.058).
The mentoring group also had significantly more positive attitudes
towards community service than the control group (p=.025).
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication:
Citation: High
5
C. Contact and Review Information
Internet:
http://modelprograms.samsha.gov
www.temple.edu/cil/acrossageshome.htm
Five principle references:
Aseltine R., Dupre, M., & Lamlein, P. (2000). Mentoring as a drug
prevention strategy: An evaluation of Across Ages. Adolescent
and Family Health, 1, 11–20.
LoSciuto, L., Rajala, A. K., Townsend, T. N., & Taylor, A. S. (1996). An
outcome evaluation of Across Ages: An intergenerational
mentoring approach to drug prevention. Journal of Adolescent
Research, 11(1), 116–129.
Taylor, A., LoSciuto, L., Fox, M., & Hilbert, S. (1999). The mentoring
factor: An evaluation of Across Ages. Intergenerational program
research: Understanding what we have created. Binghamton,
NY: Haworth.
Taylor, A., & Bressler, J. (2000). Mentoring across generations:
Partnerships for positive youth development. New York:
Kluwer/Plenum.
Weissberg, R. P., Caplan, M., & Silvo, P. J. (1987). A new conceptual
framework for establishing school-based social competence
promotion programs. In L. A. Bond & B. E. Compas (Eds.),
Primary prevention and promotion in schools (pp. 52–64).
Newbury Park, CA: Sage.
Contact Details Progamme:
Andrea S. Taylor, Ph.D.
Temple University
Center for Intergenerational Learning
1601 North Broad Street
USB 206
Philadelphia
PA 19122
Tel: 215 204 6708
Fax: 215 204 3195
E-mail:ataylor@temple.edu
www.temple.edu/cil/acrossageshome.htm
6
Contact Details: Evaluation:
Leonard LoSciuto, Ph.D.
Institute for Survey Research
Temple University
1601 North Broad Street, 5th Floor
Philadelphia
PA 19122
Tel: 215 204 8355
Fax: 215 204 3797
E-mail Leonard.losciuto@temple.edu
First review:
Second review:
7
Programme: All Stars
A: The Programme
Programme Type:
Theory based character education and problem behaviour prevention
programme for adolescents.
Brief Description:
All Stars is a character-based approach to preventing high-risk behaviour,
such as drug abuse, violence and premature sexual activity in
adolescents. The programme is deliverable in both community and school
settings and focuses on enhancing protective factors (or mediator
behaviours) known to reduce the risk of drug use in adulthood:
developing positive ideals, belief in conventional norms, strong personal
commitments, bonding with school and family and encouraging positive
parental attentiveness.
Scope:
Children from a wide variety of ethnic and socioeconomic backgrounds
have participated in the programme across both rural and urban sites in
13 locations across the United States of America.
Target Population:
Typically sixth and seventh graders (All Stars Core programme), but one
version of the programme is designed with preparatory focus for fourth
and fifth graders (All Stars Jr.) and another as a follow up for high school
seniors (All Stars Sr.).
Longer Description:
Based on over 25 years of scientific research, the All Stars programme
aims to delay or prevent high-risk problem behaviours (i.e. premature
sexual activity, violence and substance use) in adolescents, by fostering
the development of positive personal characteristics. Previous research
has identified the critical factors that mediate the development of the
specified problem behaviours, these factors are targeted by the All Stars
programme through the nurturing of positive personal qualities in
adolescent youth which ultimately serve as protective factors.
The
protective factors nurtured through participation in the programme
include idealism and orientation to the future; belief in conventional
norms; commitment to avoid high-risk behaviours; communication with
parents; parental monitoring and supervision; establishment of clear rules
and standards; expressions of love and affection; discipline at times when
it is appropriate; motivation to provide a good example; visibility of peer
8
opinion leaders; establishment of conventional norms about behaviour;
bonding to school; student-teacher communication; parental support for
school prevention activities; commitment to be a productive citizen; and
participation in community-focused service projects.
The programme is available in a range of formats ensuring its ability to
meet the needs of different settings and methods, this includes the All
Stars Core programme (designed for 11-15 year olds and available in
specialist, teacher and community formats); the All Stars Junior
programme (designed for 4th and 5th graders and teaches building-block
concepts); and All Stars Senior (designed for high school students and
incorporates the use of health text books with activities that change
attitudes and behaviour). All Stars is an interactive programme involving
games, debates, videotaping, one-to-one sessions with programme
facilitators and participants, and group discussions. Homework is also
assigned to encourage interaction between children and their parents and
in order to allow the latter to have an active role in the programme.
Parents also attend a meeting and are given resources providing guidance
on positive parenting. Typically a programme participant will attend 21
core sessions and around 8 booster sessions.
A novel innovation in the programme is the ‘All Stars Commitment Ring’,
a silver signet ring with a circle of nine stars on a black background which
is awarded to adolescents who make a series of commitments about each
of the following: future ideals; citizenship; responding to violence
provoking situations; drunkenness; drinking alcohol; use of tobacco;
using inhalants; using illicit drugs and finally about sex.
Risks targeted by the programme:
- Perceived pressure to participate in substance use.
- Parental tolerance of deviance.
- Offers and pressure from peers to use substances.
- Identification and exclusion of negative peer role models.
Outputs and outcomes sought by the programme:
- Delay in the onset of sexual activity.
- Reduction in violence.
- Reduction in substance use.
- Development of positive ideals that do not fit with high-risk
behaviour.
- Creating a belief in conventional norms.
- Building strong personal commitments.
- Bonding with school, pro-social institutions and family.
- Increasing positive parental attentiveness.
9
Specified LM or Theory of Change:
See the logic model published in PDF format on the All Stars website:
http://www.tanglewood.net/products/allstars/allstars1.htm
Hypothesised LM or ToC:
Links to Other Programmes:
Previously evaluated in comparison with D.A.R.E.
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
10
(B) The Evaluation
Brief Description:
Randomised field trial examining the mediator variables targeted, and in
some cases not targeted, by the programme. The evaluation revealed
that the All Star programme was effective in reducing substance use and
postponing sexual activity only in instances when the programmes were
teacher-led, and teachers were successful at altering normative beliefs,
lifestyle incongruence and manifest commitment in the student
participants.
Evaluation Type:
Randomised field trial, employing three conditions; control, specialist
(programme delivered by specialist such as a social worker) and teacher
(programme delivered by school teacher). The sample of 1857 students
attended, collectively, 14 middle schools in Kentucky. The schools were
randomly assigned to the control and specialist conditions, following
stratification based on school size, the distribution of gender and ethnicity
and other demographics.
The teacher condition was added upon
completion of this assignment procedure. Pre- and Post-tests were
conducted in order to obtain information and scores on student
demographics, use of substances (cigarettes, smokeless tobacco, alcohol,
marijuana and inhalants) and involvement in heterosexual intimate
behaviour. The mediating variables proposed as catalysts to behaviour
and attitudes change were also measured. These include normative
beliefs about risky behaviours, manifest commitment to avoid risky
behaviours and bonding to school. In addition non-programme targeted
mediating variables were also examined in the evaluation, including selfesteem, impulsive decision-making and sensation seeking.
Comparison Group Received:
Control: no intervention from the All Stars program, but did attend
standard health education courses as part of the school curriculum.
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Substance use
Normative beliefs
Lifestyle incongruence
Commitment
Sexual activity
Impulsive decision-making
Sensation seeking
11
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
The largest programme effects were observed for students enrolled on the
teacher delivered programmes who had significantly reduced levels of
alcohol, cigarette, smokeless tobacco and inhalant use. However, there
were no significant effects for marijuana use or sexual activity although
they were slightly reduced at post-test. The only significant effect of the
specialist led intervention was observed in the reduction of cigarette use.
In order to examine the relationship between so-called mediating
variables and behavioural outcomes, correlations were conducted.
Normative beliefs, lifestyle incongruence and commitment (mediator
variables) were strongly
and similarly correlated with behavioural
outcomes. Less strongly correlated were the variables of bonding to
school, self-esteem, impulsive decision-making and sensation seeking,
these variables have only a moderate relationship with behaviours of
interest.
The strongest behavioural correlation with mediator variables was
observed for cigarette smoking (r=.584), sexual activity (r=.571), alcohol
consumption (r=.536) and marijuana use (r=.509). The use of inhalants
(r=.264) and smokeless tobacco (r=.275) were less strongly correlated
with the mediators.
Specialists failed to change targeted mediators and therefore had very
little effect on behaviour.
Only the teacher-led programmes had a
significant effect on targeted mediators (normative beliefs, lifestyle
incongruence and commitment), in addition to impacting on other
mediators not specified within the programme such as impulsive decisionmaking and sensation seeking.
According to multiple regression analyses, the strongest predictor of posttest marijuana use, smoking cigarettes and drinking alcohol is manifest
commitment. Ability to change normative beliefs also mediated outcomes
for alcohol, marijuana, cigarettes and sexual activity, as did changing
lifestyle incongruence, although only with moderate strength. Impulsive
decision making, although not targeted specifically by the programme,
mediated changes in sexual activity but not for substance use. Lifestyle
incongruence is the strongest mediator of smokeless tobacco use.
12
Other Evaluation Notes:
The evaluation makes no mention of violent behaviour; a behaviour
problem specifically targeted by the programme, and also does not
examine effects on parents and other outcomes desired by programme
developers.
Although available on the Internet, this evaluation study is not yet
published and is under review.
Previous evaluative work on All Stars has found mixed results for the
effectiveness of the programmes. A recent independent evaluation found
short-term and immediate programme effects for teacher based All Stars.
However, long-term effects were not present and the community and
specialist interventions appeared to be ineffective in achieving the
outcomes specified by the programme and evaluators (Harrington, 2001).
Quality of Evaluation: OK
Sample: Good
Measures: OK
Control Group: Good
Other Innovation:
Replication:
Citation: Low
13
C. Contact and Review Information
Internet:
All Stars programme website http://www.tanglewood.net/products/allstars/allstars.htm
SAMHSA Model program –
www.samhsa.gov
Five principle references:
Donaldson S.I., Graham J.W., & Hansen WB. (1994). Testing the
generalizability of intervening mechanism theories:
Understanding the effects of adolescent drug use prevention
interventions. Journal of Behavioral Medicine, 17, (2), pp.195216.
Fearnow-Kenney M, Hansen WB, McNeal RB. (2002). Comparison of
psychosocial influences on substance use in adolescents:
Implications for prevention programming. Journal of Child and
Adolescent Substance Abuse, 11, (4), pp.1-24.
Harrington, N.G. et al. (2001). Evaluation of the All Stars Character
Education and Problem Behaviour Prevention Program: Effects
on Mediator and Outcome Variables for Middle School Students.
Health and Education Behaviour, 28, (5), pp.533-546.
Hansen, W.B. (1996). Pilot Test Results Comparing the All Stars
Program with Seventh Grade D.A.R.E.: Program Integrity and
Mediating Variable Analysis. Substance Use & Misuse, 31, (10),
pp.1359-1377.
McNeal, R.B et al. (under review). How All Stars Works: An
Examination of Program Effects on Mediating Variables [WWW]
http://www.tanglewood.net/products/allstars/All_Stars_Literature.h
tm (21/12/2004).
Contact Details Progamme:
William B Hansen, Ph.D.
President
Tangelwood Research Inc.
7017 Albert Pick Road, Suite D
Greensboro, NC 27409
Tel: (800) 826-4539, ext. 101
Fax: (336) 662-0099
Email: billhansen@tangelwood.net
14
Contact Details: Evaluation:
Ralph B McNeal, Jr., Ph.D.
Department of Sociology
344 Mansfield Road U-2068
University of Connecticut
Storrs , CT 06269
Telephone: 860-486-4083
Fax: 860-486-6356
E-mail: ralph.mcneal@uconn.edu
First review: Sarah Blower
Second review:
15
Programme: Al’s Pals: Kids making Healthy Choices
A: The Programme
Programme Type: Resiliency based early intervention programme
Brief Description: Childhood curriculum and teacher training program that develops
personal, social and emotional skills in children.
Scope: Developed in 1993. The programme was piloted for 5 years in a variety of settings
across several States in the U.S and revised using teacher feedback.
Target Population: children at risk due to poverty and other factors between ages of 3 – 8.
Longer Description: Al’s Pals: Kids Making Healthy Choices is a resiliency-based early
childhood curriculum and teacher training program that develops personal, social, and
emotional skills in children 3 to 8 years old. Using 46 interactive lessons, Al’s Pals teaches
children how to—











Express feelings appropriately
Use kind words
Care about others
Use self-control
Think independently
Accept differences
Make friends
Solve problems peacefully
Cope
Make safe and healthy choices
Understand that tobacco, alcohol, and illegal drugs are not for children
The lessons use guided creative play, brainstorming, puppetry, original music, and movement
to develop children’s social-emotional competence and life skills. A nine-lesson booster
curriculum is used in second or third grade with children who have previously received the
full program.
16
Risks targeted by the programme: Al’s Pals was developed in response to concerns for
preschool children considered at risk who displayed increasing levels of aggressive
behaviour, lacked social skills, and mimicked drug use and sexual activity behaviours in their
play, increasing the future risk for new and escalating problem behaviours.
Outputs and outcomes sought by the programme:
 Helps children manage their own behavior thus freeing teachers to do more teaching
 Strengthen children’s social and life skills.
Specified LM or Theory of Change: Children who participate are more likely to use
classroom coping skills, which leads to improved cognition, which makes learning more
enjoyable which in turns reduces the likelihood of anti social behavior developing
Hypothesized LM or ToC:
Links to Other Programmes:
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Very good (built into implementation)
17
(B) The Evaluation
: Since 1994, more than 20 studies of Al’s Pals have been conducted in preschools,
elementary schools, and child care centres. These studies used teacher ratings to measure the
program’s effectiveness at developing prosocial behaviours and preventing
antisocial/aggressive behaviours among participating children. Also pre and postest
evaluations have been used involving 446 children. Also replication studies involving
thousands of children have been conducted in preschool and early elementary settings in
Iowa, Michigan, Missouri, and Virginia using comparison and one group pre- and post-test
designs. Also an experimental design was used to evaluate Al’s Pals in a large Head Start
program in a study involving 399 children. Seventeen classrooms were randomly assigned to
receive the intervention and 16 classrooms served as controls.
Evaluation Type: As stated above different approaches have been used from teacher
feedback to experimental random allocation trials.
Comparison Group Received: N/K
Outputs Specified by Evaluation: none specified.
Outcomes Specified by Evaluation: Primarily to test improved pro-social behaviour and
reduction of aggressive behaviour.
LM or Theory of Change Specified by Evaluation: Prevention of increases in antisocial
and aggressive behaviours that might otherwise occur leading to improved learning and
development.
Results: Outputs: None stated
18
Results: Outcomes:
 Significant reductions in problem behaviours such as social withdrawal.
 Significant increases in positive coping behaviours such as seeking help to solve a
problem.



Significant increases in prosocial behaviours.
Significant decreases in negative coping behaviours such as the use of physical or verbal
aggression to solve problems.
Prevention of increases in antisocial and aggressive behaviours that might otherwise
occur. *
*Based on comparisons to children who did not participate in Al’s Pals
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: Poor
Citation: High
19
C. Contact and Review Information
Internet:
www.modelprograms.samhsa.gov/template_cf.cfm?page=model&pkProgramID=10...
Five principle references: Please contact the Program Developer for references (see below).
E-mail: sgeller@wingspanworks.com
Contact Details Progamme: Susan R. Geller, President
Wingspan, LLC
P.O. Box 29070
Richmond, VA 23242
Phone: (804) 754-0100
Fax: (804) 754-0200
E-mail: sgeller@wingspanworks.com
Web site: wingspanworks.com
Contact Details: Evaluation: as above
First review: Carl Staunton 10th November 2004
Second review:
20
Programme: Big Brothers Big Sisters of America (BBBSA)
A: The Programme
Programme Type: Mentoring Programme
Brief Description: Big Brothers, Big Sisters is a 93 year old programme
which aims to provide successful mentoring relationships to children who
need and want them in order to help them achieve their potential. BBBSA
hope to improve schools and strengthen communities.
Scope: Serves over 200,000 children in 5,000 communities across 50
states
Target Population: ‘At risk’ children aged 6-18
Longer Description: Initially volunteers are screened for safety. Once
they have fulfilled the criteria they are trained to provide one-to-one
mentoring. The child’s needs are assessed and a mentor is matched to an
‘at risk’ child. They are monitored closely in their progress of forming a
relationship with the child. The idea is to provide disadvantaged children
with one caring responsible adult.
Risks targeted by the programme: The programme targets children
living in poverty, experiencing a lack of support, bereavement and
parental separation, as well as physical, emotional and sexual abuse.
Outputs and outcomes sought by the programme:



To build successful mentoring relationships for children who need
and want them
To help ‘at risk’ children build a better future
To build stronger communities for all
Specified LM or Theory of Change:
Providing ‘at risk’ children with an adult mentor will improve their lives
and quality of life for people in the community.
Hypothesised LM or ToC:
Links to Other Programmes:
21
Quality of Programme: High
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
22
(B) The Evaluation
Brief Description: A sample group of 959 10-16 year olds who applied
to the programme in 1992/93 (60% boys, 55% of a minority group, 96%
lived with only one parent or grand parent, 40% receiving food
stamps/and or cash public assistance, 25% had experienced physical,
emotional or sexual abuse) were selected. These children were allocated
following interviews to the treatment and control groups.
Evaluation Type: Randomised Controlled Trial
Comparison Group Received: Nothing
Outputs Specified by Evaluation:



Increase in grade point averages
Reduction in truancy
Improvement in quality of relationship with parents
Outcomes Specified by Evaluation:




Reduction in drug use
Reduction in alcohol use
Reduced likelihood of acting violently
Increased intellectual competency
LM or Theory of Change Specified by Evaluation:
Caring relationships between adults and youth supported by the
programme provide benefits to the children involved and the wider
community.
Results: Outputs:


More confident in class work performance
Able to get along better with family
Results: Outcomes:




46%
27%
52%
37%
less
less
less
less
likely
likely
likely
likely
to
to
to
to
begin using illegal drugs
begin using alcohol
quit school
truant
Other Evaluation Notes:
23
Quality of Evaluation: High
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: High
24
C. Contact and Review Information
Internet:
www.ppv.org
www.aypf.org/compendium/C1S30.pdf
Five principle references:
Tierney, J.P., Grossman, J.B., and Resch, N.L. (1995) Making a
difference: An Impact Study of Big Brothers Big Sisters. Philadelphia:
Public/Private Ventures
Contact Details Progamme:
Thomas M. McKenna
National Executive Director
Big Brothers Big Sisters of America
230 North 13th Street
Philadelphia
PA 19107-1538
Contact Details: Evaluation:
Maxine Sherman, Communications Manager
Public/Private Ventures
One Commerce Square
Philadelphia
Phone: (215) 557-4400
Fax: (215) 557-4469
First review: Emma Sherriff
Second review:
11-Nov-04
25
Programme: Be Proud! Be Responsible
A: The Programme
Programme Type: Prevention Program (sexual health)
Brief Description: Be Proud! Be Responsible!, a collection of three
curricula, was developed to help reduce HIV-risk-associated sexual
behaviour among low-income African American adolescents.
Scope: The program has been implemented and evaluated with inner-city
male African American youths in their early adolescence.
Target Population: The mean age of program participants in evaluated
implementations of the program ranged from 11.8 to 14.6 years. The
program is designed to be used with African male adolescents through
age 18.
Longer Description: The curricula -- Be Proud! (a five-hour safer-sex
intervention, made up of six 50-minute modules), Making Proud Choices!
(An 8-hour, multi-module, safer-sex intervention), and Making a
Difference! (An 8-hour, multi-module, abstinence-based intervention) -were designed to be educational and, at the same time, entertaining and
culturally sensitive. The curricula involves group discussions, videos,
games, brainstorming, experiential exercises, and skill-building activities.
Participants in the program work in groups of six to eight teens and are
led by a trained facilitator.
Risks targeted by the programme: African American male youth who
engage in risky sexual behavior.
Outputs and outcomes sought by the programme: Principally to see
an increase in male African American youths who abstain from sexual
activity.
Specified LM or Theory of Change: None specified
Hypothesised LM or ToC:
26
Links to Other Programmes:
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
27
(B) The Evaluation
Brief Description:
 Experimental design, including treatment and control conditions, in
Philadelphia, Pennsylvania.
 Urban male teens (n=157 at baseline; n=150 at follow up) recruited
from multiple venues; mean age 14.6
 Participants received a monetary incentive for participating ($15)
 Pre-test, Post-test, and three-month follow up survey
Evaluation Type: experimental design
Comparison Group Received: Not known
Outputs Specified by Evaluation: Main output sought is the reduction
of coitial sexual activity
Outcomes Specified by Evaluation: mainly an improved knowledge of
sexual health issues.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs: Reduced frequency of sex:
 Intervention participants were significantly less likely than control
youth to report coitius in the three months following the
intervention and reported coitius on fewer days than did control
youth.
 Intervention participants reported significantly fewer sexual
partners than did control youth in the three months following the
intervention (0.85 versus 1.70)
Results: Outcomes: Knowledge and attitudes respectively:
 Intervention participants had greater knowledge of HIV/AIDS
immediately after the intervention and at three month follow up
than did control youth.
 At post-test and at three month follow up, intervention participants
reported weaker intentions to engage in unsafe sexual behavior in
the next three months than did control youth.
28
Other Evaluation Notes:
Positive results; however, the results are somewhat inconsistent. In the
1992 and 1999 evaluations of Be Proud! (Which did not look separately at
outcomes for individuals who were and were not sexually active at preintervention), the program was shown to increase the levels of knowledge
regarding HIV-associated risk factors and effective prevention measures,
as well as improving attitudes and intentions regarding risky sexual
behaviour. However, this change in knowledge and attitudes did not
translate into a sustained improvement in teens’ behaviours.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: High
29
C. Contact and Review Information
Internet: www.selectmedia.org
Five principle references:
1. Jemmott, John B. III, Loretta Sweet Jemmott, and Geoffrey T. Fong, “Reductions
in HIV Risk-Associated Sexual Behaviours Among Black Male Adolescents: Effects
of an AIDS Prevention Intervention,” American Journal of Public Health, Vol.
82, No. 3, 1992, pp. 372–377.
2. Jemmott, John B. III, Loretta Sweet Jemmott, Geoffrey T. Fong, and Konstance
McCaffree, “Abstinence and Safer Sex: HIV Risk-Reduction Interventions for
African American Adolescents,” Journal of the American Medical Association,
Vol. 279, No. 19, 1998, pp. 1529–1536.
3. Jemmott, John B. III, Loretta Sweet Jemmott, Geoffrey T. Fong, and Konstance
McCaffree, “Reducing HIV Risk-Associated Sexual Behavior Among Africa
American Adolescents: Testing the Generality of Intervention Effects,” American
Journal of Community Psychology, Vol. 27, No. 2, 1999, pp. 161–175.
4. Jemmott, John B. III, Loretta Sweet Jemmott, and Geoffrey T. Fong, “Reductions
in HIV Risk-Associated Sexual Behaviours Among Black Male Adolescents: Effects
of an AIDS Prevention Intervention,” American Journal of Public Health, Vol.
82, No. 3, 1992, pp. 372–377.
5. Jemmott, John B. III, Loretta Sweet Jemmott, Geoffrey T. Fong, and Konstance
McCaffree, “Abstinence and Safer Sex: HIV Risk-Reduction Interventions for
African American Adolescents,” Journal of the American Medical Association,
Vol. 279, No. 19, 1998, pp. 1529–1536.
Contact Details Progamme:
Marketing Department
375 Greenwich St, suite 828
New York, NY 10013
800-707-6334
212-941-3997 (fax)
Contact Details: Evaluation: See contact details above or emailbeth@selectmedia.org
tyree@selectmedia.org
First review: Carl Staunton 14/12/2004
Second review:
30
Programme: School Breakfast clubs
A: The Programme
Programme Type: Early intervention and prevention programme
Brief Description: participating schools provide breakfasts, and in some
cases fruit to children prior to start of lessons.
Scope: 253 breakfast clubs have been allocated funding under the
Department of Health since 1999/2000.
Target Population: children of working or studying parents and children
of parents who report higher levels of stress and children with high levels
of social or behavioral difficulties.
Longer Description: A school breakfast club is a form of before-school
provision serving food to children who arrive early. The emphasis of
different clubs vary considerably, some may integrate study or welfare
support, or play activities whilst others focus on providing breakfast and a
space for informal interaction between children and with school staff,
sometimes with parental involvement. A review of the 16 studies
examining breakfast fasting and cognition concluded that missing
breakfast is associated with poor performance on memory tasks. Indeed
eating breakfast has been associated with improved academic outcomes,
improved concentration, increased school attendance, decreased school
lateness and improved mood at school.
Risks targeted by the programme: Children with high levels of social
or behavioral problems. Children from households of the lower income
brackets
Outputs and outcomes sought by the programme: Improved
cognition, attendance and mood whilst at school
Specified LM or Theory of Change: None specified
Hypothesised LM or ToC:
Links to Other Programmes: National fruit Scheme (NFS)
Quality of Programme:
31
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
32
(B) The Evaluation
Brief Description: A survey of breakfast club provision and the
structures put in place to implement the scheme. A cluster randomised
controlled trial to evaluate the effectiveness of breakfast clubs in terms of
nutritional, social, psychological and educational outcomes. Case studies
to generate detailed information about processes and structures and the
experiences of those involved. A child and family study using
questionnaires and semi-structured interviews to collect information from
parents about socioeconomic circumstances, the impacts of the scheme
on families, and parents’ and children’s satisfaction with and views about
breakfast clubs.
Evaluation Type: mixed methods approach with strong randomized
control element
Comparison Group Received: Not stated
Outputs Specified by Evaluation: None stated
Outcomes Specified by Evaluation: This account of the evaluation
concentrates mainly on descriptions of the schemes and findings from
case studies and interview data. A later report (‘Evaluation SummaryPart 2’) will provide more detailed information on statistical analyses of
outcome data.
LM or Theory of Change Specified by Evaluation:
Results: Outputs: Not stated
33
Results: Outcomes: Full results of outcomes will be published in 2005
however contact with the evaluation team have revealed preliminary
findings which show that show improved concentration (Trail Making Test
Part A) amongst the intervention group at 3 months. Fewer pupils within
the intervention group reported having skipped classes within the last
month and fewer pupils within the intervention group reported having
skipped 1 or more days of school within the last month at 1 year.
Observational analysis at 1 year showed a higher proportion of primaryaged breakfast club attendees reported eating fruit for breakfast in
comparison to non-attendees. A higher proportion of breakfast club
attendees had borderline or abnormal conduct and total difficulties scores
(primary-aged pupils) and prosocial score (secondary-aged pupils).
Other Evaluation Notes: for details of the 2005 publication of
‘Evaluation Part 2’ contact i.shelmit@uea.ac.uk
Quality of Evaluation: (Part 1 of evaluation)
Sample: Good
Measures: Good
Control Group:
Other Innovation:
Replication: None
Citation: Moderate
34
C. Contact and Review Information
Internet: http://www.breakfast-club.co.uk/ or call 020 8709 9900.
Five principle references:
1, Evaluation summary, part 1. University of East Anglia:2002.
2, Health Education Board for Scotland.
3, Evaluation of breakfast club initiatives in greater Glasgow: Stages 1 &
2. Health Education Board for Scotland:2001.
4, Benton, D. and Parker, P. Y. Breakfast, blood glucose, and cognition.
American Journal of Clinical Nutrition 1998;67:(Suppl)772S-778S.
5, Morris, N. and Sarll, P. Drinking glucose improves listening span in
students who miss breakfast. Educational Research 2001;43:(2)201-208.
17. Pollitt, E. and Matthews, R. Breakfast and cognition: an integrative
summary. American Journal of Clinical Nutrition 1998;67:(Suppl)804S813S.
Contact Details Progamme: www.breakfast-club.co.uk
Contact Details: Evaluation: National Evaluation A National Evaluation
of School Breakfast Clubs, School of Medicine, Health Policy and Practice
School of Social Work and Psychosocial Studies School of Education and
Professional Development University of East Anglia, Norwich NR4 7TJ Tel:
+44 (0)1603 593496 Email: wwwcomm@uea.ac.uk, .
Also see other evaluation notes above for contact details.
First review: Carl Staunton 28th November 2004
Second review:
35
Programme: PROBIT Promotion of Breastfeeding Intervention Trialin the
Republic of Belarus
A: The Programme
Programme Type:
Prevention (by encouraging mothers to breast feed their infant, it is
believed that infant health will benefit.)
Brief Description:
The intervention was modeled on the baby friendly Hospital Initiative of
the World health Organization which emphasizes health care worker
assistance with initiating and maintaining breastfeeding and lactation and
post natal breastfeeding support, or a control intervention of continuing
usual infant feeding practices and policies.
Scope: 17046 mother infant pairs began the intervention, with 16491
completing. 31 maternity hospitals and polyclinics in the Republic of
Belarus participated.
Target Population:
The intervention targeted mothers in good health who intended to breastfeed and their infants weighing at least 2500g. This controlled against
infants who may have poor health for other reasons to facilitate the
comparison of the outcome on health for breastfed infants.
Longer Description:
Current evidence that breast feeding is beneficial for infant and child
health is based exclusively on observational studies. This study aimed to
assess the effects of breastfeeding promotion on breastfeeding duration
and exclusivity, and gastrointestinal and respiratory infection and atopic
eczema among infants. The intervention involved greater levels of health
care worker assistance and information for initiating and maintaining
breastfeeding, lactation and postnatal breastfeeding support.
36
Risks targeted by the programme:
The program objective was to assess the effects of breastfeeding
promotion on breastfeeding duration and exclusivity and benefits on
infant health. Consequently it aims to prevent health risks for the infant.
Breast feeding also helps the mother to lose excess weight after
pregnancy although this effect was not evaluated in this investigation.
Outputs and outcomes sought by the programme:
Increase in breastfeeding and length of breastfeeding by mothers.
Improved health of infants in the intervention group.
Specified LM or Theory of Change:
Hypothesised LM or ToC:
An increase in care worker assistance support and information for
breastfeeding mothers will have long term benefits for the health of the
infant.
Links to Other Programmes:
Baby Friendly Hospital Initiative of the World Health Organisation
Quality of Programme:
More health care worker support is provided than advocated by current
policy, but actual details are limited.
LM or TofC:
Target Population Specified: Good sample
Attention to Ethics: Good, the control group received an intervention
Consistency/Fidelity: Need more details on experiment intervention
37
(B) The Evaluation
Brief Description:
Longitudinal evaluation (12 months) of 16491 mothers and infants. Of 31
clinics, 16 received the experimental intervention while 15 received the
control.
Evaluation Type:
Cluster-randomized control trial was used.
Comparison Group Received:
Continued usual infant feeding practices and policies
Outputs Specified by Evaluation:
Increase in breastfeeding and length of breastfeeding by mothers.
Improved health of infants in the intervention group.
Outcomes Specified by Evaluation:
Improved health of intervention infants
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
Infants from the experimental intervention clinics were more likely than
controls to be breast fed to any degree at 12 months. The experimental
intervention increased the duration and degree (exclusivity) of
breastfeeding and decreased the risk of gastrointestinal tract infection
and atopic eczema in the first year of life.
38
Other Evaluation Notes: only limited information on the actual content
of the experimental intervention was available.
Quality of Evaluation:
Sample: good
Measures: good
Control Group: good
Other Innovation:
Replication: None
Citation: Good
39
C. Contact and Review Information
Internet:
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=pubmed&dopt=Abstract
&list_uids=11242425
Five principle references:
Contact Details Progamme:
Contact Details: Evaluation:
Dr Kramer
First review: Helen
Second review:
40
Programme:
A: The Program
Casa Start
Programme Type: Prevention
Brief Description: CASASTART is a substance abuse and delinquency
prevention program serving high-risk preadolescents and their families.
Scope: Developed in 1992. Program runs in six U.S cities including
Austin, Texas; Bridgeport, Connecticut; Memphis, Tennessee; Savannah,
Georgia; Seattle, Washington; Newark, New Jersey.
Target Population: 11 to 13 year olds.
Longer Description: CASASTART’s primary goals are (1) to provide
youths with the services and support they need to become productive,
law-abiding citizens and (2) to create a safer environment for adolescents
and their families through the reduction of crime and illegal drugs in their
neighbourhoods. To attain its goals, CASASTART brings together key
stakeholders in a community, including families, schools, law enforcement
agencies, and social service and health agencies.
Developed by The National Centre on Addiction and Substance Abuse
(CASA) at Columbia University, CASASTART was first implemented from
1992 to 1995 in six cities and was known as the "Children at Risk"
program at that time. CASASTART currently operates in nearly 40 schools
around the country.
Risks targeted by the programmed: youths at risk from substance
misuse who live in deprived neighborhoods.
Outputs and outcomes sought by the programmed:
Increase the percentage of youths not using alcohol, tobacco, or illegal
drugs
Increase the percentage of juveniles who do not engage in violent
behaviour. Making environments safer so that adolescents also feel safer.
Participants should feel more productive.
Specified LM or Theory of Change: None.
Hypothesised LM or ToC: may lead to outcomes of improved selfesteem, educational attainment and improved life chances.
Links to Other Programmes:
41
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
42
(B) The Evaluation
Brief Description: The effectiveness of CASASTART was evaluated in all
demonstration sites except Newark, New Jersey. The program was
evaluated using an experimental design.
Evaluation Type: Experimental.
Comparison Group Received: Nothing.
Outputs Specified by Evaluation: Principally the reduction in substance
misuse.
Outcomes Specified by Evaluation: Self esteem, reduction of
alienation, improvement in personal relationships.
LM or Theory of Change Specified by Evaluation: None started
Results: Outputs: The research by Harrell, Cavanaugh, and Sridharan
(1998, 1999) found that one year after program completion CASASTART
youths when compared with youths in the control group were:
*
Significantly less likely to have used drugs in the past month -- 67
percent of control youths reported any drug usage within the past month,
as compared with only 52 percent of CASASTART youths.
*
5 percent of CASASTART youths as compared with 9 percent of
control youths reported use of "strong drugs," such as psychedelics,
crack, cocaine, heroin, or non-prescription drugs within the past month.
*
51 percent of CASASTART youth as compared with 65 percent of
control youths reported use of other drugs, including marijuana, alcohol,
inhalants, or cigarettes.
*
Significantly less likely to report lifetime sales of drugs and
significantly less likely to report drug sales activity in the past month.
*
14 percent of CASASTART youths as compared with 24 percent of
control youths reported having sold drugs within the past month.
*
37 percent of CASASTART youths as compared with 46 percent of
control youths reported having lifetime drug sales activity.
*
Significantly less likely to have committed a violent crime in the
year following completion of the program.
*
22 percent of CASASTART youth as compared with 27 percent of
control youth committed a violent crime during this period.
43
Results: Outcomes: There were no significant differences between the
treatment and control groups in any of the following outcomes:
*
Self-esteem, feelings of alienation, or antisocial risk-taking
behaviours.
*
The number or severity of personal problems, such as conflict in the
home or at school, neglecting schoolwork, problems with peers and/or
significant others (that is, boyfriend or girlfriend), or feeling sad, lonely,
or anxious.
*
Grade point average, chronic absenteeism, truancy (self-reported),
school misbehaviour, attachment to school, or likelihood of promotion.
*
Youths’ reports of parental supervision, family organization, or
family support.
*
Property crimes or lifetime drug use.
Other Evaluation Notes: This program was given a "proven" rating. It
involved an experimental research design using a large sample size and
yielded a number of sizeable positive outcomes. Moreover, positive
program effects were sustained a year after the program intervention
ended.
While CASASTART youths experienced gains in the areas of reduced
substance use and criminal behaviour, they did not exhibit similar gains in
educational outcomes, such as improved school attendance and grades.
Although CASASTART youths were significantly more likely to be
promoted in school than control youths, the size of this gain was very
small.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: Low
44
C. Contact and Review Information
Internet:
http://www.casacolumbia.org/
Principle references:
1. Harrell, Adele, Shannon Cavanaugh, and Sanjeev Sridharan,
Impact of the Children At Risk Program: Comprehensive Final
Report, Volume I, Washington, D.C.: The Urban Institute, 1997.
2. Harrell, Adele, Shannon Cavanaugh, and Sanjeev Sridharan,
Impact of the Children At Risk Program: Comprehensive Final
Report, Volume II, Washington, D.C.: The Urban Institute,
1998.
3. Harrell, Adele, Shannon Cavanaugh, and Sanjeev Sridharan,
"Evaluation of the Children at Risk Program: Results 1 Year After
the End of the Program," National Institute of Justice Research
Brief, Washington, D.C.: U.S. Department of Justice, Office of
Justice Programs, National Institute of Justice, November 1999
(http://www.ncjrs.org/pdffiles1/nij/178914.pdf).
Contact Details Progamme: Lawrence F. Murray, CSW
The National Centre on Addiction and Substance Abuse at Columbia
University
633 Third Avenue, 19th Floor
New York, NY 10017
Phone: 212-841-5200
Fax: 212-956-8020
E-mail: lmurray@casacolumbia.org
Web: http://www.casacolumbia.org/
Contact Details: Evaluation: Same as above
First review: Carl Staunton 02/12/2004
Second review:
45
Programme: Cognitive behavioral Therapy for Child Sexual Abuse (CBTCSA)
A: The Programme
Programme Type: Early intervention approach targeting child victims of
sexual abuse.
Brief Description: Cognitive Behavioural Therapy for Child Sexual Abuse
(CBT-CSA) is a treatment approach designed to help children and
adolescents who have suffered sexual abuse overcome posttraumatic
stress disorder (PTSD), depression, and other behavioural and emotional
difficulties.
Scope: The program may be utilized in private and/or public clinics and
has demonstrated success with Black/African American, Hispanic/Latino,
and White children from all socioeconomic backgrounds. The participants
were primarily seen at a public clinic on a medical school campus, but
therapists in community settings, including child protection offices in
urban, suburban, and rural settings, have also delivered the treatment
program.
Target Population: CBT-CSA is designed for children and adolescents 3
through 18 years old who have experienced sexual abuse and are
exhibiting posttraumatic stress, depression, and other abuse-related
difficulties (e.g., age-inappropriate sexual behaviours, problematic fears,
social isolation). Children are generally referred for treatment following an
investigation conducted by child protection or law enforcement personnel
in whom allegations of sexual abuse are found to be credible. Whenever
possible, a non-offending caregiver or parent is encouraged to participate
along with the child.
Longer Description: The treatment program consists of parallel sessions
with the child and his or her non-offending parent(s), as well as joint
parent-child sessions in the later stages of therapy. The treatment
approach can be effectively implemented in 12 sessions and has been
applied to both individual and group therapy formats. The specific
components of treatment for both the child and parent include:
*
Education about child sexual abuse and healthy sexuality
*
Coping skills training, including relaxation, emotional expression,
and cognitive coping
46
*
Gradual exposure and processing of traumatic memories and
reminders
*
Personal body safety skills training
Parents are also provided with behavioural management training to
strengthen children's positive behaviours while minimizing behavioural
difficulties. Joint parent-child sessions are designed to help parents and
children practice and utilize the skills learned, while also fostering more
effective parent-child communication about the abuse and related issues.
Risks targeted by the programme: children exhibiting posttraumatic
stress, depression, and other abuse-related difficulties (e.g., ageinappropriate sexual behaviours, problematic fears, social isolation).
Outputs and outcomes sought by the programme: The main
outcomes expressed are the boosting of protective factors such as
*
Emotional expression skills
*
Relaxation skills
*
Cognitive coping skills
*
Personal safety skills
*
Self-esteem
Specified LM or Theory of Change: none stated
Hypothesized LM or Tic: Greater improvements to PTSD and less
intrusive thoughts which will lead to prevention of depression and other
psycho social disorders in later life, also leading to improved parent-child
communication
Links to Other Programmers: National Action Plan Against Sexual
Assault (NAPASA): ECPAT:
47
Quality of Programme: Good
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
48
(B) The Evaluation
Brief Description: mainly based on a series of randomized control trials.
Evaluation Type: Randomized control trails and research into parental
participation in treating children’s acting out behaviors and depression
Comparison Group Received: n/k
Outputs Specified by Evaluation: n/k
Outcomes Specified by Evaluation:
LM or Theory of Change Specified by Evaluation: none stated
Results: Outputs: none stated
Results: Outcomes: Children who participated in CBT-CSA with their
non-offending parents demonstrated greater improvements with respect
to PTSD, depression, and acting out behaviours as compared to children
assigned to the community control condition. As compared to parents who
participated in a support group, parents who participated in a CBT-CSA
group showed greater improvement with respect to emotional distress
and intrusive thoughts related to their children's sexual abuse.
49
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: N/K
Other Innovation:
Replication: None
Citation: High (l).
50
C. Contact and Review Information
Internet: www.hope4families.com
Principle references: journal of the academy of the child and
adolescent psychiatry, child maltreatment, and Child Abuse and Neglect:
the International Journal –see program developer for details.
Contact Details Progamme: Program Developer
Esther Deblinger, Ph.D.
Clinical Director
Centre for Children Support
University of Medicine and Dentistry of NJ
School of Osteopathic Medicine
42 East Laurel Road, Suite 1100B
Stratford, NJ 08084
Phone: (856) 566-7036
Fax: (856) 655-6108
Email: deblines@umdnj.edu
Web site: www.hope4families.com
Contact Details: Evaluation: same as program developer.
First review: Carl Staunton 11th November 2004
Second review:
51
Programme: Cognitively Guided Instruction (CGI)
A: The Programme
Programme Type: Early intervention program (school based)
Brief Description: Cognitively Guided Instruction (CGI) is a professional
development program for teachers that explicitly shows what kind of
knowledge students bring to the maths learning process and how they
connect that knowledge with formal concepts and operations.
Scope: Training programs have been established in Wisconsin, North
Carolina, Arizona, and Ohio. There are also several start-up programs in
Phoenix; Fargo, North Dakota; Dearborn and East Lansing, Michigan; and
other sites in California, Alaska, and New Zealand.
Target Population: CGI is intended for Kindergarten, first, second, and
third-grade teachers.
Longer Description: Developed by education researchers Thomas
Carpenter, Elizabeth Fennema, and Penelope Peterson, CGI is guided by
two major theses. The first thesis is that children bring an intuitive
knowledge of mathematics to school with them and that this knowledge
should serve as the basis for developing the formal mathematics
instruction in primary school. This thesis leads to an emphasis on
assessing the processes that students use to solve problems. The second
thesis is that maths instruction should be based on the relationship
between skills and problem solving. This thesis leads to an emphasis on
problem solving in the classroom versus the repetition of number facts
and/or deskwork.
CGI provides a basis for identifying what is difficult and what is easy for
students to comprehend in their study of maths. It also provides a way
for dealing with the common errors students make while learning. The
emphasis is on what children can do, rather than what they cannot do,
which leads to a very different approach regarding wrong answers. With
the CGI approach, teachers work backward from the error to identify the
valid concepts that students do understand. The program aims to improve
children’s mathematical skills by changing teachers’ beliefs regarding how
children learn, and ultimately their teaching practices.
Risks targeted by the programme: None. Programme focuses on what
children can rather than cannot do.
52
Outputs and outcomes sought by the programme: The program aims
to improve children’s mathematical skills by changing teachers’ beliefs
regarding how children learn, and ultimately their teaching practices.
Specified LM or Theory of Change: ToC stated is based on the thesis
that children bring an intuitive approach to maths to school with them
and that this knowledge should serve as a basis for developing the formal
mathematics instruction in primary school.
Hypothesised LM or ToC: As specified in program as above.
Links to Other Programmes:
Quality of Programme:
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
53
(B) The Evaluation
Brief Description: There have been several evaluations of the CGI
program. In 1989, Carpenter et al. studied 40 first-grade teachers, half of
whom were randomly assigned to the CGI program. The CGI teachers
participated in a four-week summer workshop. The teachers and their
students were then observed during the school year. Measures, such as
the teacher belief instrument, were developed to assess the teachers’
knowledge of their students thinking and performance, which was then
matched with actual performance. The students were evaluated using the
Iowa Test of Basic Skills with a pre-test in September and post-tests in
April/May.
A second study (Villasenor and Kepner, 1993) examined CGI in a large
Midwestern urban school district. Two first-grade teachers were
voluntarily recruited from schools where there was at least a 50 percent
minority population, resulting in a total of 12 treatment classrooms.
Comparison classrooms were selected to match the treatment
classrooms. The CGI teachers went through a 19-hour summer workshop,
a two-hour review in September, and two support sessions.
Evaluation Type: First evaluation used mainly observational methods
whilst the second latest evaluation used randomized control method.
Comparison Group Received: nothing
Outputs Specified by Evaluation: improvement in mathematical
reasoning
Outcomes Specified by Evaluation: mainly to change Teachers attitude
towards problem solving and spending less time teaching number facts.
LM or Theory of Change Specified by Evaluation: none
54
Results: Outputs: The Carpenter et al. (1989) study found the
following:

CGI students scored significantly higher (8.6 compared with 7.8
out of a possible score of 12) than control students on the
complex addition/subtraction portion of the math section of the
Iowa Test of Basic Skills.
Villasenor and Kepner (1993) found the following:



CGI students scored significantly higher than control students on
the problem-solving test (9.41 versus 3.18 out of a possible
score of 14).
The CGI students scored significantly higher than control
students on the word problems part of the interview (5.54 versus
2.83 out of a possible score of 6).
The CGI students scored significantly higher than control
students on the number facts portion of the interview (4.76
versus 2.92 out of a possible score of 5).
Results: Outcomes: The Carpenter et al. (1989) study found the
following:

On the teacher belief instrument, CGI teachers were significantly
more likely to agree with the principle that problem solving
should be the focus of instruction.

CGI teachers spent significantly more time teaching problem
solving and less time teaching number facts than did control
teachers.
Other Evaluation Notes: This program received a “promising” rating.
Although the two evaluations showed significant gains in some measures,
there are some areas of concern:
55



First, there were no significant differences between the control
and treatment groups on the Iowa Test of Basic Skills in the first
evaluation. Rather, the researchers found significant differences
between control and treatment students only when looking at
student performance on smaller subgroups of test problems. CGI
students scored significantly higher on problems identified as
number-facts problems or complex addition/subtraction
problems, but not on simple addition/subtraction or advanced
problems. This finding is of some concern because the Iowa Test
of Basic Skills is the only assessment used in the evaluations
that were not developed by the program’s designers.
Second, the evaluations concentrated on measuring the change
in teachers’ beliefs and behaviour. While the evaluations
provided significant evidence that the CGI program was
successful at changing teachers’ beliefs and that this change in
beliefs then changed their teaching methods in the classroom, it
did not necessarily translate into improved student outcomes.
Finally, although the Villasenor and Kepner (1993) study
measured outcomes for 288 students, only two teachers were
part of the treatment and those teachers volunteered for the
program rather than being randomly selected.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: None
Replication: None
Citation: High
56
C. Contact and Review Information
Internet: llevi@factstaff.wisc.edu
Principle references:
1. Carpenter, T. P., E. Fennema, P. L. Peterson, C. Chiang, and M. Loef,
“Using Knowledge of Children’s Mathematics Thinking in Classroom
Teaching: An Experimental Study,” American Educational Research
Journal, Vol. 26, No. 4, 1989, pp. 499–531.
2. Fennema, E., et al., “A Longitudinal Study of Learning to Use Children’s
Thinking in Mathematics Instruction,” Journal for Research in
Mathematics Education, Vol. 27, No. 4, 1996, pp. 403-434.
3. Villasenor, A., and H. S. Kepner, “Arithmetic from a Problem-Solving
Perspective: An Urban Implementation,” Journal for Research in
Mathematics Education, Vol. L24, No. 1, 1993, pp. 62–69.
Contact Details Progamme:
Linda Levi
University of Wisconsin–Madison
Wisconsin Centre for Education Research
1025 West Johnson Street
Madison, WI 53706
608-263-4267
E-mail: llevi@factstaff.wisc.edu
Contact Details: Evaluation: Same as for programme
First review: Carl Staunton 14/12/2004
Second review:
57
Programme: Child Development Project
A: The Programme
Programme Type: Early intervention and prevention of substance abuse
and anti social behaviour program
Brief Description: CDP is an early intervention and prevention program
designed primarily to prevent formation of anti social behaviour in later
life.
Scope: The Child Development Project has been developed over the past
20 years through a series of demonstration studies and revisions. It has
been rigorously implemented and evaluated in such diverse settings as
Dade County, FL; White Plains, NY; Louisville, KY; and San Francisco,
Salinas, and Cupertino, CA. Copies of various evaluation studies,
assessment instruments, program descriptions, and program materials
are available from its developer, the non profit Developmental Studies
Center in Oakland, CA.
Target Population: school students (5–11)
Longer Description: The Child Development Project (CDP) is a
comprehensive, elementary school-based intervention program. CDP
incorporates class meetings, learning activities for partners and small
groups, and open-ended discussions on literature to enhance students’
social, ethical, and intellectual development. CDP is based on the belief
that prevention efforts are most likely to be effective when they occur
early in a child’s development, before antisocial behavioral patterns have
a chance to become firmly established. CDP emphasizes the promotion of
positive development rather than the prevention of disorder. The central
goal of CDP is to help schools become "caring communities of learners" by
offering an environment of caring, supportive, and collaborative
relationships to build students’ sense of community in school and to
promote school bonding.
58
Risks targeted by the programme:
 Early antisocial behavior
 Lack of self-control, assertiveness, and other social/emotional skills
 Lack of commitment to core societal values
Outputs and outcomes sought by the programme:
Decreases in substance use, reductions in behaviours relating to risk
factors
Specified LM or Theory of Change: none stated
Hypothesised LM or ToC: the ‘helping schools to become caring
communities’ ethos of the program and promotion of positive
development as opposed to prevention of disorder will help to enhance
students social and intellectual development which will help to prevent
future problem behaviour.
Links to Other Programmes: none cited
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
59
(B) The Evaluation
Brief Description:
Evaluation Type: Solomon et al. (1988) studied the effects of CDP in a
sample of 346 students from six elementary schools in a middle- to
upper-middle class suburban school district in the San Francisco Bay area.
The sample over the five study years consisted of three treatment schools
(173 students) and three control schools (163 students), which included
67 classrooms.
Comparison Group Received: N/K
Outputs Specified by Evaluation: N/K
Outcomes Specified by Evaluation:
Outcome measures included past month use of tobacco, alcohol,
marijuana, and other elicit drugs; delinquent behaviours (e.g., using
weapons in a fight); grade-point average in core academic subjects
(language arts, mathematics, science, and social studies), and scores on
district-administered achievement tests. Program effects were assessed
by comparing the total sample of all treatment and comparison students,
as well as by focusing only on students from high-change schools. Sample
sizes for the high-change group were approximately 775 students for the
behaviour variables, and 900 students for the academic achievement
data.
LM or Theory of Change Specified by Evaluation: None stated
Results: Outputs:
60
Results: Outcomes:
DECREASES IN SUBSTANCE USE Issues of substance use or abuse are
not directly addressed in the CDP program. However, when consistently
implemented, the program produced the following effects on use of
alcohol, marijuana, and tobacco at upper elementary grades over a 4year period:
Alcohol use declined from 48% to 37% of students
• Cigarette use declined from 25% to 17% of students
• Marijuana use declined from 7% to 5% of students
REDUCTIONS IN BEHAVIORS RELATED TO RISK FACTORS
•
Other risky behavior declined, including carrying weapons, threats
of violence, and involvement in gang fights
OTHER TYPES OF OUTCOMES Creates an atmosphere of trust and
respect between students and teachers Nurtures responsibility, fairness,
honesty, and helpfulness in students Enhances students’ conflict
resolution skills Increases students’ academic motivation Strengthens
family-school-community connections
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: Good
Replication: None
Citation: Moderate
61
C. Contact and Review Information
Internet:
Web site: www.devstu.org
Five principle references:
1. Battistich, Victor, Eric Schaps, and Nance Wilson, "Effects of an
Elementary School Intervention on Students’ "Connectedness" to
School and Social Adjustment During Middle School," The Journal
of Primary Prevention, Vol. 24, No. 3, 2004, pp. 243-262.
2. Battistich, Victor, Eric Schaps, Marilyn Watson, Daniel Solomon, and
Catherine Lewis, "Effects of the Child Development Project on
Students’ Drug Use and Other Problem Behaviors," The Journal of
Primary Prevention, Vol. 21, No. 1, 2000, pp. 75-99.
3. Solomon, Daniel, Marilyn S. Watson, Kevin L. Delucchi, Eric Schaps,
and Victor Battistich, "Enhancing Children’s Pro-Social Behavior in
the Classroom," American Educational Research Journal, Vol. 25,
No. 4, 1988, pp. 527-554.
4. Solomon, Daniel, Marilyn S. Watson, Victor Battistich, Eric Schaps,
and Kevin Delucchi, "Creating Classrooms that Students Experience
as Communities," American Journal of Community Psychology,
Vol. 24, No. 6, 1996, pp. 719-748.
5. Solomon, Daniel, Victor Battistich, Marilyn Watson, Eric Schaps, and
Catherine Lewis, "A Six-District Study of Educational Change: Direct
and Mediated Effects of the Child Development Project," Social
Psychology of Education, Vol. 4, No. 1, 2000, pp. 3-51.
Contact Details Progamme:
Developmental Studies Center 2000 Embarcadero, Suite 305 Oakland, CA
94606 Phone: (800) 666-7270, ext. 239 Fax: (510) 464-3670 E-mail:
info@devstu.org Web site: www.devstu.org
Contact Details: Evaluation: same As above
First review: Carl Staunton 31/11/04
Second review:
62
Programme: Child Parent Centres
A: The Programme
Programme Type: Early Intervention program
Brief Description: The Chicago Child-Parent Centres (CPCs) provide
comprehensive educational support and family support to economically
disadvantaged children and their parents.
Scope: The CPC program was founded in 1967 to serve families in highpoverty neighbourhoods that were not being served by Head Start or
similar programs.
Target Population: CPC programming is available to children in
preschool through third grade. To be eligible to participate in the CPC
program, children must reside in school neighbourhoods that receive Title
I funds. In order for children to participate in the program, their parents
must commit to dedicating volunteer time to the centre on a weekly
basis. The centres conduct outreach activities to recruit families who are
in need.
Longer Description: The guiding principle of the program is that by
providing a school-based, stable learning environment during preschool
and during kindergarten through third grade, in which parents are active
and consistent participants in their child's education, scholastic success
will follow. The program requires parental participation and emphasizes a
child-cantered, individualized approach to social and cognitive
development.
The centres are part of the Chicago Public Schools system and are
traditionally housed in separate buildings (primarily in preschools) or in
wings of a parent elementary school. Currently, the Chicago Public
Schools operate 23 Federal Title I CPC sites; 18 feature services from
preschool through kindergarten, and 5 have services in preschool only.
Title I stopped supporting the elementary-school portion of the program
about a decade ago. Currently, children may begin the CPC program in
preschool only.
63
Risks targeted by the programme: Educational failure, anti-social
behaviour. Economically deprived children
Outputs and outcomes sought by the programme: Increase in
educational achievement and pro-social behaviour are the main outputs
and outcome sought by the program.
Specified LM or Theory of Change: The guiding principle of the
program is that by providing a school-based, stable learning environment
during preschool and during kindergarten through third grade, in which
parents are active and consistent participants in their child's education,
scholastic success will follow.
Hypothesised LM or ToC: as specified above
Links to Other Programmes: Strong link to Headstart. I.e. seen as
Headstart substitute for areas were this program does not operate..
Quality of Programme:
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
64
(B) The Evaluation
Brief Description: Evaluations of the CPC program use information from
the Chicago Longitudinal Study (CLS), which followed 1,539 low-income
minority students (95 percent of whom are African-American, and 5 of
whom are Hispanic) who were scheduled to be in the graduating class of
kindergartners in 26 public elementary schools in Chicago in the spring of
1986. All children resided in neighbourhoods eligible for Title I services.
Among them were 1,150 children who were enrolled in 20 CPCs that had
both preschool and kindergarten programs, and those students served as
the "treatment" group.
Evaluation Type: 15 year longitudinal study –quasi experimental.
Comparison Group Received: The comparison group consisted of 389
children who were students at six randomly selected schools participating
in a full-day kindergarten program for low-income students. Some of the
children in the comparison group may have received CPC services in
grades 1 through 3.
Outputs Specified by Evaluation: Evaluation mainly output driven.
Main outputs specified are increase grade specific performance and less
juvenile arrests.
Outcomes Specified by Evaluation: None specified.
LM or Theory of Change Specified by Evaluation: None stated
Results: Outputs: Reynolds et al. (2001) found at the 15-year follow-up
that




Children who attended a CPC preschool program as compared
with children who did not attend preschool
Were more likely to have completed high school (49.7 percent
versus 38.5 percent)
Were less likely to have been retained in a grade by age 15
(23.0 percent versus 38.4 percent)
Were almost half as likely to have been in special education
by age 18 (14.4 percent versus 24.6 percent)
65






Had fewer arrests of any type (16.9 percent versus 25.1
percent) and were less likely to have had any violent arrests
(9.0 percent versus 15.3 percent).
"School-age" participation (with or without preschool
participation) yielded no improvement in educational
attainment or juvenile arrests; however, participating in at
least one year of the school-age program was associated with
lower rates of special education enrolment (15.4 percent
versus 21.3 percent) and fewer children ever having been
retained a grade (23.8 percent versus 34.3 percent)
Children who had extended CPC program participation as
compared with all children who had less CPC program
participation
Were less likely to have been held back a grade by age 15
(21.9 percent versus 32.3 percent)
Were less likely to have spent time in special education by
age 18 (13.5 percent versus 20.7 percent)
Had no statistically significant differences in educational
attainment or juvenile arrests.
Results: Outcomes: Evaluation mainly concerned with output
measurement.
Other Evaluation Notes: This program received a “proven” rating,
despite the fact that the evaluations use a quasi-experimental design
rather than randomly assigning children to treatment or control groups.
The sample sizes for the analysis were adequate, and the researchers
used rigorous empirical methods. The evaluations demonstrated sizeable
and significant gains in several areas over 15 years of follow-up.
Quality of Evaluation:
Sample: Good.
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: High.
66
C. Contact and Review Information
Internet: email: pstevens@csc.cps.k12.il.us
Website: http://www.cps.k12.il.us/
Five principle references:
1. Reynolds, Arthur J., The Chicago Child-Parent Centres: A
Longitudinal Study of Extended Early Childhood Intervention,
Discussion Paper No. 1126-97, Madison, Wis.: Institute for
Research on Poverty, 1997,
(www.ssc.wisc.edu/irp/pubs/dp112697.pdf).
2. Reynolds, Arthur J., “Effects of a Preschool Plus Follow-On
Intervention for Children at Risk,” Developmental Psychology,
Vol. 30, No. 6, 1994, pp. 787-804.
3. Reynolds, Arthur J., and Dylan L. Robertson, “School-Based Early
Intervention and Later Child Maltreatment in the Chicago
Longitudinal Study,” Child Development, Vol. 74, No. 1, 2003,
pp. 3-26.
4. Reynolds, Arthur J., and Judy A. Temple, “Quasi-Experimental
Estimates of the Effect of a Preschool Intervention,” Evaluation
Review, Vol. 19, No. 4, 1995, pp. 347-73.
5. Reynolds, Arthur J., Judy A. Temple, Dylan Robertson, and Emily
Mann, “Long-Term Benefits of Participation in the Title I Chicago
Child-Parent Centres,”
paper presented at the biennial meeting
of the Society for Research on Adolescence, Chicago, March 30,
2000.
Contact Details Progamme:
Pamela Stevens
Chicago Public Schools
125 S. Clark, 9th Floor
Chicago, IL 60603
773-553-2010
Fax: 773-553-2011
Contact Details: Evaluation:
First review: Carl Staunton 15/12/2004
Second review:
67
Programme: Creating Lasting Family Connections (CLFC)
A: The Programme
Programme Type:
Preventative and family-based programme designed with the aim of
reducing violence and alcohol, tobacco and illegal drug use in young
people.
Brief Description:
The CLFC programme was developed by the Council on Prevention and
Education: Substances, inc. (COPES), as a prevention and intervention
programme that enhances family resiliency and community connections in
order to reduce alcohol and other drug use (AOD) in adolescents.
Scope:
The programme has been replicated in nearly 50 states in the US.
The majority of the families and children served by the programme have
been aged between 11-15 year old and from varied ethnic backgrounds.
The programme has been delivered in an array of settings from churches
to juvenile justice facilities.
Target Population:
Designed for “at-risk” children aged 9-17 and their families.
Longer Description:
CLFC is a curriculum and national dissemination model based on the
results of a five year demonstration research project known as Creating
Lasting Connections (CLC), which focused on increasing community,
family and individual youth protective factors that potentially delay the
onset and reduce the frequency of AOD use. Families (children and
parents) participate in two and a half hour training sessions, per night,
throughout a period of 20 weeks. The programme is targeted at children
displaying characteristics associated with the development of substance
misuse and aims to provide parents and children with resiliency to
environmental risk factors. The sessions cover a variety of topics, for
example, skills for personal growth, family enhancement, empowerment,
family management, role modelling, service utilisation, interpersonal skills
and refusal skills.
Programme facilitators often work with up to 30 families at any one time,
and are responsible for case management and referrals to community
services if necessary.
68
Risks targeted by the programme:
- Family conflict.
- Failure to bond with family.
- Lack of parental understanding and regulation of ATOD use
within the home.
- Poor school attendance.
- Poor understanding and lack of access to community based
support and services.
Outputs and outcomes sought by the programme:
- Delay onset of ATOD use.
- Reduce frequency of ATOD use.
- Resiliency.
Specified LM or Theory of Change:
The CLFC logic model is available for download from the programme
website: http://www.copes.org/include/clfcLM.htm
The central components of the CLFC programme are community advocate
teams, parent training, youth training, early intervention services, and
case management services. These components are hypothesised to
facilitate community engagement, parent resiliency and youth resiliency,
which in turn should result in positive outcomes for children in the form of
delayed or reduced frequency of AOD use.
Hypothesised LM or ToC:
Links to Other Programmes:
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
69
(B) The Evaluation
Brief Description:
Participants for the programme evaluation were recruited by churches in
the five test sites in Louisville, Kentucky and then randomly allocated to
either an experimental group (49 parents and 59 teenagers) or a control
group (48 parents and 61 teenagers). Participants in each condition were
interviewed at the start of the programme and one year later. In
addition, the experimental group was interviewed upon completion of the
workshops (Johnson et al., 1996).
Evaluation Type:
Randomised Control Trial and multivariate analysis methods.
Comparison Group Received:
The control group received the intervention one year later.
Outputs Specified by Evaluation:
Use of community services
Outcomes Specified by Evaluation:
Communication skills
Involvement in rule setting
Parental alcohol use
Family bonding
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Parents and teenagers made significantly greater use of community
resources and services.
Results: Outcomes:
Communication between parent and child was significantly improved.
Children significantly more involved in setting rules regarding AOD use.
Decrease in parental use of alcohol, within the black community.
Significantly increased level of bonding between teenagers and their
mothers.
The decrease in risk factors and enhancement of both individual and
family level protective factors was associated with postponement and
reduction in AOD use.
Other Evaluation Notes:
70
Programme had an adverse effect on non-AOD rules used by the family.
The evaluators hypothesise that the use of non-AOD rules was overlooked
by families, due to the emphasis placed by the programme on the use of
AOD rules.
Quality of Evaluation: Good
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: Good
Citation: High
71
C. Contact and Review Information
Internet:
CLFC website: www.copes.org
Promising Practices:
http://www.promisingpractices.net/program.asp?programid=59
Five principle references:
Johnson, K., D. Bryand, D. Collins, et al. (1998). Preventing and
Reducing Alcohol and Other Drug Use Among High-Risk Youths by
Increasing Family Resilience. Social Work, 43, pp. 297-308.
Johnson, K., T. Strader, M. Berbaum, et al. (1996). Reducing Alcohol
and Other Drug Use by Strengthening Community, Family, and
Youth Resiliency: An Evaluation of the Creating Lasting
Connections Program. Journal of Adolescent Research, 11, 1, pp.
36-67.
Johnson, K., Noe, T., Collins, T., Strader, T. & Bucholtz, G. (2000).
Mobilizing Church Communities to Prevent Alcohol and Other Drug
Abuse: A Model Strategy and Its Evaluation. Journal of
Community Practice, 7 (2), 1-27.
Johnson, K., Bryant, D., Collins, D., Noe, T., Strader, T., & Berbaum,
M. (1998). Preventing and Reducing Alcohol and Other Drug Use
among High-Risk Youths by Increasing Family Resilience. Social
Work Journal of the National Association of Social Workers, 43
(4), 297-308.
Strader, T., D. Collins, T. Noe, and K. Johnson. (1997). Mobilizing
Church Communities for Alcohol and Other Drug Abuse
Prevention Through the Use of Volunteer Church Advocate
Teams. Journal of Volunteer Administration, 15, pp. 16-29.
Contact Details Programme:
Ted Strader, Executive Director
Council on Prevention and Education: Substances, Inc. (COPES, Inc.)
845 Barrett Avenue
Louisville, KY 40204
Phone: (502) 583-6820
Fax: (502) 583-6832
email: tstrader@sprynet.com
72
Internet: www.copes.org/include/clfc.htm
Contact Details: Evaluation:
Dr. Knowlton Johnson
Pacific Institute for Research and Evaluation, Inc. Louisville Center
1300 South Fourth Street, Suite 300
Louisville, Kentucky 40208
Tel: (502) 634-3694
F: (502) 634-5690
Internet: kwjohnson@pire.org
First review: Sarah Blower
Second review:
73
Programme:
Incredible Years Dinosaur Social Skills
A: The Programme
Programme Type:
Early Intervention aimed to improve the behavior of children with early
onset conduct disorders.
Brief Description:
Children aged 4-8 with conduct disorders (CD) such as ADHD,
Oppositional Defiant Disorder (ODD) etc. experience a long-term training
program targeted at improving behavior.
Scope: 51 children experienced over 13 of the 20-24 behavior training
sessions. 48 children were in the waiting list control group.
Target Population:
Children for the training and control conditions were recruited from the
University of Washington Parenting Clinic. Children were aged between 4
and 8 and the primary reason for their referral was child misconduct (e.g.
noncompliance, aggression, oppositional behaviors) continuing for at least
6 months. Participating children needed to be diagnosed with CD or ODD
to be eligible for the study.
Longer Description:
Interventions aimed at improving child behavior have tended to focus on
teaching better parenting skills and while these interventions have been
successful in the home, children still behave badly in other social
situations. This intervention aims to improve the behavior of children in
all situations by targeting the child.
The study randomly assigned children to the training group or control
group. The intervention group received up to 24 training sessions where
children are encouraged to discuss positive social skills and apply them in
hypothetical situations.
During each situation children watch videos of children dealing with
different stressful situations in different ways. These initiate discussions
and tools such as puppets, cue cards and coloring books are used to
74
facilitate learning. The children also role play situations and are given
homework to practice what they have learned. Schoolteachers and
parents are encouraged to positively reinforce learned behaviors.
The long-term follow up one year later indicated that most of the child
behavior changes were maintained. Failure to make improvements in
child behavior only related to children with poor parents, indicating a need
to also target parenting skills.
Risks targeted by the program:
The program targets children with early onset conduct problems and
seeks to prevent poor behavior and social relations. It also looked at
family type, whether experiencing poverty, stress or marital problems,
and parenting styles, whether parents are overly critical or use harsh
punishment.
Outputs and outcomes sought by the program:
The program aims to significantly improve children’s social behavior by
improving social and conflict resolution skills, improving levels of
loneliness and negative attributions, improving ability to emphasize and
understand another persons perspective, improve use of feeling language
and problem solving at school.
Specified LM or Theory of Change:
The intervention incorporates social learning theory (SLT) and a
theory of coping.
The SLT model of change suggests that a child must attend to and model
events, they must remember it over a period of time, be motivated to
reproduce it and eventually spontaneously reproduce it.
Using the coping model, children are encouraged to discuss and model
the use of positive social skills, apply them to hypothetical situations and
practice those skills.
Hypothesized LM or ToC:
Links to Other Program:
75
Quality of Programme: good
LM or TofC: good
Target Population Specified: good
Attention to Ethics:
Consistency/Fidelity:
76
(B) The Evaluation
Brief Description:
The research team looked at how children facing additional risks reacted
to the training. They looked specifically at child disorders (CD/ ODD/
ADHD) family type (whether experiencing stress, poverty, marital
problems) and parenting styles, (i.e., use of physical punishment, harsh
criticism.) they found that children with disorders, particularly ADHD,
benefited from the program. Children from families with poor parenting
did not benefit as well, this indicates the need for parent training
intervention programs.
This program also found an improvement in child behavior across social
situations such as within the family and the school environment.
The one-year follow up of the intervention group indicated that most of
the behavior changes were maintained.
Evaluation Type:
Longitudinal randomized control trial
Comparison Group Received:
The families assigned to the control condition received no treatment and
had no contact with a therapist. After waiting 8-9 months, control
children were reassessed and then offered an intervention. They were
not followed up at 12 months.
Outputs Specified by Evaluation:
The experimental intervention improved social behavior for all child
groups except those with parents with poor parenting skills.
Outcomes Specified by Evaluation:
Better social skills for the child such as improved social and conflict
resolution skills, reduced loneliness, improved ability to understand
another persons perspective, improved use of feeling language and
improved problem solving abilities
LM or Theory of Change Specified by Evaluation:
77
Results: Outputs:
Results: Outcomes:
Other Evaluation Notes:
Quality of Evaluation: good
Sample: limited
Measures: good
Control Group: limited – did not receive an intervention
Other Innovation:
Replication:
Citation: the Journal of Child Psychology and Psychiatry
78
C. Contact and Review Information
Internet:
Five principle references:
Beelmann, A., Pfingste, U., Losel, F., (1994) Effects of training social
competence in children: A meta-analysis of recent evaluation studies.
Journal of Abnormal Child Psychology, 5, 265-275.
Grossman, D. C., Neckerman, H. J., Koepsell, T. D., Liu, P. Y., Asher, K.
N., Beland, K., Frey, K., Rivara, F. P., (1997) Effectiveness of a violence
prevention curriculum among children in elementary school. A
randomized controlled trial. Journal of the American Medical Association,
27, 1605-1611
Lochman, J. E., Dunn, S. E., (1993) an intervention and consultation
model from a social cognitive perspective: A description of the anger
coping program. School psychology review, 22, 458-471.
Webster-Stratton, C., (1991) Dinosaur social skills and problem solving
training manual. Seattle, WA: Incredible Years
Webster-Stratton, C., Reid, M. J., (1999) treating children with early
onset conduct problems: the importance of teacher training. Paper
presented at the Association for the advancement of Behavior Therapy:
Toronto, Canada, November.
Contact Details Progamme:
Webster-Stratton, C., Reid, J., Hammond, M., (2001) social skills and
problem solving training for children with early onset conduct problems:
who benefits? Journal of child psychology and psychiatry, V42, no7, 943952.
Contact Details: Evaluation:
First review: Helen
Second review:
79
Programme:
A: The Program Child Sexual Abuse Prevention: Teacher Training
Workshop.
Programme Type: Prevention.
Brief Description: The Child Sexual Abuse Prevention: Teacher Training
Workshop Curriculum was developed in 1988 to train and prepare
teachers to more adequately respond to the problem of child sexual
abuse.
Scope: In the studies done so far, classroom teachers in grades K–12
have been trained in the curriculum, with most of the participating
teachers in elementary education. The studies were all conducted in the
south-eastern United States.
Target Population: Teachers who teach at elementary schools.
Longer Description: The six-hour program presents classroom teachers
from kindergarten through twelfth grade with general knowledge on child
sexual abuse and attempts to increase their awareness of the problem.
The training provides an opportunity for teachers to (1) explore their own
sexual and abuse-related issues and opinions; (2) determine and build
upon their knowledge of the symptoms of abuse; and (3) understand
their legal and ethical responsibilities as teachers.
The program uses a variety of educational tools to help teachers better
understand, recognize, and respond appropriately to child sexual abuse.
Those tools include lectures, videotapes, role-playing, pencil and paper
activities, question-and-answer sessions, and group discussions. The
training is conducted by individuals with expertise in child sexual abuse,
such as school psychologists or staff from a child abuse centre. In
addition, community experts—including therapists, paediatricians, social
workers, detectives, and attorneys—can be brought in to discuss their
involvement with child sexual abuse.
80
Risks targeted by the programme: Elementary aged children at risk
from sexual abuse.
Outputs and outcomes sought by the programme: Principally to
increase the percentage of children who do not experience physical,
psychological or emotional abuse are the outputs sought.
Specified LM or Theory of Change:
Hypothesized LM or ToC: May empower children and increase
assertiveness through knowledge and skills relating to what is and isn’t
appropriate behavior of adults.
Links to Other Programmes:
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
81
(B) The Evaluation
Brief Description: This program has been evaluated in 1988, 1990 and
1994 respectively.
Evaluation Type: randomized control study.
Comparison Group Received: n/k
Outputs Specified by Evaluation: percentage of children not
experiencing abuse and teachers being able to respond more effectively
to sexual abuse problems.
Outcomes Specified by Evaluation: none.
LM or Theory of Change Specified by Evaluation:
Results: Outputs: The last study in 1994 found that:
 On a 30-item knowledge scale, untrained teachers went from
having a pre-test average of 19.62 to a having a post-test average
of 19.57. Trained teachers went from having a pre-test average of
18.29 to having a post-test average of 25.43.
 On the opinion scale similar to the one used by Kleemeier et al.,
untrained teachers scored 50.24 on the pre-test and 50.10 on the
post-test, versus the trained teachers who scored 50.52 on the pretest and 57.00 on the post-test.
 The post-test vignette average score for the untrained teachers was
25.14 versus 44.24 for the trained teachers.
Results: Outcomes:
 Trained teachers were able to apply their knowledge to hypothetical
situations more easily.
 Trained teachers reported spending more time in “discussions of
child abuse issues with a friend or colleague,” “classroom activities
or discussions about abuse,” and “discussions with individual
children about possible abuse” than did control teachers.
Other Evaluation Notes: This program received a “promising” rating.
Evaluations indicate that the teacher trainings have produced some
positive results. However, a majority of the research has examined
outcomes only for participating teachers and not for the children.
Any K–12 teacher could be trained on this curriculum, but it is difficult to
say whether it would be applicable for all students because student
outcomes were studied only to determine whether there were any
changes in knowledge about abuse.
82
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: Moderate.
83
C. Contact and Review Information
Internet: No web info known.
Principle references:
1. Hazzard, A., Kleemeier, C., & Webb, C. Teacher Versus Expert
Presentations of Sexual Abuse Prevention Programs 1990. Journal
of Interpersonal Violence, 5: 23-36
2. Kleemeier, C., Webb, C., Hazzard, A. & Pohl, J. Child Sexual
Abuse Prevention: Evaluation of a Teacher Training Model 1988.
Child Abuse & Neglect, 12: 555-561.
3. Randolph, M. K., & Gold, C.A. Child Sexual Abuse Prevention:
Evaluation of a Teacher Training Program 1994. School Psychology
Review, 23(3): 485-495.
Contact Details Progamme: Ann Hazzard, Ph.D.
Paediatric Continuity Clinic
PO Box 26065
80 Butler Street, SE
Atlanta, GA 30303
Phone: (404) 616-4875
Contact Details: Evaluation:
First review: Carl Staunton 6th December 2004.
Second review:
84
Programme: The Dalston Youth Project II
A: The Programme
Programme Type: Longitudinal Mentoring Programme
Brief Description: Works with young people in the community who are
at risk of becoming involved in crime. The programme lasts 12 months, it
is structured and aims to emphasise young people’s positive potential and
works on a ‘praise culture’, it is educational and provides individual
support.
Scope: 80 11-14 year olds, who were underachievers, had low
educational attainment and behavioural problems. 30 were studied from
the 1st year, 30 from the 2nd and 20 from the third.
Target Population: Young people aged 11-14
Longer Description:
The programme includes
 A five-day residential course when young people are challenged to
take stock of their lives and set personal goals for change
 Regular meetings and telephone contact with a volunteer mentor
trained to provide them with support in achieving their goals
 Group events on a monthly basis to provide challenging and fun
activities
 Education and careers advice, including ‘taster’ sessions at a further
education college and job-shadowing visits
Risks targeted by the programme:
Low educational achievement, anti-social behaviour
Outputs and outcomes sought by the programme:
 To improve basic education skills
 To improve social skills
 To reduce conflict with parents and adults
 To reduce offending rates, drug use, truanting or other at-risk
behaviour
85
Specified LM or Theory of Change:
Hypothesised LM or ToC:
Having one adult to care about the child and that the child can contact in
any situation will improve the child’s decision-making and security.
Links to Other Programmes:
Dalston Youth Project I
Quality of Programme: High quality in terms of theoretical base,
content, ethics and the programme itself.
LM or TofC: N/A
Target Population Specified: Poor
Attention to Ethics: Good
Consistency/Fidelity: Good
86
(B) The Evaluation
Brief Description: A longitudinal analysis, but no true control group.
Evaluation Type:
Short and Long-term follow up - Single measures were used to assess the
achievements of the young people as a result of the Dalston Project.
These were checked across the participation year. Longer-term outcomes
were analysed from an even smaller sample of those who could be
followed up.
Comparison Group Received: N/A
Outputs Specified by Evaluation:
 Two thirds graduated with a certificate in years 1 and 2, and
three quarters graduated in year 3
 10-12 young people had improved their behaviour, self-esteem
and academic
 Only a small number showed improvements in school
attendance, school work and behaviour at school
Outcomes Specified by Evaluation:
 Of the 40 young people followed up 19 were judged to be a
success and 21 a failure
 87% of those who participated in the educational element were
judged to be a success
 In the context of mentoring there was not a statistically
significant relationship between those who had good relations
and those having poor relations
 Of the 80 participants, 40%were cautioned or convicted for an
offence
 12% of girls committed offences compared with 54% of boys
LM or Theory of Change Specified by Evaluation:
Results: Outputs:


Modest progress to improved behaviour and attitudes to learning
Half did not engage with the project
87
Results: Outcomes:
 Successful completion of mentoring
 Successful completion of education components
 Results of interviews with young people and their mentors
Other Evaluation Notes:
It is important to note that the right young people may not have been
referred to the programme and that a one-year project may not be long
enough to consolidate the gains made.
Quality of Evaluation: Fairly low quality of evaluation as there is such a
small sample and an absence of qualitative information to back up
observations.
Sample: Fair
Measures: Poor
Control Group: N/A
Other Innovation: N/A
Replication: Good
Citation: High
88
C. Contact and Review Information
Internet:
www.hackney.gov.uk
www.homeoffice.gov.uk/rds/pdfs/hors232.pdf
Five principle references:
Dalston Youth Project Part II (11-14): an evaluation by Roger Tarling, June Burrows and
Alan Clarke (2001). Home Office Research Study No.232. London: Home Office.
Contact Details Progamme:
Patrick Stewart, Project Manager
Dalston Youth Project
The Round Chapel
Powerscroft Road
Lower Clapton
London
E5 OPU
Tel: 020 8525 9696
Email: dyp@btconnect.com
Contact Details: Evaluation:
Roger Tarling, June Burrows and Alan Clarke for the Home Office
Institute of Social Research
University of Surrey
England
First review: Emma Sherriff
Second review:
5-Nov-04
89
Programme: Dare To Be You (DTBY)
A: The Programme
Programme Type: Early intervention programme
Brief Description: Dare to Be You (DTBY) is a proven program which
focuses on improving the parenting skills of parents of young children
(age 2 to 5) in order promote children’s resiliency to problems later in life,
which can, in turn, reduce children’s alcohol and drug use as they grow
up.
Scope: All four of the experimental DTBY sites were in Colorado,
participants varied by ethnicity, location (urban or rural), and income
levels.
Target Population: Program participants were at-risk children age 2 to 5
and their parents.
Longer Description: There are several components of the programme:
a children’s component, a parents’ component, training for child-care
providers, and training for social service agency workers who work with
families.
The program was found to be most effective when provided in two-hourlong blocks for each session, with the sessions given over a 10- to 12week period. Each series of workshops for parents, their young children,
and the children’s siblings included 10 to 25 parents and their children.
Each session began with a joint activity for parents and children and then
continued with separate activities for participants based on their age.
Each session focused on a different programme objective, mostly related
to improving parenting techniques.
Risks targeted by the programme: Risk factors for alcohol use
included foster care, child abuse, a parent who dropped out of high
school, low annual income, and family history of mental illness or
substance abuse.
Outputs and outcomes sought by the programme: Programme is
mainly outcome focused. Outcomes sought are mainly:
 Parental self-esteem
 Focus of control
 Parents’ reasoning skills
90



Parental communication with their children leading to effective
discipline
Child behaviour
Social support networks and peer support.
Specified LM or Theory of Change: Non specified
Hypothesised LM or ToC: Program seeks mainly to improve parenting
skills which is thought will boost protective factors and resilience of
children.
Links to Other Programmes: Has some similarities to the Head-start
program.
Quality of Programme:
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
91
(B) The Evaluation
Brief Description: Eligible families in each of the four sites were
randomly assigned to either the treatment group or control group. On
average, each site included 28 treatment and 17 control families each of
the five years. Standard psychological assessments were administered to
all participating families before and after treatment.
Evaluation Type: Randomised controlled trials
Comparison Group Received: Nothing
Outputs Specified by Evaluation: Mainly outcome driven
Outcomes Specified by Evaluation: The same as ‘outcomes sought by
programme’ section as above
LM or Theory of Change Specified by Evaluation:
Results: Outputs: Results are outcome focused.
Results: Outcomes:
Parental self-esteem: Parents in the treatment group, whose self-esteem
was measured before and after the workgroup sessions, showed
significantly increased feelings of confidence in their parenting skills. In
addition, at both the one-year and the two-year mark, parents in the
treatment group showed higher levels of self-esteem than parents in the
control group.
 Focus of control: Between the pre-test and post-test periods, there
was a significant decline in the treatment group’s belief that chance
controls outcomes and a smaller decline in the group’s belief that
powerful others determine outcomes.
 Parents’ reasoning skills: Between Year 1 and Year 2 of the
program, parents in the treatment group appeared to blame
themselves and their children for children’s poor behaviour less
than parents in the control group.
 Parental communication with their children that leads to effective
discipline: Three areas associated with this measure were tested:
overly harsh punishment, disciplining effectively, and setting limits
for children. Tests measuring these areas showed no change among
parents in the control group, but the scores of parents in the
experimental group showed improvements through the two-year
follow-up period.
92

Child behaviour: The goal of this measure was to determine if
children exhibited more age-appropriate behaviour after
participating in the program and if parents recognized this
behaviour as such. Evaluators asked parents and other caregivers
to note whether a child demonstrated a particular behaviour among
a checklist of behaviours, and, if so, whether the parents perceived
the behaviour as being inappropriate. Children exhibited significant
increases in their development and age-appropriate behaviours,
both compared with their pre-test scores and with the control
group.
 Social support networks and peer support: Between the pre-test
and the first-year post-test, parents in the experimental group
increased their satisfaction with available social support networks
more so than parents in the control group did. However, there was
no evidence that DTBY changed parents’ actual social networks.
Other Evaluation Notes: DTBY received a “proven” rating. Although the
program is designated as being proven, it is only proven for socioemotional development of a child and not for prevention of drug abuse.
The affected outcomes are only indirectly related to the professed
program goal of reducing substance abuse. There is no evidence that the
program prevents drug abuse, as the children were not followed into
adolescence. On the other hand, the experimental design, including
randomized assignment, a comparison group that received no
intervention, and ample sample size, provides evidence that the program
positively affects children’s socio-emotional development.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: Good
Replication: None
Citation: Moderate
93
C. Contact and Review Information
Internet: www.coopext.colostate.edu
Principle reference:
 Miller-Heyl, J., D. Mache, and J. Fritz, DARE to be You: A Family-Support,
Early Prevention Program, Journal of Primary Prevention, Vol. 18, pp. 257285, 1998.
Contact Details Progamme:
Jan Miller-Heyl
Dare To Be You
Colorado State University Cooperative Extension
215 N. Linden, Suite E
Cortez, CO 81321
Phone: (970) 565-3606
e-mail: darecourt@coop.ext.colostate.edu
Contact Details: Evaluation: Same as above
First review: Carl Staunton 17/12/2004
Second review:
94
Programme: Dare To Be You (DTBY)
A: The Programme
Programme Type: Early intervention programme
Brief Description: Dare to Be You (DTBY) is a proven program which
focuses on improving the parenting skills of parents of young children
(age 2 to 5) in order promote children’s resiliency to problems later in life,
which can, in turn, reduce children’s alcohol and drug use as they grow
up.
Scope: All four of the experimental DTBY sites were in Colorado,
participants varied by ethnicity, location (urban or rural), and income
levels.
Target Population: Program participants were at-risk children age 2 to 5
and their parents.
Longer Description: There are several components of the programme:
a children’s component, a parents’ component, training for child-care
providers, and training for social service agency workers who work with
families.
The program was found to be most effective when provided in two-hourlong blocks for each session, with the sessions given over a 10- to 12week period. Each series of workshops for parents, their young children,
and the children’s siblings included 10 to 25 parents and their children.
Each session began with a joint activity for parents and children and then
continued with separate activities for participants based on their age.
Each session focused on a different programme objective, mostly related
to improving parenting techniques.
Risks targeted by the programme: Risk factors for alcohol use
included foster care, child abuse, a parent who dropped out of high
school, low annual income, and family history of mental illness or
substance abuse.
Outputs and outcomes sought by the programme: Programme is
mainly outcome focused. Outcomes sought are mainly:
 Parental self-esteem
 Focus of control
 Parents’ reasoning skills
95



Parental communication with their children leading to effective
discipline
Child behaviour
Social support networks and peer support.
Specified LM or Theory of Change: Non specified
Hypothesised LM or ToC: Program seeks mainly to improve parenting
skills which is thought will boost protective factors and resilience of
children.
Links to Other Programmes: Has some similarities to the Head-start
program.
Quality of Programme:
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
96
(B) The Evaluation
Brief Description: Eligible families in each of the four sites were
randomly assigned to either the treatment group or control group. On
average, each site included 28 treatment and 17 control families each of
the five years. Standard psychological assessments were administered to
all participating families before and after treatment.
Evaluation Type: Randomised controlled trials
Comparison Group Received: Nothing
Outputs Specified by Evaluation: Mainly outcome driven
Outcomes Specified by Evaluation: The same as ‘outcomes sought by
programme’ section as above
LM or Theory of Change Specified by Evaluation:
Results: Outputs: Results are outcome focused.
Results: Outcomes:
Parental self-esteem: Parents in the treatment group, whose self-esteem
was measured before and after the workgroup sessions, showed
significantly increased feelings of confidence in their parenting skills. In
addition, at both the one-year and the two-year mark, parents in the
treatment group showed higher levels of self-esteem than parents in the
control group.
 Focus of control: Between the pre-test and post-test periods, there
was a significant decline in the treatment group’s belief that chance
controls outcomes and a smaller decline in the group’s belief that
powerful others determine outcomes.
 Parents’ reasoning skills: Between Year 1 and Year 2 of the
program, parents in the treatment group appeared to blame
themselves and their children for children’s poor behaviour less
than parents in the control group.
 Parental communication with their children that leads to effective
discipline: Three areas associated with this measure were tested:
overly harsh punishment, disciplining effectively, and setting limits
for children. Tests measuring these areas showed no change among
parents in the control group, but the scores of parents in the
experimental group showed improvements through the two-year
follow-up period.
97

Child behaviour: The goal of this measure was to determine if
children exhibited more age-appropriate behaviour after
participating in the program and if parents recognized this
behaviour as such. Evaluators asked parents and other caregivers
to note whether a child demonstrated a particular behaviour among
a checklist of behaviours, and, if so, whether the parents perceived
the behaviour as being inappropriate. Children exhibited significant
increases in their development and age-appropriate behaviours,
both compared with their pre-test scores and with the control
group.
 Social support networks and peer support: Between the pre-test
and the first-year post-test, parents in the experimental group
increased their satisfaction with available social support networks
more so than parents in the control group did. However, there was
no evidence that DTBY changed parents’ actual social networks.
Other Evaluation Notes: DTBY received a “proven” rating. Although the
program is designated as being proven, it is only proven for socioemotional development of a child and not for prevention of drug abuse.
The affected outcomes are only indirectly related to the professed
program goal of reducing substance abuse. There is no evidence that the
program prevents drug abuse, as the children were not followed into
adolescence. On the other hand, the experimental design, including
randomized assignment, a comparison group that received no
intervention, and ample sample size, provides evidence that the program
positively affects children’s socio-emotional development.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: Good
Replication: None
Citation: Moderate
98
C. Contact and Review Information
Internet: www.coopext.colostate.edu
Principle reference:
 Miller-Heyl, J., D. Mache, and J. Fritz, DARE to be You: A Family-Support,
Early Prevention Program, Journal of Primary Prevention, Vol. 18, pp. 257285, 1998.
Contact Details Progamme:
Jan Miller-Heyl
Dare To Be You
Colorado State University Cooperative Extension
215 N. Linden, Suite E
Cortez, CO 81321
Phone: (970) 565-3606
e-mail: darecourt@coop.ext.colostate.edu
Contact Details: Evaluation: Same as above
First review: Carl Staunton 17/12/2004
Second review:
99
Programme:
A: The Programme On Track Programme
Programme Type: Early intervention & prevention
Brief Description: Government led multi agency and multi intervention
community driven approach. Prevention of offending by decreasing risks
and boosting protective factors for children vulnerable to offending
behavior.
Scope: set up in 2000 by the Home office now covered by the Children’s
fund, no figures as yet as too how many children have been effected by
programme
Target Population: 4-12 year olds in 24 areas of highest crime in
England and Wales
Longer Description: Based on the U.S ‘what works’ model of evidence
led interventions. Comprises 5 core elements;
1. Home visiting
2. Home school partnerships
3. Family therapy
4. Parent support
5. Training and pre-school education.
Risks targeted by the programme: 4-12 year olds at risk deemed to
be at risk of offending in the geographical high-risk crime areas
Outputs and outcomes sought by the programme: Outputs expected
are reduction in rates of youth crime and anti social behavior and
increased literacy levels. Outcomes for the child are more time at school,
improved cognition, self-esteem and pro social behavior.
Specified LM or Theory of Change: None stated
Hypothesised LM or ToC: increasing school attendance and supporting
parents should reduce risk of offending later on.
100
Links to Other Programmes: part of government ‘joined up’ approach
and strong links with similar programmers i.e. SureStart. Connexions,
Neighbourhood Renewal Scheme, National Literacy Strategy.
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
101
(B) The Evaluation
Brief Description: Evaluation is consortium based and led by the Policy
Research Bureau. Currently at phase 5. Evaluation is ongoing and final
report expected March 2006
Evaluation Type: component parts-Review of previous data and
collection of community statistics, data audit, mapping primary data
requirements, analysis and final report stage.
Comparison Group Received: No control groups used.
Outputs Specified by Evaluation:
 Have risk factors been reduced and protective factors increased?
 Impact that other interventions operating in the OT area have had
on OT either positive or negative.
 Relationship between On Track interventions and levels of crime in
the areas concerned.
 Impact that OT has had on standards of education in OT areas.
Outcomes Specified by Evaluation: None stated
LM or Theory of Change Specified by Evaluation: Non stated
Results: Outputs: Results will be published in March 2006
Results: Outcomes:
Other Evaluation Notes: As stated previously evaluation is on going
(Public Policy Research Bureau) and results not expected until March
2006. No major impact on crime reduction predicted in the short term
102
Quality of Evaluation:
Sample: non-specific at present
Measures: Poor
Control Group: Non
Other Innovation:
Replication: Yes as partial separate evaluation also done by the Home
Office itself.
Citation: low.
103
C. Contact and Review Information
Internet: www.crimereduction.gov.uk
principle references:
(1) On Track Thematic Report: Community and Schools Engagement. Carl
Parsons, Brian Austin, Hazel Bryan, Jean Hailes and William Stow, DfES,
2003
Contact Details Progamme: Information Services Team
Home Office Crime Reduction Centre
The Hawkhills
Easingwold
York YO61 3EG
Tel: 01347 825058
Fax: 01347 825097
E-mail: crc@homeoffice.gsi.gov.uk
Contact Details: Evaluation: email admin@prb.org.uk Policy Research
Bureau http://www.prb.org.uk/research%20projects%summaries/p1575htm
First review: Carl Staunton November 5, 2004
Second review:
104
Programme: Draw the line/Respect the line
A: The Programme
Programme Type: This is a theoretically based program designed to
reduce the sexual risk behaviors among middle school adolescents.
Brief Description: Draw the line/Respect the line was a three-year
classroom based program that took place in 19 schools in Northern
California between 1997-1999. It used group discussions, group activities
and role-playing to delay the initiation of sex in order to reduce the
incidence of STDs including HIV/AIDS and pregnancy. It is one of the
first studies to yield long-term effects for males.
Scope: the program targeted 19 schools in Northern California and
served grades 6-8. 2829 program and control students were tracked for
360 months.
Target Population: the program served youths in sixth, seventh and
eighth grades with an average age of 11.5. Participants were 59%
Latino, 17% white and 16% Asian. Half of the participants were male and
half were female.
Longer Description: this was a 20-session curriculum that assisted in
developing students personal sexual limits and practicing skills to help
them maintain them. The sixth grade curriculum included 5 lessons that
featured limit setting and refusal skills in non-sexual situations. The
seventh grade curriculum included 8 lessons that addressed determining
personal limits regarding sexual intercourse and the consequences of
unplanned intercourse. The eighth grade curriculum included 7 lessons
that featured a HIV infected speaker, a condom demonstration and
descriptions of other types of protection. Students also practice refusal
skills in a dating context. The lessons are designed to reinforce and
strengthen messages from previous lessons and build students
knowledge. The lessons were interactive and included culture specific
information.
105
Risks targeted by the program: STDs including HIV/AIDS and
pregnancy resulting from risky sexual behavior.
Outputs and outcomes sought by the programme:
Delayed onset of sexual activity
Increased use of condoms
Reduced levels of STDs among school population
Specified LM or Theory of Change:
The intervention was based on social cognitive theory and social
inoculation theory.
QuickTime™ and a
TIFF (Uncompressed) decompressor
are needed to see this picture.
Hypothesised LM or ToC:
Links to Other Programmes:
Postponing Sexual Involvement, Human Sexuality and Health Screening
Curriculum (PSI) has had positive effects on sexual behavior of females.
PSI Program contact:
Renee Jenkins, M.D., Dept. of Pediatrics and child health
Howard University Hospital
2041 Georgia Ave, NW
Washington DC 20060
rjenkins@howard.edu
Quality of Programme: good
LM or TofC: good
Target Population Specified: good
Attention to Ethics: good
Consistency/Fidelity:
106
(B) The Evaluation
Brief Description: the evaluation involved a randomized control trial of
2829 students. Results showed that the intervention delayed sexual
initiation among boys but not girls and significantly affected other
measures for boys but not girls.
Evaluation Type: Randomised control trial involving 19 schools in
Northern California. 2829 sixth graders were tracked for 36 months
between 1997-1999.
Comparison Group Received: general classroom based sex education
lessons.
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Abstinence from sexual activity
Reduced frequency of sexual intercourse
Increased condom use
Reduced STDs transition
LM or Theory of Change Specified by Evaluation:
The intervention is based on social cognition theory and social inoculation
theory.
Results: Outputs:
Results: Outcomes:
Abstinence from sexual activity- boys in the intervention group were
significantly less likely than those in the control group to report ever
having had sex, or having had sex in the last 12 months; this effect
lasted throughout the 3 years. There were no significant effects for girls.
Reduced frequency of sexual intercourse- boys in the intervention group
reported significantly lower numbers of sexual intercourse in the eighth
grade, but these effects diminished by the ninth grade. There were no
significant effects for girls.
Increased condom use- there were no significantly different results for
condom use at last intercourse but few students in the sample were
engaging in recent sexual activity.
107
STDs transition- boys in the intervention exhibited greater knowledge of
HIV and condom related knowledge than control students (P<0.001),
Girls in the intervention group showed significantly greater HIV and
condom knowledge than controls.
Sexual attitudes- Boys in the intervention group had more positive
attitudes towards not having sex (P<0.003) perceived fewer peer norms
supporting sex (P<001), had stronger sexual limits (P<004) and were
less likely to place themselves in situations that could lead to sexual
behaviors (P<0.001).
Girls in the intervention group also perceived fewer peer norms
supporting sexual intercourse (P<0.02) and girls in the intervention
reported significantly fewer unwanted sexual advances after the eighth
grade follow up than control group girls.
Other Evaluation Notes:
Many sex education programs have found it difficult to significantly affect
the sexual behavior of females. Researchers suggest that girls may need
more intense skill building opportunities, more support for handling
coercion and a more supportive social environment (e.g. one that
addresses gender role and peer influences). It is also suggested that the
influence of older boyfriends may have contributed to the lack of effect for
girls and future programs should aim to address this risk factor.
Quality of Evaluation: excellent
Sample: good
Measures: good
Control Group: good (received intervention)
Other Innovation:
Replication:
Citation:
108
C. Contact and Review Information
Internet:
Five principle references:
Coyle, K. K., Kirby, D. B., Marin, B. V., Gomez, C. A., & Gregorich, S. E.
(In Press). Draw the Line/Respect the Line: A randomized trial of a middle
school intervention to reduce sexual risk behaviors. American Journal of
Public Health.
Coyle, K., Marin, B., Gardner, C., Cummings, J., Gomez, C., & Kirby, D.
(2003) Draw the Line/Respect the Line: Setting limits to prevent HIV,
STD, and pregnancy, grade 7. ETR Associates: Scotts Valley, CA.
Coyle, K.K., Kirby, D., Marin, B., Gomez, C., & Gregorich, S. (2000).
Effect of Draw the Line/Respect the Lineon sexual behavior in middle
schools. Santa Cruz: ETR Associates. Unpublished Manuscript. Marin,
B., Coyle, K., Cummings, J., Gardner, C., Gomez, C., & Kirby, D. (2003).
Draw the Line/Respect the Line: Setting limits to prevent HIV, STD, and
pregnancy, grade 8. ETR Associates: Scotts Valley, CA.
Marin, B., Coyle, K., Gomez, C., Jinich, S., & Kirby, D. (2003). Draw the
Line/Respect the Line: Setting limits to prevent HIV, STD, and pregnancy,
grade 6. ETR Associates: Scotts Valley, CA.
Contact Details Progamme:
Program Contact
Karin Coyle, Ph.D.
Evaluator ETR Associates 4 Carbonero Way Scotts Valley, CA 95066
Phone: 831-438-4060
Fax: 800-435-8433
Email: kcoyle@etr.org
Curriculum Contact,
Materials ETR Associates 4 Carbonero Way Scotts Valley, CA 95066
Phone: 800-321-4407
Fax: 800-435-8433
Website: http://www.etr.org
Contact Details: Evaluation:
Evaluation Contact
Doug Kirby, Ph.D. Evaluator Senior Research Scientist ETR Associates 4
Carbonero Way Scotts Valley, CA 95066
Phone: 800-321-4407
109
Fax: 800-435-8433
Email: dougk@etr.org
First review: Helen
Second review:
110
Programme: Early Intervention in Reading (EIR)
A: The Programme
Programme Type: Early Intervention Programme
Brief Description: The Early Intervention in Reading Program (EIR) is a
small-group intervention for struggling readers that is used within the
regular classroom.
Scope: covers north central states students in kindergarten through
grade 4.
Target Population: kindergarten to grade 4 age group.
Longer Description: Regular classroom teachers carry out the program,
usually with the help of instructional aides or older students. EIR is
designed to help kindergarten and first-grade students succeed in school
and to help children continue to make good progress in reading in grades
2 through 4. Kindergarten is a whole class literature-based emergent
literacy/oral language program with small group follow-up for children
who need extra help. Children in first and second grade receive 20 to 30
minutes a day of instruction as a portion of the school’s regular reading
program, with a focus on word recognition, fluency (reading with speed,
accuracy and proper expression), and comprehension instruction.
Risks targeted by the programme: children struggling with literacy
and thereby at risk of educational failure.
Outputs and outcomes sought by the programme: percentage
increase in pupils succeeding in school and performing at grade level.
111
Specified LM or Theory of Change: None stated
Hypothesised LM or ToC: boosting confidence of children with reading
problems by enhancing ability will increase interest in school generally
and improve academic outcomes later on.
Links to Other Programmes: none known
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: n/k
Consistency/Fidelity: Good
112
(B) The Evaluation
Brief Description: Evaluation in two stages; Taylor et al. (1997)
evaluated EIR in a sample of second-grade students from a school in St.
Paul, Minnesota. Taylor et al. (2002) studied EIR among first-grade
students in two intermediate school districts located in the north-central
United States.
Evaluation Type: non-randomised controlled study
Comparison Group Received: Control students received the school’s
regular reading program, which included 90 to 120 minutes a day of
literacy instruction.
Outputs Specified by Evaluation: none.
Outcomes Specified by Evaluation: Outcomes that were assessed
included reading speed and number of words read correctly in a story
passage, accuracy in the retelling of a story passage, the percentage of
correct answers to reading comprehension questions related to the
passage, and the percentage of children who could read at a primer level
or higher with at least 93 percent accuracy. Student’s scores on a
phonemic-awareness test given at the beginning of the school year were
used as covariates in the analyses.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs:
Results: Outcomes:

Taylor et al. (1997) reported:
Significantly more children in the intervention-plus-tutoring
group than in the control group were reading at grade level by
the end of second grade. By the end of the school year (in May),
75 percent of the EIR-plus-tutoring group, less than 30 percent
of the EIR-only group, and none of the control group students
could read a selected passage from the second-grade basal
reader with at least 90 percent word-recognition accuracy.
113

The EIR-plus-tutoring group scored significantly higher than the
control group on the Metropolitan Achievement Test, with
percentile rankings of 19 and 8, respectively. The EIR-plustutoring group scored marginally higher than the EIR-only group,
which had a percentile ranking of 11. There were no significant
differences between the EIR-only and the control group.
The study of first-graders by Taylor et al. (2002) found the following at
the end of first grade:

EIR and EIR-plus-tutoring students scored significantly higher
than control students on the number of words read correctly per
minute (effect size 0.34) and on accurate story retelling (effect
size 0.69).

There were no significant differences between EIR and EIR-plustutoring students and control students on the percentage of
correct answers to reading-comprehension questions.

When the sample was limited to the most at-risk students at the
beginning of the school year (defined by scores on a phonemic
awareness test), significantly more EIR and EIR-plus-tutoring
students (81 percent) than control students (50 percent) could
read at a primer level or higher at the end of the school year.
Other Evaluation Notes: This program received a "promising" rating.
The evaluations of the EIR program indicate that treatment-group
students have experienced significant improvements in their reading skills
as compared with no-treatment control group students who have not
experienced similar improvements. The program's "promising" rating is
due to the small samples sizes in the two evaluation studies and the nonequivalent control groups used in the analyses. These factors limit our
ability to know for certain that the program alone caused the observed
positive outcomes.
Quality of Evaluation:
Sample: Poor
Measures: Good
Control Group: Good
Other Innovation: None
Replication: None
Citation: Low
114
C. Contact and Review Information
Internet: www.earlyinterventioninreading.com
Principle references:
1. Taylor, Barbara M., Barbara E. Hanson, Karen Justice-Swanson, and
Susan M. Watts, "Helping Struggling Readers: Linking Small-Group
Intervention with Cross-Age Tutoring," The Reading Teacher, Vol. 51,
No. 3, 1997, pp. 196-209.
2. Taylor, Barbara M., Ceil Critchley, Kristine Paulsen, Kristen MacDonald,
and Heidi Miron, Learning to Teach an Early Reading Intervention
Program Through Internet-Supported Professional Development, Edina,
Minn.: Web Education Company, 2002.
3. Taylor, Barbara M., Ruth A. Short, Brenda A. Shearer, and Barbara J.
Frye, "First Grade Teachers Provide Reading Intervention in the
Classroom," in Richard L. Allington and Sean A. Walmsley, eds., No
Quick Fix: Rethinking Literacy Programs in America’s Elementary
Schools, New York, N.Y.: Teachers College Press,1995, pp. 159-176.
Contact Details Progamme: Ceil Critchley
Early Intervention in Reading Professional Development Program
11293 Hastings Street NE
Blaine, MN 55449
Tel (763) 785-0710
Fax (763) 785-0702
ccritchley@comcast.net
Contact Details: Evaluation: same as contact details above.
First review: Carl Staunton 14/12/2004.
Second review:
115
Programme:
A: The Program Early Childhood Education and Assistance Program
(ECEAP)
Programme Type: Early intervention programme
Brief Description: ECEAP is a community-based, family-focused,
comprehensive, pre-kindergarten program designed to help children and
their families who are in poverty. The program focuses on helping threeand four-year-olds prepare for and succeed in school while helping their
parents’ progress toward self-sufficiency.
Scope: ECEAP operates 260 program sites locally through 35 contractors,
including school districts; educational services districts, local
governments, nonprofits, childcare providers, and tribal organizations.
Target Population: children who are at least 3 years old and are not
yet enrolled in kindergarten and whose families have been at or below
110 percent of the federal poverty level for the past 12 months.
Longer Description: ECEAP is composed of four interactive components:
education, health and nutrition, parent involvement, and family support.
These components collectively identify problems that hinder learning;
provide health screenings and immunizations for children; encourage
parental involvement in the classroom and in the program itself through
local parent-run policy councils; assess family needs and refer families to
community resources; and provide adults with training to improve their
parenting, leadership, and self-sufficiency skills.
Risks targeted by the programme: Mainly children at risk of school
failure due to problems of poverty, also 10% of program slots are
available to children at risk of failure due to other reasons.
116
Outputs and outcomes sought by the programme: Increase the
percentage of children living above the poverty level and to increase the
levels of children’s parents who as former welfare dependents remain
employed after two years.
Specified LM or Theory of Change: None stated.
Hypothesized LM or ToC:
Links to Other Programmes: Headstart, Early Start.
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good.
117
(B) The Evaluation
Brief Description: A longitudinal study completed over 12 years of data
collection and evaluation, in which it followed 1,358 children drawn from
groups selected over three consecutive years beginning in 1988.
Evaluation Type: Longitudinal.
Comparison Group Received: A comparison group of 322 children who
were eligible for the scheme but not served by the program was also
established.
Outputs Specified by Evaluation: None specified.
Outcomes Specified by Evaluation: The study examined ECEAP's
effectiveness in preparing these children to achieve educational success,
and later, to measure family well being, changes in social status and
family resources, and dependence on public assistance.
LM or Theory of Change Specified by Evaluation: None specified.
Results: Outputs:
Results: Outcomes: The Year 8 Longitudinal Study found that:

The fraction of ECEAP families above the poverty level grew from 5
percent at enrolment to 47 percent. The fraction of control group
families above the poverty level grew more modestly over the same
period -- from 47 to 61 percent.
The Years 9 and 10 Study showed that:
 Between enrolment and year 9 of the evaluation, the percent of
ECEAP participants above the poverty level rose from 5 to 57
percent (a ten-fold increase). Over the same period, the growth in
the percent above the poverty level was smaller for the comparison
group (47 percent to 68 percent, a 44 percent increase).
118
Other Evaluation Notes: This program received a “promising” rating
based on the fact that there is only one study that has evaluated the
program so far and the methodology used exhibits some weaknesses. The
design was quasi-experimental, but the comparison group may have
serious flaws. It is composed of children and families who chose to
participate in the comparison group. In some cases, they had the option
of participating in ECEAP; in other cases, they may not have had access
to the program in their geographical area. Also, the treatment group had
much higher rates of poverty at the start of the project than the
comparison group. This may make the comparison families different as a
group from the families who did participate. Furthermore, both the
treatment and the comparison group exhibited relatively high attrition
rates over the period of evaluation.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Poor
Other Innovation:
Replication: None
Citation: Moderate
119
C. Contact and Review Information
Internet: ECEAP_Admin@CTED.wa.gov
Principle references:
1. An Investment in Children and Families: Year 8 Longitudinal
Study Report Northwest Regional Educational Laboratory, Child
and Family Program, December 1999.
2. An Investment in Children and Families: Years 9 & 10
Longitudinal Study Report, Northwest Regional Educational
Laboratory, Child and Family Program, December 2000.
3. An Investment in Children and Families: Year 8 Longitudinal
Study Report Northwest Regional Educational Laboratory, Child
and Family Program, December 1999.
4. An Investment in Children and Families: Years 9 & 10
Longitudinal Study Report, Northwest Regional Educational
Laboratory, Child and Family Program, December 2000.
Contact Details Progamme: Lynne Shanafelt
Managing Director
Early Childhood Education and Assistance Program
906 Columbia Street, SW
PO Box 48350
Olympia, WA 98504-8350
Phone: (360) 725-2830
Fax: 360-586-0489
Contact Details: Evaluation: Tim Speth
Research Associate
Child and Family Program
Northwest Regional Educational Laboratory
101 SW Main Street, Suite 500
Portland, OR 97204
Phone: (503) 275-9551
Fax: 503-275-9152
E-mail: SpethT@nwrel.org
First review: Carl Staunton 13/12/2004.
Second review:
120
Programme: Fast-Track
A: The Programme
Programme Type: Longitudinal intervention (designed to prevent
serious anti-social behaviour and related adolescent problems in three
successive cohorts of high risk children).
Brief Description: The Longitudinal study is a 10-year project, which
aims to prevent anti-social behaviour in those children most at risk. The
children have been exposed to multiple risk factors in their environment
due to inhabiting low income, high crime areas.
Scope: 891 children (445 intervention group, 446 control group)
Target Population: Children attending kindergarten in four areas in the
US were screened (10,000 children). Teacher and parent ratings of
aggressive, disruptive and oppositional behaviour were taken. A
representative sample of children was selected. Children were monitored
from first to tenth grade. Three cohorts were recruited in 1991, 1992 and
1993. Participation rates for year eleven were 80% for the control group
and 85% for the intervention group.
Longer Description:
Particularly intensive intervention takes place at each transition e.g. at
school entry, and from elementary to middle school. The main elements
include:
 Teacher-led classroom curricula (PATHS) a universal intervention
aims to develop emotional concepts, social understanding and selfcontrol. This includes a weekly teacher consultation about
classroom management.
 Parent training groups aiming to develop positive family-school
relationships and to teach parents behaviour management skills
e.g. praise, time-out, and self-restraint.
 Home visits to develop parents problem-solving skills, self-efficacy
and life management
 Child social training groups (Friendship Groups)
 Child tutoring in reading
 Child friendship enhancement in the classroom (Peer Pairing)
These individualized services aim to increase protective factors and
reduce risk factors.
121
Risks targeted by the programme: low income, inhabiting high crime
communities, marital conflict and instability at home. Addresses
classroom risk, school risk and family risk factors.
Outputs and outcomes sought by the programme:


School readiness: socially, emotionally and cognitively
Positive parental contact with school
Specified LM or Theory of Change:
Developmental Theory
Hypothesised LM or ToC:
Links to Other Programmes:
Pre-school PATHS
Mark Greenberg’s website re: www.prevention.psu.edu
Quality of Programme: The programme is of good quality there are
many highly regarded researchers of the prevention field working on the
Fast-Track project.
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
122
(B) The Evaluation
Brief Description: The Fast-Track longitudinal evaluation consists of a
controlled trial, which compares outcomes for 891 participants.
Evaluation Type: Randomised Controlled Trial over ten years of the
outcome differences for the intervention and comparison group.
Comparison Group Received: No information
Outputs Specified by Evaluation:
 Educational activities
 Parental support and training activities
 Social support
Outcomes Specified by Evaluation:
 School Readiness
 Smooth School transition
 Positive family and teacher relations
 Stronger peer relations
 Dilution of risk factors
LM or Theory of Change Specified by Evaluation:
None specified
Results: Outputs:
 Curricula completed
 Home visits and support completed
 Mentoring and Peer Pairing put to work
Results: Outcomes:
 By the end of elementary school, 33% of the intervention group had
decreasing conduct problems, compared with 27% of the control
group
 Placement in special education by the end of elementary school was
one fourth lower in the intervention group than the control group
 By eighth grade 38% of the intervention group boys had been
arrested compared with 42% of the control group
 The Fast-Track programme reduced serious conduct disorder by
over a third, from 27% to 17%.
 37% of the intervention group became free of conduct problems,
compared with 27% of the comparison group
123
Other Evaluation Notes:
Quality of Evaluation: The use of a Randomised Controlled Trial
enhances the quality of the evaluation.
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: Low
124
C. Contact and Review Information
Internet: www.fasttrackproject.org
Five principle references:
Flanagan, K.S., Bierman, K.L., Kam, C., and the Conduct Problems Prevention Research
Group. (2003). Identifying at-risk children at school entry: The usefulness of
multibehavioral problem profiles. Journal of Clinical Child and Adolescent Psychology, 32,
396-407.
Miller-Johnson, S., Coie, J.D., Maumary-Gremaud, A., Bierman, K., and the Conduct
Problems Prevention Research Group. (2002). Peer rejection and aggression and early
starter models of conduct disorder. Journal of Abnormal Child Psychology, 30, 217-230.
Kaplow, J.B., Curran, P.J., Dodge, K.A., and the Conduct Problems Prevention Research
Group. (2002). Child, parent, and peer predictors of early-onset substance use: A
multisite longitudinal study. Journal of Abnormal Child Psychology, 30, 199-216.
Hinshaw, S.P. (2002). Prevention/intervention trials and developmental theory:
Commentary on the Fast Track special section. (Commentary). Journal of Abnormal Child
Psychology, 30, 53-60.
Farmer, A.D., Bierman, K.L., and the Conduct Problems Prevention Research Group.
(2002). Predictors and consequences of aggressive-withdrawn problem profiles in early
grade school. Journal of Clinical and Adolescent Psychology, 31, 299-311.
Contact Details Progamme:
Linda Collins, Director
Methodology Center
LMCollins@psu.edu
Contact Details: Evaluation:
Donald Woolley, Research Analyst
Data Center (Duke)
First review: Emma Sherriff
Second review:
donald.woolley@duke.edu
5-Nov-04
125
Programme: Functional Family Therapy (FFT)
A: The Programme
Programme Type: An outcome-driven prevention/intervention
programme
Brief Description: FFT is a short intervention, which aims to prevent
the onset of delinquency, violence substance use, and behavioural
disorders. As well as treat the problems as they stand.
Scope: No information
Target Population: 11-18 year olds at risk for or presenting
delinquency, violence, substance use, Conduct Disorder, Oppositional
Defiant Disorder, or Disruptive Behaviour Disorder
Longer Description: FFT uses at least 8-12 hours of direct service time
for commonly referred youth and their families, and no more than 26
hours of direct service time for more severe problem situations. There is
flexible delivery of service by one and two persons to clients at their
home, clinic, juvenile court and at time of re-entry from institutional
placement. Interventionists involved include para-professionals under
supervision, trained probation officers, mental health technicians, and
degreed mental health professionals. It enhances protective factors and
reduces risk.
There are five stages: Engagement-boosts youth and family factors
protecting from early programme dropout, Motivation-changes emotional
reactions and beliefs and increases trust, hope and motivation for change,
Assessment-clarifying individual, family system and larger system
relationships, Behaviour Change-communication training, specific tasks
and technical aids, basic parenting skills and Generalization-family case
management is guided by their needs, income levels, and their
relationship with the case manager.
Risks targeted by the programme:
Delinquency, violence, substance use and behavioural disorders.
Outputs and outcomes sought by the programme:
126




To
To
To
To
reduce delinquency
reduce youth violence
reduce substance use
prevent and treat behavioural disorders
Specified LM or Theory of Change:
http://www.fftinc.com/model.php
Hypothesised LM or ToC:
Links to Other Programmes:
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
127
(B) The Evaluation
Brief Description: In this longitudinal evaluation, quantifiable outcomes
in the context of offending behaviour of participants from the yearly trials
from 1973 and 1977 were collected in 1998. Control and Treatment
groups were set up for each year. The cost effectiveness of the
intervention in few of the collective outcomes is established.
Evaluation Type: Longitudinal Randomised Controlled Trial
Comparison Group Received: Nothing
Outputs Specified by Evaluation:


Reduced long-term treatment costs
Reduced arrests
Outcomes Specified by Evaluation:

Reduced recidivism
LM or Theory of Change Specified by Evaluation:
Results: Outputs:


Dramatically reduces the cost of treatment (up to $14,000 per
family)
Compared with no intervention FFT reduces adolescent arrests by
20-60%
Results: Outcomes:


Reduces recidivism for a wide range of juvenile offence patterns
Reduces potential new offending for siblings of participants
Other Evaluation Notes:
Quality of Evaluation: Good
128
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: High
129
C. Contact and Review Information
Internet:
www.fftinc.com
www.ncjrs.org/pdffiles1/ojjdp/184743.pdf
Five principle references:
Alexander, J.F., Pugh, C., Parsons B.V., and Sexton T.L. (2000).
Functional Family Therapy. In Blueprints for Violence Prevention (Book 3),
2d ed., edited by D.S. Elliott. Boulder, CO: Center for the Study and
Prevention of Violence, Institute of Behavioural Science, University of
Colorado.
Barton, C., Alexander, J.F., Waldron, H., Turner, C.W. and Warburton, J.
(1985). Generalizing treatment effects of Functional Family Therapy:
Three replications. American Journal of Family Therapy 13:16-26
Gordon, D.A., Graves, K., and Arbuthnot, J. (1985) The effect of
Functional Family Therapy for delinquents on adult criminal behaviour.
Criminal Justice and Behaviour 22: 60-73
Hansson, K. (1998). Functional Family Therapy replication in Sweden:
Treatment outcome with juvenile delinquents. Paper presented to Eighth
Conference on Treating Addictive Behaviors, Santa Fe, NM.
Sexton, T.L., and Alexander, J.F. (1999). Functional Family Therapy:
Principles of Clinical Intervention, Assessment, and Implementation.
Henderson, NV: RCH Enterprises.
Contact Details Progamme:
Holly deMaranville, Communications Coordinator
Functional Family Therapy, LLC
2538 57th Avenue, SW
Seattle, WA 98116
Phone: (206) 369-5894
Fax: (206) 664-6230
Email: hollyfft@attbi.com
Contact Details: Evaluation:
James F. Alexander, Ph.D.
130
Department of Psychology
University of Utah
390 S 1530 E, Room 502
Salt Lake City, UT 84112
Phone: (801) 581-6538
Fax: (801) 581-5841
Email: jfafft@psych.utah.edu
First review: Emma Sherriff
Second review:
11-Nov-04
131
Programme: Focus on kids
A: The Programme
Programme Type: HIV/AIDS and other STD prevention program, early
intervention behavior.
Brief Description: Focus on Kids aimed to prevent at-risk youth from
acquiring HIV by increasing their understanding if HIV transition and
teaching them about prevention such as abstinence and condom use.
Scope: the intervention was held in 9 recreation centers in urban, lowincome communities of Baltimore, Maryland.
Target Population:
The intervention served low-income African American youths aged 9-15.
Some were in school others had dropped out. Over half of the
participants were male and 36% had already had sexual intercourse.
Longer Description:
Youths were recruited at community recreation centers as this was
believed to be where the most at risk children would be accessible.
Youths were able to select groups of friends of the same gender to form
friendship groups and spend 8 90-minute sessions working together on
the program. Adult facilitators run each session, and youths are given
talks, watch videos and perform role-plays and discussions relating to
sexual behavior and STDs. Participants are taught that abstinence and
avoiding drugs are the only certain ways to avoid HIV infection. They
also learn about the effectiveness of condoms and other contraceptives in
preventing pregnancy, HIV and other STDs.
Risks targeted by the program: the program targets youths who may
already be having sexual intercourse and are most at risk of acquiring
STDs, by increasing their understanding of transition. It aims to prevent
STDs, drug abuse, and unwanted pregnancy among teenagers.
Outputs and outcomes sought by the programme:
 Increased knowledge of STD/HIV transition
132

Increased use of prevention strategies such as abstinence and
condom use
Specified LM or Theory of Change:
The intervention is based on the protection motivation theory. This
theory posits that at-risk adolescents can prevent HIV transition if they
understand the risks and consequences of their behaviors and have
considered strategies to for avoiding risky sexual behaviors.
Adolescents participate in role-playing and small group discussions about
topics such as saying “No” to sex. Using the SODA decision making
model (Stop and state the problem; consider the Options; Decide and
choose the best solution; Act on your decision.) Teens were taught to
think through risky situations and consider the potential consequences of
their actions.
Hypothesized LM or ToC:
Links to Other Programmes:
Quality of Programme: good
LM or TofC: good
Target Population Specified: Specific
Attention to Ethics:
Consistency/Fidelity:
133
(B) The Evaluation
Brief Description: 383 youths were matched according to common
characteristics. 206 were assigned to the program group while 177 were
in the control group. All youths were African American and the average
age was 11.3 years old. Participants were followed up at 6 and 12
months.
Evaluation Type: random allocation
Comparison Group Received: none
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
 Increased knowledge of STD/HIV transition
 Increased use of prevention strategies such as abstinence and
condom use
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:





Program group teens had more positive condom use outcomes than
did control group teens.
At 6 months program participants also perceived greater risks of
not using condoms and were more likely to report condom use
intentions (3.4 program versus 2.9 control on a one to five scale.)
Program youths were more likely to report using condoms the last
time they had sex (85% program, 61% control)
Participants did not differ on their knowledge of HIV prevention six
months after the program ended
There were no significant differences between the groups after 12
months, suggesting the need for “booster” sessions.
134
Other Evaluation Notes:
Researchers on the program identified that the most important way to
engage youths in the program is to make it enjoyable, it is less important
where the program is run. They also found that educating parents about
the content of the program and why it is needed increases their support
and involvement. In Baltimore, program staff developed a parent
education session that prepared parents to be able to answer any
questions their children had about session topics.
Quality of Evaluation: good
Sample: good
Measures: good
Control Group: no intervention
Other Innovation:
Replication: being replicated in rural West Virginia and the Bahamas
Citation:
135
C. Contact and Review Information
Internet:
Five principle references:
Akers, D.D. (2002). Focus on Kids: An adolescent HIV risk prevention
program, user’s guide. Los Altos, CA: PASHA/Sociometrics.
Children’s Television Workshop (CTW). (1992). What kids want to know
about sex & growing up. Santa Cruz, CA: ETR Associates.
Findings of scientific misconduct, 68 Fed. Reg. 67,449 (Dec. 2, 2003).
Mitchell, S. (2003, December 8). HHS: Faulty research removed two
years ago. United Press International. Retrieved December 11, 2003,
from http://www.upi.com/view.cfm?StoryID=20031205025409-2529r
Stanton, B.F, Xiaoming, L., Ricardo, I., Galbraith, J., Feigelman, S., &
Kaljee, L. (1996). A randomized, controlled effectiveness trial of an AIDS
prevention program for low-income African American youths. Archive of
Pediatric Adolescent Medicine, 150(4): 363–372.
Stanton, B., Fang, X., Xiaoming, L., Feigelman, S., Galbraith, J., &
Ricardo, I. (1997). Evolution of risk behaviors over 2 years among a
cohort of urban African-American adolescents. Archive of Pediatric
Adolescent Medicine, 151(4): 398–406.
Contact Details Progamme:
Program and Evaluation Contact
Dr. Bonita Stanton, M.D. Evaluator Chair, Department of Pediatrics Wayne
State University — Medicine Pediatrics Children’s Hospital Room 140 540
E. Canfield Detroit, MI 48201 Phone: 313-745-5870 Email:
ap1972@wayne.edu
Curriculum Contact,
Materials Program Archive on Sexuality, Health, and Adolescence (PASHA)
Sociometrics Corporation 170 State Street, Suite 260 Los Altos, CA
94022-2812 Phone: 650-949-3282 Fax: 650-949-3299 E-mail:
socio@socio.com Website: http://www.socio.com/pasha.htm Cost: $265
Training Contact ETR Associates 5522 Scotts Valley Drive Scotts Valley,
CA 95066 Phone: 800-321-4407 Fax: 800-435-8433 Email:
susanb@etr.org Website: http://www.etr.org
136
Contact Details: Evaluation:
First review: Helen
Second review:
137
Programme: Gang Resistance Education and Training (G.R.E.A.T)
A: The Programme
Programme Type: Prevention program
Brief Description: The objective of the nine-week curriculum is to
reduce gang activity through teaching students the consequences of gang
involvement, as well as incorporating life skills and problem-solving
techniques.
Scope: The Gang Resistance Education and Training (G.R.E.A.T.)
program was originally developed in 1991 by police officers from the
Phoenix metropolitan area and agents of the Bureau of Alcohol, Tobacco
and Firearms to address gang violence.
Target Population: Middle school students, primarily 13 year olds, who
may live in or attend schools in areas that are at risk for gang
involvement.
Longer Description: The curriculum is offered once a week, in the
schools, to middle school students, with a primary focus on seventh
graders. The program utilizes uniformed police officers, who have been
specially trained in the G.R.E.A.T. curriculum, to work with students
through nine lessons. The curriculum also calls for specifically discussing
gang issues and their effects on people’s lives.
Risks targeted by the programme: students who live in areas or
attend schools that present a risk for gang involvement.
Outputs and outcomes sought by the programme: Outputs include
the percentage increase of juveniles who do not engage in violent
behaviour within certain communities.
Specified LM or Theory of Change: None specified.
Hypothesised LM or ToC: greater commitment to peers encourages pro
social as opposed to anti social behaviour.
Links to Other Programmes: none known
138
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
139
(B) The Evaluation
Brief Description: The G.R.E.A.T. program has been evaluated several
times since its inception. In 1995, Esbensen and Osgood used a crosssectional design to look at two ex-post facto comparison groups. Eighth
graders were surveyed in order to allow for a one-year follow-up time and
ensure that none of the surveyed students were currently in the program.
There were 11 cross-sectional evaluation sites (Las Cruces, New Mexico;
Omaha; Phoenix; Philadelphia; Kansas City, Missouri; Milwaukee;
Orlando; Will County, Illinois; Providence, Rhode Island; Pocatello, Idaho;
and Torrance, California). This was a post-test comparison of students
who had and had not participated in the G.R.E.A.T. program. The schools
and teachers had decided whether to offer the program and the
researchers came in only after the fact. Researchers randomly chose
classrooms in which the program had been offered, which were then the
treatment group, and chose classrooms in which there had been no gangrelated curriculum to be the comparison group. Only one of the three
evaluations compared groups of students that went through the program
to another group that did not.
Evaluation Type: Cross sectional and random controlled trials.
Comparison Group Received: nothing
Outputs Specified by Evaluation: None stated
Outcomes Specified by Evaluation: Primarily to test whether gang
affiliation had decreased. Also to see if parent relationships and pro-social
behaviours had increased.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs: None stated
Results: Outcomes: The program effect is statistically significant and
shows that the G.R.E.A.T. program participants were more likely never to
140
have been the victim of a crime, have negative views about gangs, have
positive attitudes toward police, have pro-social peers, and be less risk
seeking. However, the magnitude of the positive effects is small.

The effects of the G.R.E.A.T. program do not really become
apparent until three to four years after the program is
administered, perhaps because behavioral change may not be
noticeable in the short-run. The authors offer two possible
explanations as to why this lag seems to happen: (1)
adolescents experience ambiguity with regard to appropriate
attitudes and behaviors and (2) the stress of moving into high
school.
Palumbo and Ferguson (1995) found:

There was a significant increase in resistance skills in terms of
being able to say no to joining a gang between the pre- and
post-test, with 59 percent at the pre-test saying they could resist
and 67 percent at the post-test saying they could resist.

There was a significant but small decrease in the percentage of
students who said they fought with their parents between the
pre- and post-test, with 48 percent having fought with parents at
the pre-test and 43 percent having done so at the post-test.
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None known
Citation: Low
141
C. Contact and Review Information
Internet: www.atf.treas.gov/great
Principle references:
1. Esbensen, F. A., and D. Osgood, Gang Resistance Education and
Training (G.R.E.A.T.): Results from the National Evaluation,
Journal of Research in Crime and Delinquency, Vol. 36, No. 2, pp.
194-225, 1999.
2. Esbensen, F.A., Osgood, D., Taylor, T., et al., How Great is
G.R.E.A.T.? Results from a Longitudinal Quasi-Experimental
Design, Criminology and Public Policy, Vol. 1, No. 1, pp. 87-118,
2001.
3. Palumbo, D., and J. Ferguson, Evaluating Gang Resistance
Education and Training (G.R.E.A.T.): Is the Impact the Same as
That of Drug Abuse Resistance Education (DARE)?, Evaluation
Review, Vol. 19, pp. 591-619, 1995.
Contact Details Progamme: Gang Resistance Education and Training Program
Federal Bureau of Alcohol, Tobacco and Firearms
Washington, DC 20531
www.atf.treas.gov/great
phone: (202) 927-2160
Toll free: 1 (800) 726-7070
Fax: (202) 927-3180
great@atfhq.atf.treas.gov
Contact Details: Evaluation: as above
First review: Carl Staunton 01/12/2004
Second review:
142
Programme: Gang Resistance Education and Training (G.R.E.A.T)
A: The Programme
Programme Type: Prevention program
Brief Description: The objective of the nine-week curriculum is to
reduce gang activity through teaching students the consequences of gang
involvement, as well as incorporating life skills and problem-solving
techniques.
Scope: The Gang Resistance Education and Training (G.R.E.A.T.)
program was originally developed in 1991 by police officers from the
Phoenix metropolitan area and agents of the Bureau of Alcohol, Tobacco
and Firearms to address gang violence.
Target Population: Middle school students, primarily 13 year olds, who
may live in or attend schools in areas that are at risk for gang
involvement.
Longer Description: The curriculum is offered once a week, in the
schools, to middle school students, with a primary focus on seventh
graders. The program utilizes uniformed police officers, who have been
specially trained in the G.R.E.A.T. curriculum, to work with students
through nine lessons. The curriculum also calls for specifically discussing
gang issues and their effects on people’s lives.
Risks targeted by the programme: students who live in areas or
attend schools that present a risk for gang involvement.
Outputs and outcomes sought by the programme: Outputs include
the percentage increase of juveniles who do not engage in violent
behaviour within certain communities.
Specified LM or Theory of Change: None specified.
Hypothesised LM or ToC: greater commitment to peers encourages pro
social as opposed to anti social behaviour.
Links to Other Programmes: none known
143
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
144
(B) The Evaluation
Brief Description: The G.R.E.A.T. program has been evaluated several
times since its inception. In 1995, Esbensen and Osgood used a crosssectional design to look at two ex-post facto comparison groups. Eighth
graders were surveyed in order to allow for a one-year follow-up time and
ensure that none of the surveyed students were currently in the program.
There were 11 cross-sectional evaluation sites (Las Cruces, New Mexico;
Omaha; Phoenix; Philadelphia; Kansas City, Missouri; Milwaukee;
Orlando; Will County, Illinois; Providence, Rhode Island; Pocatello, Idaho;
and Torrance, California). This was a post-test comparison of students
who had and had not participated in the G.R.E.A.T. program. The schools
and teachers had decided whether to offer the program and the
researchers came in only after the fact. Researchers randomly chose
classrooms in which the program had been offered, which were then the
treatment group, and chose classrooms in which there had been no gangrelated curriculum to be the comparison group. Only one of the three
evaluations compared groups of students that went through the program
to another group that did not.
Evaluation Type: Cross sectional and random controlled trials.
Comparison Group Received: nothing
Outputs Specified by Evaluation: None stated
Outcomes Specified by Evaluation: Primarily to test whether gang
affiliation had decreased. Also to see if parent relationships and pro-social
behaviours had increased.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs: None stated
Results: Outcomes: The program effect is statistically significant and
shows that the G.R.E.A.T. program participants were more likely never to
145
have been the victim of a crime, have negative views about gangs, have
positive attitudes toward police, have pro-social peers, and be less risk
seeking. However, the magnitude of the positive effects is small.

The effects of the G.R.E.A.T. program do not really become
apparent until three to four years after the program is
administered, perhaps because behavioral change may not be
noticeable in the short-run. The authors offer two possible
explanations as to why this lag seems to happen: (1)
adolescents experience ambiguity with regard to appropriate
attitudes and behaviors and (2) the stress of moving into high
school.
Palumbo and Ferguson (1995) found:

There was a significant increase in resistance skills in terms of
being able to say no to joining a gang between the pre- and
post-test, with 59 percent at the pre-test saying they could resist
and 67 percent at the post-test saying they could resist.

There was a significant but small decrease in the percentage of
students who said they fought with their parents between the
pre- and post-test, with 48 percent having fought with parents at
the pre-test and 43 percent having done so at the post-test.
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None known
Citation: Low
146
C. Contact and Review Information
Internet: www.atf.treas.gov/great
Principle references:
4. Esbensen, F. A., and D. Osgood, Gang Resistance Education and
Training (G.R.E.A.T.): Results from the National Evaluation,
Journal of Research in Crime and Delinquency, Vol. 36, No. 2, pp.
194-225, 1999.
5. Esbensen, F.A., Osgood, D., Taylor, T., et al., How Great is
G.R.E.A.T.? Results from a Longitudinal Quasi-Experimental
Design, Criminology and Public Policy, Vol. 1, No. 1, pp. 87-118,
2001.
6. Palumbo, D., and J. Ferguson, Evaluating Gang Resistance
Education and Training (G.R.E.A.T.): Is the Impact the Same as
That of Drug Abuse Resistance Education (DARE)?, Evaluation
Review, Vol. 19, pp. 591-619, 1995.
Contact Details Progamme: Gang Resistance Education and Training Program
Federal Bureau of Alcohol, Tobacco and Firearms
Washington, DC 20531
www.atf.treas.gov/great
phone: (202) 927-2160
Toll free: 1 (800) 726-7070
Fax: (202) 927-3180
great@atfhq.atf.treas.gov
Contact Details: Evaluation: as above
First review: Carl Staunton 01/12/2004
Second review:
147
Programme: Hawaii Healthy Start
A: The Programme
Programme Type: Hawaii Healthy Start Program (HSP) is an abuse
prevention intervention
Brief Description:
The program uses home visitors to help families turn away from abusive
and neglectful parenting behaviors and toward parenting that promotes
healthy child development. The goal of HSP is to identify vulnerable
families before their day-to-day stresses, isolation, and lack of parenting
knowledge give rise to abusive and neglectful parenting behaviors.
Scope: Originally, the study was piloted with 234 at risk families in Oahu.
Versions of the program have since been exported to the mainland and a
recent evaluation of HSP in Oahu had 373 program families. The program
began in 1975 and funding has increased annually since 1989 to 1995.
Target Population: Families at risk of abusive or neglectful parenting
styles who have newborn children.
Longer Description: Families identified as at risk of child abuse and
neglect receive home visits to help mothers cope with the stresses of child
rearing. Professional home visitors first establish trusting relationships
with the families and seek to resolve immediate problems. They help
parents to identify and build on family strengths and help link families
with needed services, such as housing, income and nutritional assistance,
childcare, and educational and vocational training.
At the same time, home visitors work to promote child health and
development by providing parenting education, modeling effective parentchild interaction, and ensuring that each child had a continuing source of
pediatric primary care.
Risks targeted by the program: The program targets abusive and
neglectful parenting.
148
Outputs and outcomes sought by the programme:
 Better family functioning through improving parental life course,
home environment and parenting behavior.
 Child has improved health and development
 No child abuse or neglect
Specified LM or Theory of Change:
Families with risk factors such as mothers age and education, substance
use, domestic violence etc. enter the Healthy start program. By having
home visitation and a good role model, family functioning is improved,
the family has better access to other services and improved quality of
care for the children. Improved use of community prevention and early
intervention services helps to improve other aspects of the family
situation and combined with HSP, lead to the above outcomes.
Hypothesised LM or ToC:
Links to Other Programmes:
Healthy Families America (HFA) is based on the HSP but has been
exported to mainland America.
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: good
Attention to Ethics:
Consistency/Fidelity: good
149
(B) The Evaluation
Brief Description: Initially a pilot study was run to evaluate HSP, more
recently a larger study has been conducted to evaluate the success of the
program in reducing neglect and abuse. Both of which have had positive
outcomes.
Evaluation Type: randomized control trial of the HSP group, a main
control group and a testing control group. There were 373 families in the
HSP group, 270 in the main control group, and 41 in the testing control.
Comparison Group Received: Other existing intervention
Outputs Specified by Evaluation:
 Better use of community services
Outcomes Specified by Evaluation:



Better family functioning through improving parental life course,
home environment and parenting behavior.
Child has improved health and development
No child abuse or neglect
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
HSP was successful in linking families with pediatric care.
Results: Outcomes:
HSP was successful in improving maternal parenting efficacy, decreasing
maternal parenting stress, promoting the use of non-violent discipline and
decreasing injuries resulting from partner violence in the home –
consequently, it was successful in reducing levels of abuse and neglect.
However no overall positive program impact was found at the two year
follow up in terms of child health care, maternal life skills, mental health,
social support or substance use as well as other factors.
Furthermore, of the three agencies running the program, there were
agency specific effects on several outcomes including parent child
interaction, child development maternal confidence in adult relationships
and partner violence.
150
Other Evaluation Notes:
Quality of Evaluation: Good
Sample: good
Measures: Good
Control Group: good
Other Innovation:
Replication: Good
Citation:
151
C. Contact and Review Information
Internet:
Five principle references:
Contact Details Progamme:
Contact Details: Evaluation:
First review: Helen
Second review:
152
Programme:
A: The Programme Know Your Body (KYB)
Programme Type: Prevention program (Health).
Brief Description: Know Your Body (KYB), as evaluated and reported
here, was a comprehensive, skills-based health promotion program that
targeted students in the fourth to ninth grades. The goal of KYB was to
teach students the necessary knowledge, attitudes, skills, and experience
to practice positive health behaviours and reduce their risk of future
illness.
Scope: Has been operational since the 1980s in northern U.S states.
Target Population: As evaluated, the program targeted fourth-grade to
ninth-grade students. Currently the program targets elementary school
students in grades K-6.
Longer Description: The KYB curriculum focused on voluntary
behavioural changes in the areas of cigarette smoking, physical fitness,
and diet, and was taught by the regular classroom teacher for
approximately two hours per week throughout the school year. The
cigarette smoking prevention component taught students the skills
necessary to resist pressures to smoke cigarettes, while the physical
fitness component helped students to begin a regular program of
endurance exercise designed to improve cardiovascular fitness. The
nutritional component of the curriculum focused on encouraging students
to adopt the American Heart Association’s "prudent diet," which consists
of decreasing the consumption of total and saturated fat, cholesterol,
sodium, and refined sugar; increasing the consumption of complex
carbohydrates and fibre; increasing the consumption ratio of
polyunsaturated fat to saturated fat; and maintaining an ideal body
weight.
153
Risks targeted by the programme: future health risks caused through
poor diet, smoking and taking drugs.
Outputs and outcomes sought by the programme: Principally the
percentage reduction of youths using alcohol, tobacco and drugs are
outputs sought and outcomes sought are youths who choose healthy
lifestyles.
Specified LM or Theory of Change: None
Hypothesised LM or ToC:
Links to Other Programmes: None known
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: n/k
Consistency/Fidelity: Good
154
(B) The Evaluation
Brief Description: The Know Your Body program has been evaluated in
four major studies, all of which focused on the effects of the program on
chronic disease, cardiovascular risks, and cancer-related risk factors,
including smoking. Only smoking-related results from two major studies
are reported here because the other studies of KYB experienced
methodological problems that prevented their inclusion.
Evaluation Type: 4 randomised controlled trials
Comparison Group Received: nothing
Outputs Specified by Evaluation: In terms of smoking prevention,
levels of saliva cotinine and serum thiocyanate (associated with smoking)
were measured and reductions compared to control group studied.
Outcomes Specified by Evaluation: For the purposes of these anti
smoking based evaluations in which the methodology was unproblematic,
evaluation was more output based and looked at biological evidence of
tobacco cessation/reduction.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs: The Bronx study (Walter et al., 1985; Walter et al.,
1988) found:

Significant differences between the intervention and control groups
at the one-year follow-up. From baseline to follow-up, the average
level of serum thiocyanate detected in KYB students decreased by 5
percent, while levels of serum thiocyanate for control group
students increased by 9 percent.
 No significant differences between the intervention and control
group at the five-year follow-up.
The Westchester County study (Walter et al., 1986; Walter et al., 1987;
Walter et al., 1988; Walter et al., 1989) found:
155




Significant differences between the intervention group and control
students at the one-year follow-up, with intervention students
demonstrating significantly lower levels of serum thiocyanate than
control students. From baseline to follow-up, serum thiocyanate
levels for the intervention group increased by 2 percent, while the
control group showed an increase of 15 percent.
No statistically significant differences between the intervention and
control groups at the three-year or five-year follow-up.
At the six-year follow-up, when the students were in the ninth
grade, the rate of cigarette smoking as determined by thiocyanate
levels was 73 percent less among intervention group students than
among control group students. While 13.1 percent of participants in
the control group were biochemically classified as current cigarette
smokers, only 3.5 percent of participants in the KYB group were
classified as such.
When analyzed separately for gender, the intervention was found to
be effective only for male students.
Results: Outcomes: N/A for these evaluations.
Other Evaluation Notes: This program received a "promising" rating.
The evaluations used a randomized experimental design and longitudinal
follow-up, and participants in the majority of the studies experienced
significantly reduced levels of smoking (as measured by serum
thiocyanate levels) compared with the control group. However, findings
were mixed at different evaluation times between the two major studies.
Quality of Evaluation: based on selective rigorous evaluations
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: Moderate (cited on UK NHS website)
156
C. Contact and Review Information
Internet: e-Mail: lzenner@kendallhunt.com
Five principle references:
1. Taggart, Virginia S., Patricia J. Bush, Alan E. Zuckerman, and Patricia K.
Theiss, "A Process Evaluation of the District of Columbia ‘Know Your Body’
Project," Journal of School Health, Vol. 60, No. 2, 1990, pp. 60-66.
2. Walter, Heather J., Albert Hofman, Linda T. Barrett, Patricia A. Connelly,
Kathryn L. Kost, Ellen H. Walk, and Rebecca Patterson, "Primary
Prevention of Cardiovascular Disease Among Children: Three-Year Results
of a Randomized Intervention Trial,"
in B. Hetzel and G. S. Berenson,
eds., Cardiovascular Risk Factors in Childhood: Epidemiology and
Prevention, New York, NY: Elsevier Science Publishers B.V. (Biomedical
Division), 1987.
3. Walter, Heather J., Albert Hofman, Patricia A. Connelly, Linda T. Barrett,
and Kathryn L. Kost, "Coronary Heart Disease Prevention in Childhood:
One-Year Results of a Randomized Intervention Study," American
Journal of Preventive Medicine, Vol. 2, No. 4, 1986, pp. 239-245.
4. Walter, Heather J., Albert Hofman, Patricia A. Connelly, Linda T. Barrett,
and Kathryn L. Kost, "Primary Prevention of Chronic Disease in Childhood:
Changes in Risk Factors After One Year of Intervention," American
Journal of Epidemiology, Vol. 122, No. 5, 1985, pp. 772-781.
5. Walter, Heather J., Albert Hofman, Roger D. Vaughan, and Ernst L.
Wynder, "Modification of Risk Factors for Coronary Heart Disease," The
New England Journal of Medicine, Vol. 318, No. 17, 1988, pp. 10931100.
Contact Details Progamme:
Lisa M. Zenner
Senior Inside Sales Representative
College Division
Kendall/Hunt Publishing Company
4050 Westmark Drive
P.O. Box 1940
Dubuque, Iowa 52004-1840
1-800-247-3458
fax: 563-589-1161
Contact Details: Evaluation:
First review: Carl Staunton 16/12/2004
Second review:
157
Programme: Kids on the Move Programme (Atlanta, Georgia)
A: The Programme
Programme Type:
Early intervention programme designed to develop healthy eating and
fitness behaviours in children at risk of developing cardiovascular
problems due to obesity or limited opportunities for physical activity.
Brief Description:
Developed by Children’s Healthcare of Atlanta, this early intervention
programme introduces health education and structured active play to
children between the ages of 8 and 12, with the aim of reducing risk
factors for cardiovascular health problems. Children participating in the
programme gain an understanding of key nutrition topics, for example
healthy food choices and the risks associated with tobacco use.
Scope:
240 participants received the intervention over three years (1999-2002),
in 17 sites across Georgia.
Target Population:
Elementary school pupils, aged between 8 and 12.
Longer Description:
The KOTM programme comprises of 75 minute sessions, delivered three
times a week, over eight weeks and after school. These sessions consist
of three main activities: ‘warm-up’, ‘warm-down’ and 25 minutes of
structured active play. During the ‘warm-up’ and ‘warm-down’ children
are exposed to health messages that increase their knowledge and
understanding of healthy eating, avoidance of tobacco use and the
importance of daily physical activity, in addition to many other health
related issues discussed in the know your body curriculum resource. The
structured active play consists of games such as relay races, jumping
rope, “kick-ball” and forms of physical fitness testing such as the sit and
reach test and bleep/pacer test. Participants are also given a handout
concerning the health topic they have learnt about during a session to
take home and share with their families.
It is hoped that this form of education and opportunity for physical
exercise will decrease the risks associated with the development of heart
disease.
158
Risks targeted by the programme:
Obesity
Limited opportunities for physical exercise
Unhealthy lifestyle choices
Outputs and outcomes sought by the programme:
Improved healthy eating habits and behaviours
Improved physical fitness
Specified LM or Theory of Change:
Hypothesised LM or ToC:
The programme delivers the knowledge and skills required by children in
order to better equip them to identify and reduce the risk factors for
developing cardiovascular disease in their lifestyle choices and eating
habits. The programme also provides regular opportunities for physical
activity which helps increase the fitness of participating children and helps
reduce the risk of heart disease.
Links to Other Programmes:
There are several other ‘Kids on the move’ programmes, with different
target populations and aims. For example, the KOTM early intervention
services in Northern Utah County accessible on the web via the following
address: http://www.kotm.org/about.htm
In addition, the Seattle Nutritition Action Consortium pilot Kids on the
Move programme delivered to children of low income families in the
greater Seattle area.
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
159
(B) The Evaluation
Brief Description:
Pre-test and post-test data were obtained from physical testing, and
information with regards to perceived behavioural change was obtained
from post-programme telephone interviews with the parents of the 76
self-selelcted participants.
Evaluation Type:
Quasi-experimental.
Comparison Group Received:
No comparison group
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Increased fitness
Increased flexibility
Increased water intake
Eating breakfast
Eating more fruit and vegetables
Less time spent watching TV and playing video games.
Increased activity levels
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
- 59% participants displayed significant improvements in the pacer test.
- 63% of children experienced significantly improved flexibility on the sit
and reach test (p<.001).
According to the parents of children participating in KOTM:
- 71% observed an increase in amount of water child was drinking.
- 43% noticed a positive change in child’s breakfast eating habits.
- 90% children were requesting/ eating more fruits and vegetables.
- 57% decreased the amount of time they spent watching TV or
playing video games.
- 68% noticed an increase in activity levels.
Other Evaluation Notes:
160
Quality of Evaluation: Poor
Sample: Poor
Measures: Good
Control Group: Poor
Other Innovation:
Replication:
Citation: Low
161
C. Contact and Review Information
Internet:
www.comminit.com/evaluations/steval/sld-2163.html
www.hfrp.org
www.actionforhealthykids.org
www.choa.org
Five principle references:
Henley, W.Z. et al. (2001). Kids on the move: An after-school fitness and
nutrition program for children aged 9-12. The 129th Annual Meeting of
APHA, Monday October 22, 2001 [WWW]
http://apha.confex.com/apha/129am/techprogram/paper_25602.htm
[accessed 13/12/2004]
Naran, R. (2002). Kids on the Move Evaluation Report. Atlanta, GA:
Children’s Healthcare.
Contact Details Progamme:
Ann Walsh, R.D.
Children’s Healthcare of Atlanta
Community Health Development & Advocacy Department
1655 Tullie Circle
Atlanta, GA 30329
Tel: 404-417-5661
Email: ann.walsh@choa.org
Contact Details: Evaluation:
Wytaria Z. Henley, BS, MBA
Children’s Healthcare of Atlanta
Community Health Devlopment & Advocacy Department
1699 Tullie Circle
Atlanta, GA 30329
Tel: 404-417-5674
Email: rachana.naran@choa.org
First review:
Second review:
162
Programme: Life Skills Training (LST)
A: The Programme
Programme Type: Substance abuse prevention programme (targets all
children at risk of exposure to addictive substances)
Brief Description: There are 15 sessions in year one, 10 sessions in
year 2 and 5 sessions in year 3, run by teachers, peer leaders and
professionals. Sessions focus on drug resistance, personal selfmanagement, and social skills.
Scope: Not indicated
Target Population: Elementary and middle/junior high school students
in inner city, suburban and rural populations.
Longer Description: The programme is made up of three main
components. Firstly, Drug Resistance skills enable young people to
recognise and acknowledge common misconceptions about tobacco,
alcohol and drug use. Participants receive coaching in resistance
strategies to put into practice when faced with peer and media pressure.
Secondly, Personal Self-Management Skills how to examine their selfimage and how it impacts on their behaviour. The young people are
encouraged to set goals and their personal progress is monitored.
Additionally they are encouraged to look at their day-to-day decisionmaking and how others may affect this, analyse problem situations and
consider the consequences before making these decisions. With a view to
reducing stress and anxiety, and taking a positive attitude to overcome
personal challenges. Thirdly, General Social Skills teach the students skills
to overcome shyness, communicate effectively and avoid
misunderstandings. Training in initiating conversations, handling social
requests, utilizing verbal and non-verbal assertiveness skills to make or
refuse requests. They will also be shown that they have choices other
than aggression and passivity when making difficult choices.
Risks targeted by the programme:
Peer and Media influence on young people
Outputs and outcomes sought by the programme:
163




To teach prevention-related information
To promote anti-drug norms
To teach drug refusal skills
To foster the development of personal management skills and
general social skills
Specified LM or Theory of Change:
Hypothesised LM or ToC:
Teaching young people how to prevent substance addiction, promoting
anti-drug attitudes, teaching refusal skills and effective social skills will
reduce the proportion of young people using these substances early on in
life and thereby reducing the likelihood of addiction in adulthood.
Links to Other Programmes:
Quality of Programme: High
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
164
(B) The Evaluation
Brief Description: Longitudinal evaluation featuring the follow-up results
of four published studies
Evaluation Type: Longitudinal Randomised Controlled Trial (comparison
groups randomly selected from middle/high school students not
participating in the programme) There are three types of evaluation tools:
Pre and post-tests, which measure program outcomes. Fidelity Check
Lists, which evaluate program implementation by classroom teachers, and
Classroom Assessments, which are quizzes that teachers can give
students for each lesson.
Comparison Group Received: Nothing
Outputs Specified by Evaluation:



Drug Resistance activities
Self-management activities
Social Skills activities
Outcomes Specified by Evaluation:



Reduction in Tobacco, Alcohol and Marijuana use
Reduction in Polydrug use
Reduction in use of Inhalants, Narcotics and Hallucinogens
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:




Tobacco, Alcohol and Marijuana use cut by 50-75%
Pack-a-day smoking reduced by 25%
Decreased use of Inhalants, Narcotics and Hallucinogens
Polydrug use cut by up to 66%
Other Evaluation Notes: The IPR evaluation is ongoing as adaptations
of the programme structure have been implemented and require further
evaluation.
Quality of Evaluation: High-conducted by Institute for Prevention
Research
165
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: Fair
166
C. Contact and Review Information
Internet:
www.lifeskillstraining.com
www.med.cornell.edu/ipr
Five principle references:
Contact Details Progamme:
National Health Promotion Associates, Inc.
115 Wall Street
Princeton, NJ 08540
Phone: (800) 636-3415
Fax: (609) 921-3593
Email: PHPinfo@aol.com
Contact Details: Evaluation:
Gilbert Botvin, Ph.D.,
Professor and Director, Institute for Prevention Research
Cornell University Medical College
411 East 69th Street, KB-201
New York, NY 10021
Phone: (212) 746-1270
Fax: (212) 746-8390
Email: gjbotvin@aol.com or gbotvin@mail.med.cornell.edu
First review: Emma Sherriff
Second review:
12-Nov-04
167
Programme: Life Skills Training (LST)
A: The Programme
Programme Type: Substance abuse prevention programme (targets all
children at risk of exposure to addictive substances)
Brief Description: There are 15 sessions in year one, 10 sessions in
year 2 and 5 sessions in year 3, run by teachers, peer leaders and
professionals. Sessions focus on drug resistance, personal selfmanagement, and social skills.
Scope: Not indicated
Target Population: Elementary and middle/junior high school students
in inner city, suburban and rural populations.
Longer Description: The programme is made up of three main
components. Firstly, Drug Resistance skills enable young people to
recognise and acknowledge common misconceptions about tobacco,
alcohol and drug use. Participants receive coaching in resistance
strategies to put into practice when faced with peer and media pressure.
Secondly, Personal Self-Management Skills how to examine their selfimage and how it impacts on their behaviour. The young people are
encouraged to set goals and their personal progress is monitored.
Additionally they are encouraged to look at their day-to-day decisionmaking and how others may affect this, analyse problem situations and
consider the consequences before making these decisions. With a view to
reducing stress and anxiety, and taking a positive attitude to overcome
personal challenges. Thirdly, General Social Skills teach the students skills
to overcome shyness, communicate effectively and avoid
misunderstandings. Training in initiating conversations, handling social
requests, utilizing verbal and non-verbal assertiveness skills to make or
refuse requests. They will also be shown that they have choices other
than aggression and passivity when making difficult choices.
Risks targeted by the programme:
Peer and Media influence on young people
Outputs and outcomes sought by the programme:
168




To teach prevention-related information
To promote anti-drug norms
To teach drug refusal skills
To foster the development of personal management skills and
general social skills
Specified LM or Theory of Change:
Hypothesised LM or ToC:
Teaching young people how to prevent substance addiction, promoting
anti-drug attitudes, teaching refusal skills and effective social skills will
reduce the proportion of young people using these substances early on in
life and thereby reducing the likelihood of addiction in adulthood.
Links to Other Programmes:
Quality of Programme: High
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
169
(B) The Evaluation
Brief Description: Longitudinal evaluation featuring the follow-up results
of four published studies
Evaluation Type: Longitudinal Randomised Controlled Trial (comparison
groups randomly selected from middle/high school students not
participating in the programme) There are three types of evaluation tools:
Pre and post-tests, which measure program outcomes. Fidelity Check
Lists, which evaluate program implementation by classroom teachers, and
Classroom Assessments, which are quizzes that teachers can give
students for each lesson.
Comparison Group Received: Nothing
Outputs Specified by Evaluation:



Drug Resistance activities
Self-management activities
Social Skills activities
Outcomes Specified by Evaluation:



Reduction in Tobacco, Alcohol and Marijuana use
Reduction in Polydrug use
Reduction in use of Inhalants, Narcotics and Hallucinogens
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:




Tobacco, Alcohol and Marijuana use cut by 50-75%
Pack-a-day smoking reduced by 25%
Decreased use of Inhalants, Narcotics and Hallucinogens
Polydrug use cut by up to 66%
Other Evaluation Notes: The IPR evaluation is ongoing as adaptations
of the programme structure have been implemented and require further
evaluation.
Quality of Evaluation: High-conducted by Institute for Prevention
Research
170
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: Fair
171
C. Contact and Review Information
Internet:
www.lifeskillstraining.com
www.med.cornell.edu/ipr
Five principle references:
Contact Details Progamme:
National Health Promotion Associates, Inc.
115 Wall Street
Princeton, NJ 08540
Phone: (800) 636-3415
Fax: (609) 921-3593
Email: PHPinfo@aol.com
Contact Details: Evaluation:
Gilbert Botvin, Ph.D.,
Professor and Director, Institute for Prevention Research
Cornell University Medical College
411 East 69th Street, KB-201
New York, NY 10021
Phone: (212) 746-1270
Fax: (212) 746-8390
Email: gjbotvin@aol.com or gbotvin@mail.med.cornell.edu
First review: Emma Sherriff
Second review:
12-Nov-04
172
Programme: Linking the Interests of Families and Teachers (LIFT)
A: The Programme
Programme Type: Longitudinal Anti-aggression intervention
Brief Description: This population-based intervention aims to instill in
the students coping strategies and create an environment that provides
the children with parents, teachers and peers working together to prevent
bullying.
Scope: All first and fifth grade elementary school girls and boys
Target Population: Children in US schools from first to eighth grade
living in at-risk neighbourhoods characterized by high rates of juvenile
delinquency.
Longer Description: LIFT intervenes on three levels, instructors offer
classroom based training in social and problem-solving skills to students.
Instructors also provide six training sessions to parents to enable them to
reinforce the skills learned at home. These skills are tested in the
playground where adults supervising reward the children when they act in
positive ways, and reduce privileges where behaviour is negative. Earning
rewards as a group helps create a positive environment that discourages
bullying rather than one that openly encourages bullying.
Risks targeted by the programme:
 Anti-social behaviour
 Offending
 Aggressive parental behaviour in the home
Outputs and outcomes sought by the programme:
 Reduction in Bullying
 Reduction in aggressive behaviour
 Reduction in the likelihood of offending
Specified LM or Theory of Change:
Hypothesised LM or ToC:
173
Reducing aggressive behaviour and bullying of children in schools will
prevent offending behaviour in the long-term. Early aggressive behaviour
has a causal relationship with criminal activity.
Links to Other Programmes:
Quality of Programme:
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: High
174
(B) The Evaluation
Brief Description: Pre and Posttest measures of behaviour and results
on progress of children and parents in the programme are evaluated.
These are compared between first grade and fifth, fifth and eighth.
Evaluation Type: Randomised Controlled Trial, Pre and Post test
Comparison Group Received: Nothing specified
Outputs Specified by Evaluation:
 Aggressive school playground behaviour was reduced by a third in
participating schools
 Children with behaviour problems are at higher risk of becoming
violent criminals
 Mothers displaying the highest pre-intervention levels of aversive
behaviours showed the largest reductions
 Teacher rating data indicated a significant increase in positive social
skills and classroom behaviour in children receiving the LIFT
program
Outcomes Specified by Evaluation:
 The percentage of young people arrested by the 8th grade (3 years
on) were reduced by 50%
 The most aggressive children improved the most First graders who
did not receive the intervention were shown in the fourth grade to
have dramatically higher levels of inattentive, impulsive and
hyperactive behaviours than LIFT participants
LM or Theory of Change Specified by Evaluation:
Aggressive behaviour and bullying were prevented; in turn the number of
arrests were halved.
Results: Outputs:
 Antisocial behaviour reduced
 Bullying reduced
 Parental aggressive behaviour reduced
 A positive attitude to peers
175
Results: Outcomes:
 At risk children become pro social
 At risk children less likely to be arrested
 At risk children less likely to bully their peers
 At risk children less likely to have aggressive parents
Other Evaluation Notes:
Quality of Evaluation: High
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: Low
176
C. Contact and Review Information
Internet:
www.oslc.org/dproj.html#lift
Five principle references:
Eddy, J.M., & Reid, J.B., & Fetrow, R.A. (2000, Fall). An Elementary
School-Based Prevention Program Targeting Modifiable Antecedents of
Youth Delinquency and Violence: Linking the Interests of Families and
Teachers (LIFT). Journal of Emotional and Behavioral Disorders, 8(3),
165-176.
Reid, J.B., Eddy, J.M., Fetrow, R.A., & Stoolmiller, M. (1999, August).
Description and Immediate Impacts of a Preventive Intervention for
Conduct Problems. American Journal of Community Psychology, 27(4),
483-517.
Contact Details Progamme:
John Reid, Ph.D.
Senior Scientist
Oregon Social Learning Center
160 East 4th Avenue
Eugene, OR 97401
Phone: (541) 485-2711
Fax: (541) 485-7087
Contact Details: Evaluation:
Same as above
First review: Emma Sherriff
Second review:
10-Nov-04
177
Programme: Midwestern Prevention Project (Project Star)
A: The Programme
Programme Type: Adolescent drug use prevention and early
intervention
Brief Description: The MPP aims to help youth recognize social pressure
to use drugs and provides training skills in how to avoid drug use and
drug use situations. These skills are initially learned in the school
programme and reinforced through the parent, media, and community
organization components.
Scope: 20,000 sixth and seventh grade students from 107 schools
Target Population: Young adolescents at the first risk period for drug
use, whole populations of middle school students (sixth or seventh grade)
Longer Description:
The programme involves active social learning techniques (modelling, role
playing and discussion). The school programme is implemented by
teachers over two years (10-13 classroom sessions in the first year, five
booster sessions in the second year). The parental programme involves a
parent-principal committee that meets to review school drug policy, and
parent-child communications training. A consistent message supporting a
non-drug use norm is delivered through three components: mass media
coverage and programming (31 television, radio, and print broadcasts per
year), community organization, and local health policy change. All
components involve regular meetings of respective deliverers. The
programme has been implemented in Kansas City and Indianapolis, and is
known as Project STAR and I-STAR, respectively.
Risks targeted by the programme: Peer and Media Pressure
Outputs and outcomes sought by the programme:



Improving students’ drug resistance skills
Institutionalizing prevention programming
Limiting youth and community access to drugs
Specified LM or Theory of Change:
Hypothesised LM or ToC:
178
Creating an anti-drugs stance in the wider community and schools, which
will be instilled in young people will prevent involvement in drug taking in
early adolescence and the development of severe problems in adulthood.
Links to Other Programmes:
Quality of Programme: High
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
179
(B) The Evaluation
Brief Description: Participants completed an 133 item questionnaire
before and after the intervention, and annually thereafter. Evaluation is
still ongoing. Measures included demographic characteristics, ‘gateway’
drug use (cigarettes, alcohol, marijuana) and psychosocial variables
related to drug use.
Evaluation Type: Longitudinal Randomised Controlled Trials
Comparison Group Received: access to mass media and community
organization components.
Outputs Specified by Evaluation:
 Anti-drug attitudes in young people and the wider community
 Improvement in parent/child communication
 Supportive community prevention exercises
Outcomes Specified by Evaluation:
 Intellectual improvement
 Reduced drug use
 Reduced likelihood of drug addiction in adulthood
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:



20-40% reductions in ‘gateway’ drug use were maintained through
high school and up to three years beyond high school
outcomes were similar for illicit drugs besides marijuana,
particularly stimulants such as cocaine and amphetamines
youth in the intervention group were less likely to require treatment
for drug abuse problems
Other Evaluation Notes:
Quality of Evaluation: High
180
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: High
181
C. Contact and Review Information
Internet:
www.colorado.edu/cspv/publications/factsheets/blueprints/FSBPM01.html
www.northeastcapt.org/pod/detail.asp?ID=111
Five principle references:
Elliot, D.S. (Series Editor), Pentz, M.A., Mihalic, S.F., and Grotpeter, J.K.
(1997). Blueprints for violence prevention. Book One – The Midwest
Prevention Project. Boulder, CO: Institute of Behavioural Science,
University of Colarado.
Pentz, M.A., Trebow, E.A., Hansen, W.B., et. al. (1990). Effects of
program implementation on adolescent drug use behaviour: The
Midwestern Prevention Project (MPP). Evaluation Review, 14, 264-289.
Rohrbach, L.A., et. al. (1994). Parental participation in drug abuse
prevention: Results from the Midwestern Prevention Project. Journal of
Research on Adolescence.
Contact Details Progamme:
Angela Lapin, Project Manager
Department of Preventive Medicine
1441 Eastlake Avenue
Mail Stop 44
Los Angeles, CA 90033-0800
Phone: (323) 865-0327
Email: pentz@hsc.usc.edu
Contact Details: Evaluation:
Same as above
First review: Emma Sherriff
Second review:
12-Nov-04
182
Programme: Olweus Bullying Prevention
A: The Programme
Programme Type: Early intervention and prevention program.
Brief Description: Olweus is designed to prevent and reduce bullying in
elementary, middle and junior high schools.
Scope: set up in 1983 in northern Norway. The programme has since
been introduced in the UK, the USA and Germany.
Target Population: All students in participating elementary, middle, and
junior high schools take part in some aspects of the progamme, whilst
students identified as bullies or victims of bullies receive additional
individual interventions.
Longer Description: The progamme works in the following way
(School wide interventions):
 Administration of the Olweus bully/victim questionnaire (filled out
anonymously by students)
 Formation of a bullying prevention coordinating committee
 Staff training
 Development of school wide rules against bullying
 Development of a coordinated system of supervision during break
periods
Classroom-level interventions
 Regular classroom meetings about bullying and peer relations
 Class parent meetings
Individual-level interventions
 Individual meetings with children who bully
 Individual meetings with children who are targets of bullying
 Meetings with parents of children involved.
183
Risks targeted by the programme: Impulsive, dominant personalities,
lack of empathy, difficulty conforming to rules. Potential anti social
behavior.
Outputs and outcomes sought by the programme: Outputs sought
are reduced delinquency and improved school/academic performance.
Outcomes sought are improved peer relations and making schools safe for
students to learn and develop.
Specified LM or Theory of Change: ToC specified is based on research,
which shows that reduction of aggressive behavior is likely also to reduce
substance misuse in later life as well as reduction of criminality generally.
Hypothesised LM or ToC:
Links to Other Programmes: Don't Laugh at Me Project. Colorado Safe
Communities- Safe Schools. Maine Project Against Bullying.
Quality of Programme: Good.
LM or TofC: Good.
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
184
(B) The Evaluation
Brief Description: Two different types of evaluation designs have been
used to assess the program. In several evaluations, what is often called
an “age-cohort design” with time-lagged contrasts between adjacent but
age-equivalent cohorts was used. One of the strengths of this quasiexperimental design is that several of the cohorts serve both as
intervention and control/baseline groups (in different comparisons). Also,
in one evaluation project, a traditional control group design was used.
Evaluation Type: Quasi-experimental
Comparison Group Received: n/k
Outputs Specified by Evaluation: assess overall reduction in figures of
bullying in participating schools Two graphs from the last evaluation of 10
schools in Oslo demonstrate this. The reductions in bully/victim problems
varied between 33 and 64 percent for the various subgroups (girls and
boys 11 to 13 years in grades five to seven).
Outcomes Specified by Evaluation: Improvement in peer relations and
improved development of all students whether bully or victim.
LM or Theory of Change Specified by Evaluation: None
Results: Outputs:
Results: Outcomes: In Norwegian studies of 2,500 5th - 8th grade
students, researchers have found substantial reductions (50% or more in
most groups) in students' reports of bullying and victimization, significant
reductions in antisocial behaviour (such as vandalism, fighting, theft,
alcohol use, and truancy), and significant improvements in the social
climate of the classroom.
In a US study of middle school students in the South-eastern US,
researchers observed significant reductions after one year in self-reported
185
bullying (for boys and girls), self-reported victimization (among boys),
and student isolation (for boys).
In a study of students in primary and middle schools in the United
Kingdom, researchers observed reductions in self-reported victimization
among primary school students, decreases in self-reported bullying
among primary and secondary school students, increases in the frequency
with which students told teachers about having been bullied, increases in
the frequency with which bullies reported that teachers had talked with
them about their behaviour, and increases in the frequency with which
students reported spending break time alone.
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: High
186
C. Contact and Review Information
Internet: http://modelprograms.samhsa.gov/template_cf.cfm?page
Five principle references: Olweus, D. (1987). "School-Yard Bullying-
Grounds for Intervention," School Safety, 6, 4-11.
Olweus, D. (1991). "Bully/Victim Problems Among School Children: Some
Basic Facts and Effects of a School-Based Intervention Program," in The
Development and Treatment of Childhood Aggression, D. Pepler and K. Rubin
eds. Hillsdale, 411-448.
Olweus, D. (1993). Bullying at School: What We Know and What We Can Do.
Williston, VT: Blackwell Publishers.
Olweus, D. (1997). "Bully/Victim Problems in School: Knowledge Base and an
Effective Intervention Program," The Irish Journal of Psychology, 18, 170-190.
Olweus, D., Limber, S., & Mihalic, S. (1999). Blueprints for Violence
Prevention, Book Nine: Bullying Prevention Program. Boulder, Concentre for
the Study and Prevention of Violence.
Contact Details Progamme: Program Developer
Dan Olweus
Research Professor and Program Director
The HEMIL Centre (Research Centre for Health Promotion)
Department of Psychology, University of Bergen
Christiesgate 13, N-5015
Bergen, Norway
Phone: 011-47-55-58-23-27
Email: olweus@online.no
Contact Details: Evaluation: As above
First review: Carl Staunton 10th November 2004
Second review:
187
Programme: Parents as Teachers (PAT)
A: The Programme
Programme Type:
Prevention
Brief Description:
This is an early childhood parent education and family support program
for parents of young children. It includes home visits , parent meetings
child health/development screenings and a referral service for community
development resources.
Scope: 3400 programs serve over 300000 children throughout the US
and other countries.
Target Population: at risk families with children (prenatal- age 5)
Longer Description:
Each PAT program has 4 main components. 1) a trained parent educator
makes home visits to teach parents how to facilitate growth and
development of their child. 2) parent groups meet to share their
experiences and gain new knowledge. 3) children’s health, development,
hearing and vision are monitored. 4) parents are referred to other
community resources. The program continues as long as necessary from
prenatal until the child is 5. Home visits last for an hour and occur as
frequently as needed from weekly to monthly.
Risks targeted by the program:
The program targets risks of poor parenting and poor child health and
development. The program also aimed to inhibit risks of low income, teen
parents, single parents and other factors.
Outputs and outcomes sought by the programme:
Improved parenting skills reducing the liklihood of developmental
problems for the child and further stress for the parents. Improved
health for the child through screening for problems.
Specified LM or Theory of Change:
188
Hypothesised LM or ToC:
Parental support reduces stress and improves the parent child
relationship. Educating the parent also serves to improve parenting skills
increasing positive opertunities for the child. Health screening enables
any problems to be identified early and treated.
Links to Other Programmes:
Quality of Programme: good
LM or TofC:
Target Population Specified: good
Attention to Ethics:
Consistency/Fidelity: good
189
(B) The Evaluation
Brief Description: Evaluation showed that PAT had little impact on
parenting knowledge, attitudes or behaviours. It was also found that
maintaining involvement in the program over the 3 years resulted in
significant gains for the children’s cognitive, social and self help skills
compaired to the control group, although these results were modest.
Evaluation Type: Experiment and control groups were assessed over a
13 year period. The experimental group received 20 visits over this time.
Comparison Group Received: none
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Improvements in child’s cognitive, social and self help skills. No
improvement in parent and behavior (it does not explain how the
program targeting parenting behavior could have altered child outcomes
without altering parental attitudes and behaviour.)
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
Other Evaluation Notes:
Quality of Evaluation: not randomized
190
Sample: good
Measures:
Control Group: no intervention
Other Innovation:
Replication: good, some support for findings
Citation:
191
C. Contact and Review Information
Internet:
Five principle references:
Multisite Parents as Teachers Evaluation: Experiences and outcomes for
children and families (SRI Project PO7283) Menlo Park, CA: SRI
International [available at:
http://www.sri.com/policy/cehs/early/pat.html]
Web site: www.patnc.org
Contact Details Progamme:
Wagner, M. M., Clayton, S. L., (1999) the Parents as Teachers Program:
Results from two demonstrations. The future of children, 9 (1), 91-115.
Contact Details: Evaluation:
First review: Helen
Second review:
192
Programme: Parent Child Development Center (PCDC)
A: The Programme
Programme Type:
The PCDC programmes are designed to foster relationships between
mothers and children in low-income families in order to facilitate more
effective child-rearing practices and increase educational and occupational
opportunities for children.
Brief Description:
Practical experiences and group discussions, in addition to other support
services, provide education in socioemotional, intellectual and physical
aspects of child development for the mothers enrolled on the programme.
Scope:
The programme has been delivered in a variety of US cities (Birmingham,
Houston and New Orleans) and to participants with varied ethnic
backgrounds (white, African American and Mexican American).
Target Population:
Low-income families in which the mother is the primary caregiver and
children are aged between 2 months and 3 years old.
Longer Description:
The personal development of participating mothers is fostered through
home management training, exposure to community resources and
access to continuing education. Other activities include structured play
sessions that are videotaped and analysed in order that family
communication and interaction skills can be enhanced. Furthermore, the
family as a whole is considered in providing transportation to services,
meals, health and social services, activities for siblings and small stipends
for participants.
Risks targeted by the programme:
Family conflict.
Ineffective parenting practices.
Living in a low-income household.
Early initiation of problem behaviours.
Rebelliousness.
Outputs and outcomes sought by the programme:
193
School performance.
Attachment to family.
Specified LM or Theory of Change:
Hypothesised LM or ToC:
No theory of change specified, but it is thought that by participating in the
multidimensional treatments offered in the programme, child rearing
practices will be improved and a stimulating environment will be created
for the child. This should lead to an improvement in educational and
behavioural outcomes for children whose families are participating in
PCDC.
Links to Other Programmes:
Houston Parent Child development Center
Birmingham Parent Child Development Center
New Orleans Parent Child Development Center
Quality of Programme: OK
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
194
(B) The Evaluation
Brief Description:
Evaluation of the PCDP programme delivered in Houston, US.
Intervention effects were originally evaluated upon participants
completing the two year program and then followed-up when students
were in second through to fifth grades at school. At the start of the
programme, a door-to-door survey was conducted to identify low-income
Mexican American families with a one year old child, families were then
randomly assigned to control and programme groups.
Evaluation Type:
Experimental design randomised control trial (RCT).
Comparison Group Received:
No services only annual assessment procedures.
Outputs Specified by Evaluation:
Referral to special education classes
Retention in grade
School grades
Reading scales
Language scales
Vocabulary scales
Outcomes Specified by Evaluation:
Classroom behaviour
Improved parenting skills (for mothers)
LM or Theory of Change Specified by Evaluation:
Through the activities and opportunities it stimulates, the programme
aims to promote the development of child competence through
strengthening parental child rearing skills. Theoretically, parents would
retain these skills and continue to provide a supportive and educationally
stimulating environment in which their children should thrive.
Results: Outputs:
End of program evaluation:
Programme participants had higher stanford-Binet IQ’s.
Follow-up evaluation:
No differences on school grades.
195
Programme students had significantly higher scores on reading, language
and vocabulary scales and on a composite score of all of these measures.
No differences in grade retention or referral to special education classes.
Results: Outcomes:
End of program evaluation:
Improvements in parental (mother’s in the programme group) use of
affection, praise, criticism and less restrictive control.
Enhanced provision of cognitively stimulating home environment.
Follow-up evaluation:
On teacher ratings of classroom behaviour programme children were less
hostile.
Other Evaluation Notes:
There are evaluations of other PCDC programmes, such as those located
in Birmingham and New Orleans (US).
Quality of Evaluation: Good
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: Good
Citation: High
196
C. Contact and Review Information
Internet:
www.marylandblueprints.org/blueprints/
programs/Parent%20Child%20Development%20Center%20Programs.pdf
http://www.colorado.edu/cspv/publications/factsheets/blueprints/FSBPP10.html
http://www.uh.edu/~psycp2/PCDC_Publications.htm
Five principle references:
Andrews, S.R. et al. (1982). The skills of mothering: A study of the
parent-child development centers. Monographs of the Society
for Research in Child Development, 47, (6, serial no. 198).
Bridgeman, B., Blumental, J.B. & Andrews, S.R. (1981). Parent Child
Development Center: Final Evaluation Report. Washington,
DC: Department of Health and Human Services, Office of Human
Development Services.
Johnson, D.L. & Breckenridge, J.N. (1982). The Houston Parent-Child
Development Center and the Primary Prevention of Behaviour
Problems in Young Children. American Journal of Community
Psychology, 10, pp.305-316.
Johnson, D.L. & Walker, T. (1991). A Follow-up Evaluation of the
Houston Parent-Child Development Center: School Performance.
Journal of Early Intervention, 15, pp.226-236.
McGowan, R.J. & Johnson, D.L. (1984). The mother-child relationship
and other antecedents of academic performance: a causal
analysis. Hispanic Journal of the Behavioral Sciences, 6,
205-224.
Contact Details Programme:
Dale Johnson, Ph.D.
Department of Psychology
University of Houston
Houston, TX 77204-5022
USA
Fax: (713) 743-8588
Dept Phone: (713) 743-8500
Email: DLJohnson@uh.edu
197
Contact Details: Evaluation:
Dale Johnson, Ph.D.
Department of Psychology
University of Houston
Houston, TX 77204-5022
USA
Fax: (713) 743-8588
Dept Phone: (713) 743-8500
Email: DLJohnson@uh.edu
First review: Sarah Blower
Second review:
198
Programme: Postponing Sexual Involvement, Human Sexuality and
Health Screening Curriculum (PSI)
A: The Programme
Programme Type:
Prevention of early sexual involvement among middle school aged youth
by encouraging abstinence. The program also aimed to reduce sexual
activity by youths who were already having sex and encouraged them to
use contraception.
Brief Description: the program aimed to prevent early sexual
involvement among middle school aged children in Washington DC. It
was designed for a classroom setting and involved 45-minute lessons and
voluntary discussions. The program had a significant effect on female
sexual behavior.
Scope: The program ran for two years and served 522 students in year
one and 459 students in year two.
Target Population: PSI served inner city youths in the seventh and
eighth grades (average age 12.8) in 6 Washington DC junior high schools.
Longer Description: During the first year of the program students
participated in eight weekly classroom sessions, each lasting about 45
minutes. Year two included three classroom sessions and eight voluntary
group discussions held during lunch or a free period. Three sessions
focused on reproductive health issues and peer leaders recruited from
local high schools ran five sessions. Students believed to be at high risk
of sexual activity received individual interviews with program facilitators.
In the second year students repeated the three reproductive health
sessions and participated in activities that reinforced the abstinence
message. An assembly was given on STDs and students had small
informal group discussions on eight topics such as gang violence, personal
hygiene, teen pregnancy and drug abuse.
Risks targeted by the program: risks of pregnancy, STDs and
emotional aspects of early sexual involvement were targeted.
199
Outputs and outcomes sought by the programme: delay in first
sexual activity. Reduced sexual activity by students already having sex
and increased use of contraceptive use by sexually active students.
Specified LM or Theory of Change:
Hypothesised LM or ToC:
1) Students are educated to the risks of early sexual involvement. 2)
They are then made aware of the social pressures influencing sexual
behavior and how to resist them. 3) Increased knowledge allows
students to make educated decisions about how they want to behave and
why. They are also more protected against risks through abstinence or
increased condom use. 4) Program messages are reinforced leading to
longer-term improvements in sexual behavior.
Links to Other Programmes:
Draw the line/Respect the line has had positive effects on sexual behavior
of males.
Draw the Line/Respect the Line Program Contact
Karin Coyle, Ph.D.
Evaluator ETR Associates 4 Carbonero Way Scotts Valley, CA 95066
Phone: 831-438-4060
Fax: 800-435-8433
Email: kcoyle@etr.org
Quality of Programme: good
LM or TofC:
Target Population Specified: Specific
Attention to Ethics:
Consistency/Fidelity:
200
(B) The Evaluation
Brief Description: six schools were matched on racial/ethnic
composition and seventh grade class size to form three pairs of schools.
The schools in each pair were randomly assigned to either PSI program or
to the control group. In the seventh grade, 262 program participants
received the intervention and 260 teens were in the control group.
Participants were followed for two years.
Evaluation Type: matched pairs/ random allocation (see above)
Comparison Group Received: None
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
 Delay in first sexual activity.
 Reduced sexual activity by students already having sex
 Increased use of contraceptives by sexually active students.
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:




Sexually active girls were more likely than controls to use
contraception
At the end of the seventh grade, female participants had lower
expectations of sexual activity in the next six months and lower
perceptions of peer sexual activity than females in the control
group.
Female participants were more likely to report that they would be
able to refuse sex if they did not feel ready and they had a greater
knowledge of reproductive health services at the end of the
program.
Girls in the program were twice as likely to delay sex with a
boyfriend than those in control group at the end of the seventh
grade program. There was no difference by the end of the eighth
grade.
201



The program did not have any significant effects for females
regarding refusal of sex with a stranger, attitudes to childbearing or
contraceptive knowledge.
Boys in the program had higher contraceptive knowledge and more
positive attitudes towards postponing childbearing than boys in the
control
No other significant effects were found for males.
Other Evaluation Notes:
Many sexual education programs have had successful results for males
but not females. This program has been more successful in improving
female sexual behavior than male.
The brief duration of the program and the lack of opportunity to reinforce
assertiveness training and communication skills could explain why
program effects were minimal regarding perceptions of peer sexual
experience, sexual activity expectations, sex refusal skills and
communication with either parents or boyfriend/girlfriend. Reproductive
health education is likely to have caused the significant effects on
contraceptive knowledge and use.
Quality of Evaluation: good
Sample: small
Measures:
Control Group: no intervention
Other Innovation:
Replication: similar programs have been run with varying results
Citation:
202
C. Contact and Review Information
Internet:
Five principle references:
Aarons, S., Jenkins, R., Raine, T., & ElKhorazaty, N. (2000). Postponing sexual intercourse
among urban junior high school students — a randomized controlled evaluation. Journal of
Adolescent Health, 27(4): 236–247.
ETR Associates (2002). Postponing Sexual Involvementhttp://www.etr.org/sb1170/psi.html.
Howard, M. & McCabe, J. (1990). Helping teenagers postpone sexual involvement. Family
Planning Perspectives, 22(1): 21–26.
Howard, M. & Mitchell, M. E. (1998). Postponing sexual involvement: An educational series
for young teens. Atlanta, GA: Adolescent Reproductive Health Center, Grady Health
Systems.
Howard, M., Mitchell, M. E., Evans-Ray, D., & Dent, D. (1997). Training teen leaders.
Atlanta, GA: Adolescent Reproductive Health Centre, Grady Health Systems.
Contact Details Progamme:
Program contact:
Renee Jenkins, M.D., Dept. of Pediatrics and child health
Howard University Hospital
2041 Georgia Ave, NW
Washington DC 20060
rjenkins@howard.edu
PSI Program and Curriculum contact
Adolescent Reproductive Health
Grady Health System/ Teen Services Dept
Box 26061
80 Jesse Hill Jr. Drive,
SE, Atlanta, GA 30303
Phone – 404-616-3529
Contact Details: Evaluation:
Marion Howard, PhD
Emory/Grady Teen Services Program
Grady Memorial Hospital
Box 26158
80 Butler St, SE
Atlanta, GA 30335
203
Phone- 404-616-3513
Email: mhoward@emory.edu
First review: Helen
Second review:
204
Programme: Quantum Opportunities Program
A: The Programme
Programme Type:
Intervention programme designed to foster educational and social
development in order to increase graduation rates, and decrease the rate
of violence and pregnancy in high school students.
Brief Description:
The Quantum Opportunities Program (QOP) is a youth development
programme that provides year-round services to socio-economically
disadvantaged youth over four years of high school. The programme
aims to improve academic ability, in addition to establishing long-term
meaningful relationships between the participants and program
coordinators, and build a sense of commitment and involvement within
the community and school. Participants, known as ‘associates’ are
engaged in three types of activity – education, development and
community service. Participants are also rewarded for completing various
stages within the programme with financial incentives and bonuses.
Scope:
In 1989, 25 disadvantaged youths from five High Schools in San Antonio,
Philadelphia, Milwaukee, Oklahoma City, and Saginaw were randomly
allocated to the program. More recently the program has been replicated
for a further 600 students in seven cities; Cleveland, Fort Worth,
Houston, Memphis, Philadelphia, Washington D.C. and Yakima.
Target Population:
High school students in the ninth grade from low-income families
(receiving food stamps and public assistance).
Longer Description:
In 1989, 125 disadvantaged high school students were randomly chosen
to participate in QOP, which provides “quantum opportunities” across
three types of activity (community service, education and development).
Participants spend 250 hours on each of the three types of activity.
Education activities include tutoring, computer-assisted instruction and
homework assistance; development activities included acquiring life and
family skills, and planning for college and jobs; service activities included
community service projects, helping with public events and holding
regular jobs.
The programme incorporates the use of case management, mentoring,
205
computer-assisted instruction and other multimedia, work experience and
financial incentives. It consists of 96 courses (48 academic and 48
functional) that develop understanding and engagement with, for
example, employment, health and consumer topics. The pace is set
according to the preferences and abilities of the individual associates.
The coordinator is bound to the associate for four years, by way of an
annual contract, involving monthly progress reports, participation in
service activities and weekly meetings. The coordinator is also able to
individually tailor activities to the needs of each associate in order to
accommodate short and long-term goals.
The programme motto is “Once in QOP, Always in QOP”, this means that
no participants are ever taken off the programme and even those who
drop out are tracked and contacted (even if they are in prison). Dropouts can also return to the programme at any point during the 4 year
duration.
Risks targeted by the programme:
Lack of opportunities.
Lack of meaningful relationship with a significant adult.
Academic underachievement.
Lack of prosocial values and beliefs (and lack of interaction with people
who display these values).
Outputs and outcomes sought by the programme:
Sense of commitment and involvement in community and school.
Lower pregnancy rate.
Lower rates of violence.
Higher rates of graduation.
Specified LM or Theory of Change:
Hypothesised LM or ToC:
Combating the real and perceived lack of opportunities accessible to
socio-economically disadvantaged youth via a number of different
methods: by promoting the notion that success and upward social
mobility is obtainable; through participation in a meaningful and enduring
relationship with the co-coordinator who, to the youth, represents a role
model and surrogate parent; by enhancing academic and functional skill
levels, to equip young people for success; and finally by reinforcing and
rewarding positive action and consequent achievements. All of these
interventions and services theoretically compensate for the deficits
apparent in impoverished areas, and should result in lower rates of
206
pregnancy and violence and higher rates of graduation in disadvantaged
young people who, as a result of the opportunities presented within the
programme, now imagine and pursue an alternative lifestyle for
themselves.
Links to Other Programmes:
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
207
(B) The Evaluation
Brief Description:
An RCT of 250 grade nine high school students tracked through their 4
remaining years of compulsory High School education. The evaluation
revealed that enrollment on QOP resulted in a number of better outcomes
for young people when compared to a control group.
Evaluation Type:
In 1989, each of the five high schools provided a list of 50 students who
were members of families receiving public assistance. 25 of these
students were then randomly allocated to the programme in each school
to form the programme group (n=125). The remaining students formed
the control group (n=125). Questionnaires and assessments were
administered in 1989, 1990, 1991, 1992 and also in 1993. These
captured information about the young people’s demographic
characteristics, work and school experiences, knowledge of health,
personal attitudes, academic skills and functional skills.
Comparison Group Received:
Control group did not receive any intervention or programme of services.
Outputs Specified by Evaluation:
Further education
Receipt of honours and awards
Outcomes Specified by Evaluation:
School completion/ graduation
Rate of pregnancy
Hopes for the future
State of mind
Academic skills level
Functional skills level
Self-assessed need for help
Alcohol and drug problems
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
42% of programme group were in postsecondary school compared to
16% of control group (statistically significant at level of p.10).
A larger percentage of students on the programme group received honors
or rewards (34%) when compared to the control group (12%)
(statistically significant at level of p.10).
208
Results: Outcomes:
63% of programme group graduated from High School compared to only
42% of the control group (statistically significant at level of p.10).
Furthermore, only 23% of the programme group were ‘drop-outs’
compared to 50% of the control group (statistically significant at level of
p.10).
In terms of academic and functional skills levels, there were no significant
differences between the two groups after the first year. However after the
second year, the programme group were scoring higher on tests of
vocabulary, comprehension, mathematics, computation, mathematics
concepts and language expression (statistically significant at level of
p.10). By 1993, the average group scores were significantly higher in all
11 areas of functional and academic skills.
24% of programmes group have had children compared to 38% of the
control group (statistically significant at level of p.10).
Control group members were significantly more likely (p.10) to express a
need for help with an alcohol or drug problem than members of the
programme group.
Although not statistically significant, 98% of QOP students agreed with
the statement that they were hopeful about the future compared to 86%
of the control group. Similarly 93% of QOP members compared to 82%
of control group members agreed with the statement that their family life
is happy.
There were no significant differences between the programme group and
the control group with regards to their self-assessed need for help in
maths, reading, finding a job, or training for a job.
Other Evaluation Notes:
The delayed impact of the programme in the functional and academic
skills of students illustrates the need for a longitudinal approach to youth
development programmes.
The evaluation did not examine the impact of the programme on levels of
violence, the decrease in which constitutes one of the central aims of
QOP.
Quality of Evaluation:
209
Sample: OK
Measures: Good
Control Group: OK (did not receive a service)
Other Innovation:
Replication: Good
Citation: High
210
C. Contact and Review Information
Internet:
www.promisingpractices.net/program.dsp?.programid=27
www.hfrp.org
www.afyp.org/RAA/12quant.pdf
www.afyp.org/forumbriefs/1994/fb102894.htm
www.childtrends.org/Lifecourse/programs/QuantamOpportunitiesProgram
.htm
Five principle references:
Hahn, A., Leavitt, T., & Aaron, P. (1994, June). Evaluation of the
Quantum Opportunities Program: Did the program work? Waltham, MA:
Brandeis University.
Lattimore, C.B., Grotpeter, J.K., Taggart, R. (1998). Blueprints for
violence prevention, book four: Quantam Opportunities Program. Boulder,
CO: Center for the Study and Prevention of Violence.
Contact Details Progamme:
C. Benjamin Lattimore
Opportunities Industrialisation Centers of America Inc.
1415 Broad Street
Philadelphia
PA 19122
Contact Details: Evaluation:
Dr Andrew Hahn
Center for Human Resources
Heller Graduate School
Brandeis University
Waltham
MA 02254-9110
211
First review:
Second review:
212
Programme: Safe Child program
A: The Programme
Programme Type: Prevention of sexual abuse Program
Brief Description: Program, which provides children, ages three to ten
with a set of skills to help them prevent sexual, emotional and physical
abuse.
Scope: Developed in 1981 and updated in 1994
Target Population: 3 to 10 year olds who attend a variety of rural,
suburban, and urban schools from diverse backgrounds.
Longer Description: Developed in 1981 and updated in 1994, the Safe
Child Program provides children age’s three to ten with a set of skills to
help them prevent sexual, emotional, and physical abuse. The main idea
guiding the program is that there are times when children can and must
be responsible for their own well being. At the same time, however, the
program emphasizes that a child’s security can be enhanced without
creating misunderstanding, fear, or anxiety or reducing a child’s sense of
trust.
The program is designed to be used in a group classroom setting. By
building on everyday experiences, the program teaches children how to
speak up for themselves, how to assess and handle various situations,
and to know where to get help. Children actively engage in discussions,
games, and role-playing in ten separate sessions, giving them time to
practice these skills.
The program has two main focuses. The first is prevention of sexual,
emotional, or physical abuse by people known to the child. This is taught
in the context of life skills, including communication, choices, asking for
help, and decision-making. These skills are developed not as ideas, but as
skills through role-play. The other focus of the program is safety around
strangers. The classroom session discusses misconceptions the children
may have, defines who a stranger is, and then provides four rules for
dealing with strangers. These rules are these: keep an arm’s length away,
don’t talk to strangers, don’t take anything from strangers, and don’t go
anywhere with a stranger.
213
Risks targeted by the programme: mainly risk factors associated with
people who are known to the child and a second focus on risks associated
with strangers. Protective factors are boosted to help prevent this.
Outputs and outcomes sought by the programme: Outcomes sought
are increased security for the child and the ability to deal with potentially
risky situations.
Specified LM or Theory of Change: None specified
Hypothesised LM or ToC: responsibility for own actions are instilled into
the child which helps not only in abuse prevention but may increase
assertiveness skills in the child.
Links to Other Programmes: None
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
214
(B) The Evaluation
Brief Description: he program has been evaluated in two separate
studies. An evaluation in Denver (Fryer, Kraizer, and Miyoshi, 1987a)
involved 48 children in kindergarten through second grade, half randomly
assigned to the treatment group and half to a control group. The program
was administered over eight consecutive classes in 20-minute sessions.
Evaluation Type: Randomised control method
Comparison Group Received: N/K
Outputs Specified by Evaluation: N/K
Outcomes Specified by Evaluation: None
LM or Theory of Change Specified by Evaluation: n/k
Results: Outputs: not stated
Results: Outcomes: Prior exposure to other prevention materials made
no significant difference in the children’s knowledge or attitudes or in the
role-playing score on the pre-test.
*
Children in the treatment group showed significant gains after the
program. Out of a possible score of 14, the three treatment groups saw
average gains of 3.7, 3.9, and 4.3 points, compared with 0.5 and 0.3 for
the control groups.
*
The role-playing aspect appears to have achieved the desired effect
of changing children’s actual behaviours, rather than a child’s self-esteem
or knowledge of and attitudes toward risk and safety.
*
Young children (kindergarten, first grade, and preschool) showed
the greatest gains from the program.
*
95.5 percent of the children reported having no fear or anxiety after
the completion of the program.
Other Evaluation Notes:
215
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None
Citation: Moderate
216
C. Contact and Review Information
Internet:
Principle references:
1. Fryer, G. E., S. K. Kraizer, and T. Miyoshi, "Measuring Actual
Reduction of Risk to Child Abuse: A New Approach," Child Abuse
and Neglect, Vol. 11, pp. 173-179, 1987a.
2. Fryer, G. E., S. K. Kraizer, T. Miyoshi, "Measuring Children's
Retention of Skills to Resis Stranger Abduction: Use of the
Simulation," Child Abuse & Neglect, Vol. 11, pp. 181-185, 1987b.
3. Kraizer, S., S. S. Witte, and G. E. Fryer, "Child Sexual Abuse
Prevention Programs: What Makes Them Effective in Protecting
Children?," Children Today, September-October 1989, pp. 23-27,
1989.
Contact Details Progamme: Sherryll Kraizer, Ph.D.
Coalition for Children
P.O. Box 6304
Denver, CO 80206
Phone: 1-800-320-1717
Fax: (303) 320-6328
E-mail: kraizer@safechild.org
Contact Details: Evaluation: Same as for programme details
First review: Carl Staunton 31/11/2004.
Second review:
217
Programme:
A: The Programme Second Step Violence Prevention.
Programme Type: Prevention program.
Brief Description: Second Step is a multi-year, school-based social skills
curriculum for children in preschool through junior high school. Spanning
the full academic year, the program teaches social skills to reduce
impulsive and aggressive behaviour in children and increase their level of
social competence.
Scope: Created in 1987 by the Committee for Children, a non-profit
Seattle-based organization working to promote the safety, well-being,
and social development of children, the Second Step program consists of
a developmentally sequenced series of curricula spanning four age
groups: preschool-kindergarten, first through third grades, fourth and
fifth grades, and junior high school.
Target Population: Preschool children through to junior high school
children.
Longer Description: Second Step teaches the same three skill units at
each grade level – empathy, impulse control, and anger management.
The lessons are tailored to be appropriate to the developmental level of
the given students. Second Step combines written and visual materials
with problem-solving, discussion-group, and role-playing activities to help
children learn to develop the targeted skills, and uses homework
assignments to reinforce concepts taught within the classroom. In
addition, an attempt is made by personnel to help students apply their
Second Step training to real-life situations by providing decision-making
opportunities throughout the school day, both inside and outside of the
classroom context.
A video-based parent program is also available. The parental component
consists of six group meetings led by a trained facilitator. It is intended to
familiarize parents with the curriculum, assist parents in reinforcing the
program skills within the home, and help families build communication,
problem-solving, and stress-management/conflict-resolution skills. The
parental portion of the program has not been evaluated.
218
Risks targeted by the programme: School students at risk of engaging
in violent behaviour.
Outputs and outcomes sought by the programme: Outputs expected
are a percentage reduction in juveniles who do not engage in violent
behaviour and less disruption in the classroom. Also increase in prosocial behaviour and self-esteem is sought as the main outcome.
Specified LM or Theory of Change: Hypothesised LM or ToC: None.
Links to Other Programmes: Increase in pro—social behaviour may
lead to improved educational outcomes and life chances for participants.
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
219
(B) The Evaluation
Brief Description: Has been evaluated twice, once in 1997 by way of a
randomized control trial and again in 2000, which was similar to the
1997, trial but no control group was used.
Evaluation Type: Randomized control group for the 1997 evaluation and
randomized cluster analysis of various schools method for the 2000
evaluation.
Comparison Group Received: nothing
Outputs Specified by Evaluation: Decrease in disruptive behaviour in
the classroom
Outcomes Specified by Evaluation: Improved pro social behaviour
LM or Theory of Change Specified by Evaluation: Not stated
Results: Outputs: (the 2000 evaluation)
Kindergarten children scored higher than preschool children on pre- and
post-test interviews and pre- and post-test behavioural teacher ratings of
problem behaviours, indicating both a higher level of baseline and postintervention knowledge, and a greater rate of teacher-reported
behavioural problems. This suggests that greater levels of knowledge do
not necessarily lead to a decrease in problem behaviours.

For preschool and kindergarten children combined, classroom
observers found that there were significant decreases in verbal
aggression, disruptive behaviour, and physical aggression from
pre- to post-test.

Classroom observers found that the decrease is disruptive
behaviour across time was more pronounced for kindergarten
than for preschool children.
220
Results: Outcomes: Children in both preschool and kindergarten
significantly increased their knowledge in identifying feelings and facial
cues in themselves and others, in thinking about how and why they and
the other children might respond in conflict situations, and in predicting
the consequences of responses, as indicated by pre- and post-test
interview scores.
 There were no significant changes in teacher ratings of
students’ social skills and problem behaviours from pre- to
post-test.
 Boys’ outcomes improved more than girls’ outcomes, as
evidenced by a greater increase in pre- and post-test
interview scores, an increase in social skills as rated by
teachers (girls experienced a slight decrease in their socialskills rating), and a greater decrease in teachers’ ratings of
behavioural problems.
Other Evaluation Notes: This program received a “promising” rating.
While both evaluations produced some positive outcomes, the positive
results were based on relatively limited student observation only. Reports
of student behaviour by teachers and parents were not significantly
impacted by program participation. Furthermore, the effect sizes of the
positive results that were seen were relatively small. Finally, although
some results of the program persisted at the six-month follow-up, results
faded a great deal over time.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Poor (2000 evaluation)
Other Innovation:
Replication: None
Citation: Low
221
C. Contact and Review Information
Internet: www.cfchildren.org
Principle references:
1. Beland, Kathy, Second Step, Grades 1–3 Pilot Project Summary
Report, Seattle, Wash.: Committee for Children, 1988.
2. Beland, Kathy, Second Step, Grades 4–5 Pilot Project Summary
Report, Seattle, Wash.: Committee for Children, 1989.
3. Beland, Kathy, and Beverly Moore, Second Step, PreschoolKindergarten: A Violence-Prevention Curriculum Kit, Seattle, Wash.:
Committee for Children, 1992.
4. Frey, Karin S., and Leihua Sylvester, Research on the Second Step
Program: Do Student Behaviours and Attitudes Improve? What Do
Teachers Think About the Program? Seattle, Wash.: Committee for
Children, 1997.
Contact Details Progamme: Client Support Services
Committee for Children
586 First Avenue South, Suite 600
Seattle, WA 98104-2804
Phone: 1 (800)634-4449
fax: (206) 438-6765
email: info@cfchildren.org
Contact Details: Evaluation: Contact above
First review: Carl Staunton 06/12/2004
Second review:
222
Programme: Smart Start
Programme Type: Early intervention program
Brief Description: Smart Start community-based initiative to help all
North Carolina children enter school ready to succeed. The primary focus
of the Smart Start program is to provide families access to high quality
child care.
Scope: Children who live within geographical access to a Smart Start
centre are eligible participants.
Target Population: children under the age of 6. Although not specifically
aimed toward children of low income, the project does attempt to reach
those who would not otherwise necessarily have access to high-quality
services such as child care.
Longer Description:
The program is predicated on the notions that
1.
the first six years of life are the most critical;
2.
that better quality child care programs can increase a child's ability
at school entry; and
3.
a child's ability at school entry can often predict later academic
success. Some Smart Start sites may provide services such as health care
and various family support services.
Smart Start's approach allows communities to make decisions and plans
that are specific to the needs of their young children and families. All
Smart Start Centres are based on three core program areas:
1.
child care and education;
2.
health care and education; and
3. family support and education. The individual services provided by
each site under these core areas are tailored to each community
depending on its specific needs, goals, and priorities. As such, the full
range of services is not likely to be available at all sites
Risks targeted by the programme: primarily poverty as a risk factor
that may affect later academic success.
Outputs and outcomes sought by the programme:
223

Outputs sought is the percentage increase of children 0-5 who
exhibit age-appropriate mental and physical development.

Main outcome sought is achieve readiness for school entry. Also
increased measured cognitive ability is sought as indicated by the
Kindergarten Check List (KTC).
Specified LM or Theory of Change: None specified.
Hypothesised LM or ToC: Readiness for school achieved through the
program will increase cognitive abilities particulary for children from
poorer families which will impact on later academic outcomes.
Links to Other Programmes: Head Start
Quality of Programme:
LM or TofC: Poor
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
224
(B) The Evaluation
Brief Description: Two multi-site comprehensive evaluations of the
Smart Start Initiative were conducted by the University of North
Carolina's Frank Porter Graham Center (FPG-UNC) this was in 1997. A
six-county study was conducted in 1998 that replicated the original
single-county study with a larger, more geographically diverse population.
The sample size for this later study included 142 in the test group and
294 in the control group.
Evaluation Type: Quasi-experimental controlled study.
Comparison Group Received: the researchers acknowledge that they
had no way of being certain that children included in the control group
had not attended child care centres that had benefited from some Smart
Start services.
Outputs Specified by Evaluation: None
Outcomes Specified by Evaluation: Improvement of cognition as
measured by improved scores on the Kindergarten Teacher Checklist
(KTC).
LM or Theory of Change Specified by Evaluation: None stated
Results: Outputs: None stated by evaluation
Results: Outcomes: The research studies (Maxwell, et al., 1998a; FPGUNC Smart Start Evaluation Team, 1999) found the following:
*
The Smart Start program has been effective at improving the
quality of child care at participating centers. This improvement is
evidenced through a comparison of Smart Start centers to themselves
(for example, increased accreditation by the National Association for the
Education of Young Children, governmental licensing ratings, or increase
in teacher credentials) and to non-program facilities. Centers that have
increased their quality of child care have produced more and a higher
level of positive results than all other centers. This finding suggests that
225
the improved quality of child care has been an important contributor to
positive outcomes.
*
Children from low-income families who attended Smart Start
Centers were rated significantly higher in readiness for school than
children from low-income families who had attended other centers. This
suggests that Smart Start may be helping children who live in poverty
enter school ready to succeed.
*
For non-poverty children, the mean KTC score was not significantly
different for those who attended the Smart Start program compared with
those who attended another child care center.
*
When compared with children who had received no previous child
care, children who had attended Smart Start Centers scored significantly
higher on the KTC, indicating an increased readiness for kindergarten.
*
When compared with children who had attended non-Smart Start
programs, children who attended Smart Start Centers focusing specifically
on child care quality improvements performed significantly better on the
KTC evaluation.
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: None known
Citation: Moderate
226
C. Contact and Review Information
Internet: http://www.fpg.unc.edu/~smartstart
Five principle references:
Contact Details Progamme:
The NC Partnership for Children
1100 Wake Forest Rd.
Suite 300
Raleigh, NC 27604
Phone: (919) 821-7999
fax: (919) 821-8050
Contact Details: Evaluation:
Smart Start Evaluation Team
Marie Butts, Administrative Assistant
Frank Porter Graham Child Development Centre
105 Smith Level Rd.
CB#8180
UNC Chapel Hill
Chapel Hill, NC 27599-8180
(919) 966-4295
First review: Carl Staunton 1/12/2004
Second review:
227
Programme: SMART Team: Students Managing Anger & Resolution
Together
A: The Programme
Programme Type:
Universal violence prevention intervention targeted at schoolchildren
regardless of whether they are exposed to high level risk or not.
Brief Description:
Modular software program designed to teach violence prevention to
school children, incorporating both a prevention curriculum (i.e. violence
prevention, conflict resolution, social competency and decision making
skills) and a therapeutic intervention (group counselling). The software is
designed for students to use independently, either alone or in pairs.
Scope:
Within the US, the program has been implemented in various large middle
schools with diverse socio-economic populations.
Target Population:
Students in grades five through to nine (aged 11 to 15 years old) from
varying socio-economic and ethnic backgrounds.
Longer Description:
The SMART team software programme was developed by the Center for
Health Systems Research and Analysis at the University of Wisconsin.
Theoretically underpinned by the skill acquisition model and social
learning theory, the programme comprises eight modules aimed at
improving anger management (modules include “what’s anger”; “triggers
and fuses”; “anger busters”; and “channel surfin”), dispute resolution
(‘talking it out” and “teen talk”) and also perspective taking (“celebrity
interviews” and “what’s on THEIR Mind”). These tasks include interactive
scenarios, role playing and games. The tasks on each of the computer
based modules are accompanied by feedback and advice from four
‘virtual’ teenage characters from mixed ethnic backgrounds who represent
peer role models for the programme participants.
Risks targeted by the programme:
-Limited or no knowledge of nonviolent conflict resolution strategies.
-Lack of understanding what triggers their own anger.
228
Outputs and outcomes sought by the programme:
-Increase repertoires of, and confidence in using, nonviolent conflict
resolution strategies.
-Increase knowledge, individually, about what triggers anger.
-Decrease incidents of violent behaviour.
-Increase pro-social/ altruistic behaviour.
Specified LM or Theory of Change:
Based on the theoretical premises of the Skill Acquisition Model (Dreyfus
& Dreyfus, 1986) and Social Learning Theory (Bandura, 1986)
programme participants acquire new skills through the completion of
various instrucitonal modules. These skills are anger replacement,
dispute resolution; and perspective taking all of which are thought to
contribute less incidence of aggression and violence in the behaviour of
children.
Hypothesised LM or ToC:
Links to Other Programmes:
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
229
(B) The Evaluation
Brief Description:
Three groups of students from a US school were assigned to each
condition; two intervention groups (n=321) and one control group
(n=195). Each of the groups were tested at pre-test and post-test by
rating their level of agreement to various statements on a five-point
scale. The groups did not differ signficantly on any of the outcome
measures at baseline.
Evaluation Type:
Pretest-postest design with matched intervention and control groups. The
impact of the intervention was examined using repeated measures
multivariate analyses of covariance (MANCOVA mixed design).
Comparison Group Received:
Control group did not participate in the programme.
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
(1) self-awareness (i.e. able to calm oneself down) (2) beliefs supportive
of violence (3) self-efficacy/ confidence in using nonviolent strategies (4)
intentions to use nonviolent strategies (5) self-reported acts of
aggression.
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
Programme participants (1) greater self-knowledge of how specific behaviours can escalate a
conflict situation (F= 3.35, p<.05) (2) greater frequency of self-reported
prosocial acts (3) increased intentions to use nonviolent strategies in
future conflicts (F= 8.67, p< .0001) (4) self-reports of never getting into
trouble in various locations during the past 30 days increased: at home
13%; at school 33%; in the community 6%
Other Evaluation Notes:
Quality of Evaluation: OK
Sample: Good
230
Measures: OK
Control Group: Good
Other Innovation:
Replication: Good
Citation: Low
231
C. Contact and Review Information
Internet:
http://www.lmssite.com
http://modelprograms.samsha.gov
Five principle references:
Bandura, A. (1986). Social foundations of thought and action: a
social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
Bosworth, K. et al. (1996). Using multimedia to teach conflict-resolution
skills to young adolescents. American Journal of Preventative
Medicine, 12, (5), pp.65-74.
Bosworth, K. et al. (1998). A computer-based violence prevention
intervention for young adolescents: Pilot study. Adolescence, 33,
(132), pp.785-795.
Dreyfus, H.L. & Dreyfus, S.E. (1986). Mind over machine: the
power of human intuition and expertise in as era of
computers. New York: Free Press.
Learning Multi-Systems, Inc. SMART Team: Students Managing Anger
& Resolution Together – Program Description, Theoretical
Background, and Evaluation Research. [WWW]
www.lmssite.com/SMARTTeam_Research.pdf (24/1/05)
Contact Details Progamme:
Brad Oltrogge
Learning Multi-Systems, Inc.
320 Holtzman Road
Madison
WI 53713
Tel: 800-362-7323 or 608-273-8060
Fax: 608-273-8065
Email: oltrogge@lmssite.com
Website: http://www.lmssite.com
Contact Details: Evaluation:
Brad Oltrogge
Learning Multi-Systems, Inc.
320 Holtzman Road
Madison
WI 53713
232
Tel: 800-362-7323 or 608-273-8060
Fax: 608-273-8065
Email: oltrogge@lmssite.com
Website: http://www.lmssite.com
First review: Sarah Blower
Second review:
233
Programme: The Seattle Social Development Project (SSDP).
A: The Programme
Programme Type:
Universal, multi-component and multi-year intervention, involving
parents, teachers and students in a programme designed to reduce
children’s problem behaviours.
Brief Description:
The SSDP is a long-term risk reduction intervention, based on social
development and social control theories, this programme aims to reduce
risk factors for school failure, drug abuse and delinquency. Established in
1981, and expanded in 1985, programme participants and their parents
have been followed up every year.
Scope:
Students from mixed socioeconomic ethnic backgrounds were tracked
from grade one through to grade six, in eight Seattle Public Schools. In
1985, this was expanded to include students from grades 5 and 6 in a
further 18 schools. Consequently, over 800 young people and their
parents have been interviewed since 1981.
Target Population:
Both high-risk children (low socioeconomic status and poor school
achievement and low-risk children enrolled in grade and middle school.
Longer Description:
In 1981, first graders in five Seattle schools were allocated to intervention
or control classrooms, so that SSDP staff could test strategies for
reducing the risk factors for school failure, drug abuse and general
delinquency in children.
In each academic year, parents and teachers received training in how to
actively engage students in learning, facilitate the strengthening of family
bonds and commitments to school, and generally encourage positive
behaviours. The varied parental, teacher and student components aim to
reduce risk by improving attachments to both school and family as is
stipulated in social development theories.
Teacher component:
Teachers receive training in general and conduct and behaviour
management and in methods of influencing and guiding students.
234
Teacher training also includes sessions on proactive classroom
management and active learning methods.
Parental component:
When their children are attending first and second grade, parents receive
training in discipline and behavior management. For second and third
grade aged children, parents learn how to improve communication and
provide academic support. Finally, the parents of fifth and sixth grade
students attend training sessions on drugs and learn how to encourage
resistance skills in their children.
Student/ child component:
Children participating in the intervention, receive little programming
directed at specific risk factors, instead they learn how to develop general
life skills, self esteem, problem-solving skills, conflict resolution, and are
encouraged to participate in pro-social behaviours.
Data obtained from the interviews conducted throughout the duration of
the programme and in the years following school completion have
contributed to the programme developers efforts to test strategies for
youth development and collate more information on the causes of drug
use (including alcohol and marijuana), crime and delinquency and positive
youth development.
Risks targeted by the programme:
Low school achievement
Lack of commitment and attachment to school
Lack of commitment and attachment to family
Outputs and outcomes sought by the programme:
- Decrease drug use in young people (tobacco, alcohol and illegal
drugs).
- Decrease the numbers of youth who partake in sexual activity
and those who engage in high-risk sexual behavior.
- Decrease the levels of engagement in violent behavior in young
people.
Specified LM or Theory of Change:
The intervention is broadly based on social development theory.
Programme developers hypothesise that as a result of opportunities for
active involvement in the family and classroom, children will experience
more positive social bonds to the school and family. These bonds, when
actively reinforced, act as a protective factors reducing the risk of the
child developing delinquent behavior such as drug abuse, in addition to
health-related life risk behaviours.
235
Hypothesised LM or ToC:
Links to Other Programmes:
Quality of Programme:Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
236
(B) The Evaluation
Brief Description:
Since its implementation in 1981, the programme has been evaluated in
terms of its effects on sexual behaviour, antisocial behaviour and school
related behaviour. The evaluation has involved interviews in every
academic year and also a follow-up study was also conducted when the
programme participants were at age 18.
Evaluation Type:
Quasi-experimental evaluation of treatment and control groups of
elementary school children (n=643 at baseline; n=598 at age 18 followup; n=349 at age 21). Methods used included self-reported measures of
violent and nonviolent crime, substance use, sexual activity, pregnancy,
bonding to school, school achievement, grade repetition, school dropout,
and school suspension/expulsion. Children and their parents were
interviewed in each academic year, and post-tests were also conducted
when programme participants were aged 18. In addition, SSDP teachers
were evaluated throughout each year for levels of classroom performance
and integrity of programme implementation.
Comparison Group Received:
No intervention
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Attachment and commitment to school
Levels of alcohol and drug use
School achievement
Grade repetition
Truancy
Study skills
Levels of teenage pregnancy
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
A study evaluating the effects of the programme when students were in
sixth grade, conducted by O’Donnell, et al. (1995), highlighted the
237
following findings:
Low-income girls compared with control counterparts:
▪ felt they had more opportunities to participate in the classroom, and
were significantly more attached and committed to their school.
▪ were significantly less likely to have smoked cigarettes or tried alcohol
or marijuana.
Low-income boys compared with control counterparts:
▪ were rated significantly higher by teachers in terms of social
competence, study skills and dedication to school.
▪ had significantly higher grades and scored higher on standardized tests
in math, reading, and language arts.
▪ had less interaction with antisocial peers.
Overall, participation in the SSDP program resulted in a greater impact
on perceptions and beliefs and had a smaller effect on actual behaviors.
A further follow-up study conducted in 1999 by Hawkins, et al. (1999)
examined the effects of programme participation on the students at age
18:
• Exposure to late intervention (fifth or sixth grade only) did not improve
long-term outcomes.
Violent and drug-taking behaviours:
▪ Programme participants were 11.4 percent less likely than their control
counterparts to have committed violent delinquent acts.
▪ Programme students were significantly less likely than controls to have
engaged in heavy drinking in the year prior to assessment (15.4
percent versus 25.6 percent).
Sexual behaviours:
▪ Programme students were significantly less likely to have engaged in
sexual intercourse and to have had multiple sexual partners (72.1
percent versus 83 percent).
▪ Programme students were significantly less likely to have been
pregnant or to have caused a pregnancy (17.1 percent versus 26.4
percent).
▪ There were no significant differences between students in terms of
nonviolent delinquency, use of cigarettes, and use of marijuana or
other drugs.
School behavior:
▪ Programme students were significantly more bonded to school and
238
significantly less likely to have repeated a grade or dropped out.
▪ Programme students report being significantly less involved in school
misbehavior, such as skipping class, cheating, or being removed from
the classroom.
▪ There were no significant differences between groups in terms of levels
of suspension/expulsion or academic performance.
Other Evaluation Notes:
Quality of Evaluation: Good
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication:
Citation: High
239
C. Contact and Review Information
Internet:
SSDP Homepage: http://depts.washington.edu/ssdp/
Promising practices network:
http://www.promisingpractices.net/program.asp?programid=64
Advocates for Youth:
http://www.advocatesforyouth.org/programsthatwork/17seattle.htm
Five principle references:
Hawkins, J. D., Catalano, R. F., Kosterman, R., et al. (1999)
Preventing Adolescent Health-Risk Behaviors by Strengthening
Protection During Childhood. Archives of Pediatric Medicine, Vol.
153, pp. 226-234.
Hawkins, J. D., Catalano, R., Morrison, D. M., et al., (1992). The
Seattle Social Development Project: Effects of the First Four Years
on Protective Factors and Problem Behaviors. In McCord, J. and
Tremblay,R. (eds.) (1992). Preventing Anti-Social Behavior:
Interventions from Birth through Adolescence. New York, NY:
Guilford Press.
Hawkins, J.D., Von Cleve, E., & Catalano, R.F. (1991). Reducing Early
Childhood Aggression: Results of a Primary Prevention Program.
Journal of American Academy of Child Adolescent Psychiatry, Vol.
30, pp.208-217
O'Donnell, J., Hawkins, J. D., Catalano, R. F., et al., (1995) Preventing
School Failure, Drug Use, and Delinquency among Low-Income
Children: Long-Term Intervention in Elementary Schools, American
Journal of Orthopsychiatry, Vol. 65, No. 1, pp. 87-100.
Contact Details Progamme:
Karl G. Hill, PhD
Project Director, Seattle Social Development Project
Social Development Research Group
University of Washington
9725 3rd Avenue NE, Suite 401
Seattle, WA 98115
Phone: (206) 685-3859
Fax: (206) 543-4506
E-mail: khill@u.uwashington.edu
Contact Details: Evaluation:
Karl G. Hill, PhD
240
Project Director, Seattle Social Development Project
Social Development Research Group
University of Washington
9725 3rd Avenue NE, Suite 401
Seattle, WA 98115
Phone: (206) 685-3859
Fax: (206) 543-4506
E-mail: khill@u.uwashington.edu
First review: Sarah Blower
Second review:
241
Programme: Say Yes First – to Rural Youth and Family Alcohol/ Drug
Prevention (SYF)
A: The Programme
Programme Type:
Implemented in Northern Colorado as a 5 year demonstration project,
SYF is a school-based drug prevention project.
Brief Description:
Protective factors and resiliency are nurtured through various activities,
for example academic and health education programs, and family
activities designed to provide alternatives to drug use for youth and their
families.
Scope:
859 youths from four school districts participated in the programme over
5 years (1991-1996).
Target Population:
Elementary and middle school students.
Longer Description:
One interesting feature of this programme is the enrollment of low risk
students who have the ability to create a positive social influence on high
risk students. All of the students and their families partake in the core
components of the programme: team training, substance abuse
prevention program and case management.
Programme staff (school administrator, teachers, parents, programme
manager and other interested school staff) attend a two day team
training event every winter.
The substance abuse prevention programme consists of several
activities – health education programmes; academic programmes; parent
education and involvement programmes; alternative youth and family
activities; SYF councils; and youth leadership trainings. Health education
promotes the development of resiliency factors such as self-acceptance
and problem-solving skills, and also encourages healthy lifestyles.
Academic programmes involve tutoring and mentoring schemes and also
summer-enrichment programmes. Parenting programmes focus on
substance abuse education, parenting skills, career development, use of
community resources and family communication. Recreational activities
242
are also scheduled in order to involve the whole family in positive, drugfree activities, these included noncompetitive sports tournaments, BBQs,
walks, trips to the Zoo and museums, and going to see plays, all of which
were designed to encourage the development of interpersonal skills and
activity skills. SYF student councils encouraged students to be proactive
in the planning and delivery of SYF programmes. Youth leadership
training consisted of one day conferences and talks by local professionals
and high school students about the benefits of staying and doing well in
school, and in being drug-free.
Students are recruited into the programme by a case manager after
being identified as high-risk by school staff. The case manager conducts
home visits and regularly liases with and monitors families to check
progress and, if necessary, advise a course of intervention by school and
community services (e.g. socical services).
Risks targeted by the programme:
- Poor academic performance
- Low self-esteem
- Unhealthy lifestyles
- Transition to high school
- Limited opportunities for drug-free experiences in families, schools and
communities.
Outputs and outcomes sought by the programme:
Enhanced protective and resiliency factors:
- Academic success.
- Increase self-esteem and confidence.
- Personal involvement in positive drug-free experiences in families,
schools and communities.
- Knowledge of alternatives to alcohol, tobacco and other drug use.
- Parental involvement in recreational and educational activities.
- Family communication.
Specified LM or Theory of Change:
Hypothesised LM or ToC:
By strengthening protective factors such as academic success, selfesteem and confidence, healthy and active familial relationships, and
knowledge of the dangers of drug abuse, the programme aims to increase
the likelihood of “at-risk” youth leading drug-free lives.
Links to Other Programmes:
243
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics:
Consistency/Fidelity: Good
244
(B) The Evaluation
Brief Description:
Longitudinal evaluative study of a cohort of students participating in the
programme (grades 4-8) and followed-up three years later when they
were in 11th grade.
Evaluation Type:
Quasi-experimental longitudinal study that examined the programme
effects of SYF on a cohort of 395 students over 4 years, with longer term
effects investigated in a follow-up study three years after programme
completion. Methods included interviews, focus groups, secondary data
(obtained from school) and questionnaires. The follow-up study
examined the longer term effects of participation in the programme for
120 former programme students when compared with 136 students from
other schools who did not receive the programme.
Comparison Group Received:
First evaluation did not involve the use of a comparison/ control group.
For the follow-up study, students from other schools who did not receive
the programme were used as a comparison group.
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Academic achievement.
Lower levels of alcohol, tobacco and drug use.
Positive attitudes towards school.
Improved communication with family members and other adults.
Improved self-esteem and optomism.
School attendance.
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
More frequent participation in the programme was significantly associated
with better acheivement in reading (p=.04) and maths (p=.025). The
245
researchers failed to identify any other associations between participation
levels and other academic subjects.
Higher participation levels in the programme were significantly associated
with less increases in “other” drugs usage over time (p<.10). This relates
to cocaine, steroids, other illegal drugs, prescription and over-the-counter
medicines.
Students who participated more regularly in the programme reported a
lower increase in their amount of alcohol consumption than those who
attended less frequently (mean scores: high participation 0.27; moderate
participation 0.22; low participation 0.42). The programme was also
significantly associated with reduced lifetime alcohol use (p<.001)
In addition, for high risk students (defined by the student’s individual
score on a five point scale risk-factor assessment form) high participation
levels were associated with decreased drug use. Moderate risk students
experienced increased drug use following high levels of participation in
the SYF programme. There were no relationships between drug use and
participation levels for low-risk students.
School staff report increased levels of peer bonding and cooperation in
the programme students they have observed.
The follow-up study conducted three years after the completion of the
programme also highlighted some interesting programme effects.
Programme students report significantly higher school grades (p<.001);
significantly fewer days absent from school (p<.02); had significantly
more positive attitudes towards school (p<.03); fewer disagreements
with parents (p<.03); more communication and involvement with family
members and other adults (p<.05); significantly less often in trouble at
school (p=.10); and also scored lower on measures of negative selfappraisal and pessimism (p<.10).
The only signficant difference on measures of alcohol, tobacco and other
drug use between the comparison and programme groups in the follow-up
study was the larger number of self- reported marijuana users in the
comparison group (p<.09). There were however, no significant
differences in reported perceptions of drug use between the two groups.
Other Evaluation Notes:
246
Quality of Evaluation: Good
Sample: Good
Measures: Good
Control Group: OK
Other Innovation:
Replication:
Citation:
247
C. Contact and Review Information
Internet:
http://www.gse.harvard.edu/hfrp/projects/afterschool/mott/mott6.html
Five principle references:
Zavela, K.J., et al. (1997). Say Yes First: A longitudinal, school-based
alcohol and drug prevention project for rural youth and families. Journal
of Early Adolescence, 17, (1), 67-96.
Zavela, K.J. & Battistich, V. (2001). Say Yes First: Findings from the high
school follow-up assessments. Greely: Author.
Contact Details Progamme:
Kathleen J. Zavela, M.P.H., Ph.D., C.H.E.S.
Professor of Community Health
College of Health and Human Sciences
Univeristy of Northern Colorado
Department of Community Health and Nutrition
Gunter Hall 2360
Greeley, CO 80639
Tel: 970-351-1516
Email: kathy.zavela@unco.edu
Contact Details: Evaluation:
Kathleen J. Zavela, M.P.H., Ph.D., C.H.E.S.
Professor of Community Health
College of Health and Human Sciences
Univeristy of Northern Colorado
Department of Community Health and Nutrition
Gunter Hall 2360
Greeley, CO 80639
Tel: 970-351-1516
Email: kathy.zavela@unco.edu
First review: Sarah
Second review:
248
Program:
A: The Program Teen Talk
Program Type: Prevention of teen pregnancy program
Brief Description: The Teen Talk program was developed in 1983 to
1984 to help adolescents become aware of the serious negative
consequences of teenage pregnancy, the likelihood that they can become
pregnant, and the benefits of and barriers to abstinence and
contraceptive use.
Scope: originally the program was intended for family planning clinics,
later the program was rolled out to include schools.
Target Population: 13 to 19 year olds (males and females).
Longer Description: The program is based on two theories of human
behaviour: the Health Belief Model (viewing actions as dependent on
beliefs) and Social Learning Theory (emphasizing actions as proceeding
from the behaviours, thoughts, and feelings of others). It is thought that
this behavioural model foundation enables Teen Talk to address and
measure not only basic knowledge, but also participants' perceptions
relating to pregnancy and sexual activity, issues of self-efficacy, and
behavioural components. The program is predicated on the assumption
that a change in participants' beliefs will translate into real-world
behaviours and decision-making.
Risks targeted by the programmed: highlights the risk factors
associated with teenage pregnancy.
Outputs and outcomes sought by the program: Outputs: Increase
the percentage of youth who abstain from sexual activity or do not
engage in risky sexual behaviour.
Outcomes: Increase participants’ awareness to sexual activity issues and
increase a sense of self-efficacy and behavioural responsibility.
Specified LM or Theory of Change: ToC expressed is the assumption
that a change in the participants’ beliefs will translate into real-world
behaviors and stronger decision-making powers.
Hypothesised LM or ToC: See above for ToC
249
Links to Other Programmes: None known
Quality of Program:
LM or TofC: Good (ToC)
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
250
(B) The Evaluation
Brief Description: Controlled study involving 1,444 teenage males and
females 13 through to 19 years of age to compare the Teen Talk program
with other sexual activity programs already in place.
Evaluation Type: Controlled randomized study.
Comparison Group Received: other similar pregnancy prevention
programs to compare with Teen Talk.
Outputs Specified by Evaluation: Percentile reduction in abstention of
sexual behavior.
Outcomes Specified by Evaluation: increased awareness of sexual
health and contraception and more responsible sexual behavior.
LM or Theory of Change Specified by Evaluation: None.
Results: Outputs: One year after the program ended, of the boys who
had no previous intercourse, program participants were significantly more
likely to stay abstinent than boys who were not in the program.
Results: Outcomes: Although both experimental and control groups
showed an increase in levels of sexual and contraceptive knowledge and
health beliefs following the completion of their respective programs, this
improvement did not translate into changes in individuals' sexual
experience and behaviour at the one-year follow-up. In addition, there
was no significant difference in the change of beliefs between control and
experimental groups. These findings contradict expectations derived from
the behavioral model foundation on which the program is based.
Other Evaluation Notes: This program received a "promising" rating.
Evaluations indicate that the program produced some positive results,
however the results are somewhat inconsistent and fluctuate greatly
within and between test groups. Analysis of program data was conducted
along a fourfold framework, looking separately at participants who had or
had not engaged in intercourse at baseline and at males and females. The
results indicated that effectiveness varied widely among these four groups
(female baseline virgins and nonvirgins and male baseline virgins and
non-virgins). Effectiveness was shown to vary according to other
demographic characteristics as well, such as ethnicity and risk-status (for
example, lower income). This would suggest that the curriculum should
251
be tailored to the unique and specific characteristics of the given
population in order to maximize effectiveness.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication: n/k
Citation: High.
252
C. Contact and Review Information
Internet: pasha@socio.com
Five principle references:
1. Eisen, M., G. Zellman,
"A Health Belief's Field Experiment: Teen
Talk," in Miller, B., et al., eds., Preventing Adolescent Pregnancy,
Newbury Park, Calif.: Sage Publications, 1992, pp. 220-264.
2. Eisen, M., G. Zellman, and A. L. McAlister,
"Evaluating the
Impact of a Theory-Based Sexuality and Contraceptive Education
Program," Family Planning Perspectives, Vol. 22, 1990, pp. 261271.
3. Eisen, M., G. Zellman, and A. L. McAlister,
"A Health Belief's
Model-Social Learning Theory Approach to Adolescents' Fertility
Control: Findings from a Controlled Field Trial," Health Education
Quarterly, Vol. 19, No. 2, 1992, pp. 229-262.
4. Frost, J.J., and J. Darroch Forrest, Understanding the Impact of
Effective Teenage Pregnancy Prevention Programs, Family
Planning Perspectives, 1995. Vol. 27, No. 5, pp. 188-195.
5. National Academy of Sciences, The Best Intentions: The Causes,
Consequences and Prevention of Unintended Pregnancy,
Washington, D.C.: National Academy Press, 1995.
Contact Details Progamme:
Shobana Ragupathy, Ph.D.
Senior Research Associate
Sociometrics Corporation
Program Archive on Sexuality, Health and Adolescence (practitioner
support)
170 State Street, Suite 260
Los Altos, CA 94022-2812
Phone: (650) 949-3282, x209
Toll free: 1 (800) 846-DISK
fax: 650-949-3299
Contact Details: Evaluation: As above
First review: Carl Staunton 02/12/2004
Second review:
253
Programme: Travellers
Programme Type: school based early intervention programme
Brief Description: Programme helps young people manage and process
change, loss and transition thus preventing emotional distress, funded by
the New Zealand Ministry of Health
Scope: after initial pilot in 2 secondary schools has been rolled out over
10 secondary schools for 2 year period in 2003.
Target Population: 13 -14 year olds who have been identified and
selected and who are showing signs of emotional distress
Longer Description: progamme aims to foster healthy development of
young people by helping them to navigate change in their lives. The use
of the metaphor of ‘life as a journey’ is utilized. The method employed is
8 group sessions per term of 60-90 mins held in school time. School
counselor’s health educators and guidance personnel within schools are
trained to facilitate the groups.
Risks targeted by the programme: Psychosocial problems developing
in later life by boosting protective factors such as personal and
interpersonal coping.
Outputs and outcomes sought by the programme: Outputs sought
are improved educational awards Principally the outcome cited is
improvement of learning outcomes by providing a supportive environment
for distressed children and children being happier whilst at school.
Specified LM or Theory of Change:
Hypothesized LM or ToC: By using the metaphor of “life is a journey”
which is the link between all sessions the idea is that young people will
visualize life processes through symbols, words and objects that will
facilitate expression of personal meanings and give mental and emotional
well being which will improve learning generally and academically which
in itself will boost self esteem which will improve cognition etc.
254
Links to Other Programmes: None found
Quality of Programme: Good
LM or Tofu: Poor
Target Population Specified: Good
Attention to Ethics: Poor
Consistency/Fidelity: Good
255
(B) The Evaluation
Brief Description: Evaluation has been done on two schools that
underwent programme on the pilot phase. Current evaluation ongoing.
Evaluation Type: currently a 2year randomized control trial underway.
Awaiting results. Evaluation from the pilot study included: Review of
progamme materials: analysis of potential selection tools and feedback
from participants.
Comparison Group Received: N/A
Outputs Specified by Evaluation: None
Outcomes Specified by Evaluation: Principally to reduce distress in
selected children. The table demonstrates reduction:
Also the outcome stated was improvement of learning and school
performance
LM or Theory of Change Specified by Evaluation:
Results: Outputs: N/K
Results: Outcomes: Distress has marginally decreased in the two
school pilot groups; as demonstrated in the table
Mean distress scores for participants
PrePostProgramme
Programme
Mean
Mean
School A
30.05
29.72
School B
32.44
32.28
**p<0.01.
Also the added benefit of self-reported improvement in school
performance with no stigma reported in participating in programme.
Participants were said to have found the programme to be fun and felt
happier afterwards.
256
Other Evaluation Notes:
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: N/A
Other Innovation:
Replication: None
Citation: Low
257
C. Contact and Review Information
Internet: www2.auckland.ac.nz/ipc/pdf/rp130.pdf
Principle references: Australian and New Zealand Journal of Psychiatry
Vol. 37 Issue 3 Page 299 June 2003
Contact Details Progamme: attitudes. Innovation, creativity and
resiliency to endure Injury Prevention Research Centre, School of
Population Health, Faculty of Medicine and Health Sciences, University of
Auckland, Private Bag 92013, Auckland, New Zealand. Email:
p.dickinson@auckland.ac.n
Contact Details: Evaluation: As above.
First review: Carl Staunton 8th November 2004.
Second review:
258
Programme: Multidimensional Treatment Foster Care (MTFC)
A: The Programme
Programme Type: Prevention - delinquency and violence in adolescents
Brief Description:
Parents participate in a 20-hour pre-training service involving and
overview of the model, a four-step approach to analyzing behaviour is
taught, procedures for implementing the individualized daily programme
are demonstrated and discussed. Methods for working with the
adolescent’s biological family are reviewed. The TFC policies and
procedures are explained.
Scope: 300 youths have been served using the TFC model
Target Population: provides juvenile delinquents with rehabilitive
services
Longer Description:
MTFC provides training for families in the community. Behaviour
management methods are emphasised to provide youth with a structured
and therapeutic living environment. After completing a pre-service
training and placement of the youth, MTFC parents attend a weekly group
meeting run by a program case manager where ongoing supervision is
provided. Supervision and support is also given to MTFC parents during
daily telephone calls to check on youth progress and problems.
Services are provided to the Youth's Family. Family therapy is provided
for the youth's biological (or adoptive) family, with the ultimate goal of
returning the youth back to the home. The parents are taught to use the
structured system that is being used in the MTFC home. Closely
supervised home visits are conducted throughout the youth's placement
in MTFC. Parents are encouraged to have frequent contact with the MTFC
case manager to get information about their child's progress in the
program.
Coordination and Community Liaison is maintained. Frequent contact is
maintained between the MTFC case manager and the youth's
parole/probation officer, teachers, work supervisors, and other involved
adults.
259
Risks targeted by the programme: delinquency and violence
Outputs and outcomes sought by the programme:








To reinforce youth’s appropriate and positive behaviours
To closely supervise youth at all times
To carefully monitor peer associations
To specify clear, consistent rules and limits
To consistently follow through with consequences
To encourage youth to develop academic skills and positive work
habits
To encourage family members to improve communication skills
To decrease conflict between family members
Specified LM or Theory of Change:
Hypothesised LM or ToC: strengthening the family unit with early
intervention, which will prevent juvenile offending.
Links to Other Programmes:
There are two replications of the TFC model in progress; they are the
Early Intervention Foster Care (EITFC) programme and the TFC
programme-addressing females with criminal histories and severe
emotional and behavioural difficulties.
Quality of Programme: High
LM or TofC:
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
260
(B) The Evaluation
Brief Description: Four studies have been conducted evaluating the
effectiveness of TFC. In the first a matched comparison design was used,
young people were matched by age, sex, and date of commitment to the
State training school. The second study compared the effectiveness of
TFC versus typical community treatment for children leaving the state
mental hospital. The third study is made up of three groups of foster
parents and placed conditions from the TFC programme on the groups to
evaluate how the conditions affected disruption rates for children in
ordinary foster care. The fourth study included evaluations of the
effectiveness of two treatment models for male adolescents with histories
of chronic delinquency.
Evaluation Type: Randomised Controlled Trial
Comparison Group Received:
Study 1 – another programme
Study 2 – typical community treatment
Study 3 - Comparison group 1: assessment only; Comparison group 2:
payment only
Outputs Specified by Evaluation:





Reduction in arrests
Increased programme completion and supervision scores
Better relations with adults
Fewer relations with delinquent peers
Lower rates of problem behaviour
Outcomes Specified by Evaluation:
 Better outcomes
 Significantly fewer arrests
 More time spent in the home
LM or Theory of Change Specified by Evaluation:
261
Results: Outputs:



More TFC students complete their treatment programmes
TFC students have better supervision scores, consistent
discipline, better relations with adults and fewer relations with
delinquent peers
TFC students had lower rates of problem behaviour occurrence
per day
Results: Outcomes:



TFC led to better outcomes for children and families
One year on TFC participants had significantly fewer arrests
TFC youth incarcerated less often, and spent more time living at
home
Other Evaluation Notes:
In 1990 rates of incarceration for the first two years after treatment and
programme completion for those on the TFC programmme were much
lower than those who received treatment on other community placed
programmes.
Quality of Evaluation: High
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: High
262
C. Contact and Review Information
Internet:
www.colorado.edu/cspv/publications/factsheets/blueprints/FSBPM08.html
Five principle references:
Borduin, C.M., Mann, B.J., Cone, L.T., Henggler, S.W., Fucci, B.R., Blaske,
D.M., and Williams, R.A. (1995). Multisystemic treatment of serious
juvenile offenders: Long-term prevention of criminality and violence.
Journal of Consulting and Clinical Psychology 63(4):569-578
Chamberlain, P. (1994). Family Connections: Treatment Foster Care for
Adolescents with Delinquency. Eugene, OR: Castalia Publishing
Chamberlain, P., and Friman, P.C. (1997). Residential programs for
antisocial children and adolescents. In Handbook of Antisocial Behavior,
edited by D.M. Stoff, J. Breiling, and J.D. Maser. New York, NY: John
Wiley & Sons, pp. 416-424
Chamberlain, P., and Reid, J.B. (1991). Using a specialized foster care
community treatment model for children and adolescents leaving the
state mental hospital. Journal of Community Psychology 19:266-276
Dishion, T.J., and Andrews, D.W. (1995). Preventing escalation in
problem behaviors with high-risk young adolescents. Journal of Consulting
and Clinical Psychology 63(4):538-548
Contact Details Progamme:
Patricia Chamberlain, Ph.D.
Clinic Director, Oregon Social Learning Center
160 East 4th Street
Eugene, OR 97401
Phone: (541) 343-2388
Fax: (541) 343-2764
Email: pattic@oslc.org
Website: www.oslc.org
Contact Details: Evaluation:
263
Gerard Bouwman
TFC Consultants, Inc.
1163 Olive Street
Eugene, OR 97401
Phone: (541) 343-2388
Fax: (541) 343-2764
Email: gerardb@mtfc.com
Website: www.mtfc.com
First review: Emma Sherriff
Second review:
15-Nov-04
264
Programme: Multidimensional Treatment Foster Care (MTFC)
A: The Programme
Programme Type: Prevention - delinquency and violence in adolescents
Brief Description:
Parents participate in a 20-hour pre-training service involving and
overview of the model, a four-step approach to analyzing behaviour is
taught, procedures for implementing the individualized daily programme
are demonstrated and discussed. Methods for working with the
adolescent’s biological family are reviewed. The TFC policies and
procedures are explained.
Scope: 300 youths have been served using the TFC model
Target Population: provides juvenile delinquents with rehabilitive
services
Longer Description:
MTFC provides training for families in the community. Behaviour
management methods are emphasised to provide youth with a structured
and therapeutic living environment. After completing a pre-service
training and placement of the youth, MTFC parents attend a weekly group
meeting run by a program case manager where ongoing supervision is
provided. Supervision and support is also given to MTFC parents during
daily telephone calls to check on youth progress and problems.
Services are provided to the Youth's Family. Family therapy is provided
for the youth's biological (or adoptive) family, with the ultimate goal of
returning the youth back to the home. The parents are taught to use the
structured system that is being used in the MTFC home. Closely
supervised home visits are conducted throughout the youth's placement
in MTFC. Parents are encouraged to have frequent contact with the MTFC
case manager to get information about their child's progress in the
program.
Coordination and Community Liaison is maintained. Frequent contact is
maintained between the MTFC case manager and the youth's
parole/probation officer, teachers, work supervisors, and other involved
adults.
265
Risks targeted by the programme: delinquency and violence
Outputs and outcomes sought by the programme:








To reinforce youth’s appropriate and positive behaviours
To closely supervise youth at all times
To carefully monitor peer associations
To specify clear, consistent rules and limits
To consistently follow through with consequences
To encourage youth to develop academic skills and positive work
habits
To encourage family members to improve communication skills
To decrease conflict between family members
Specified LM or Theory of Change:
Hypothesised LM or ToC: strengthening the family unit with early
intervention, which will prevent juvenile offending.
Links to Other Programmes:
There are two replications of the TFC model in progress; they are the
Early Intervention Foster Care (EITFC) programme and the TFC
programme-addressing females with criminal histories and severe
emotional and behavioural difficulties.
Quality of Programme: High
LM or TofC:
Target Population Specified: Good
Attention to Ethics: Good
Consistency/Fidelity: Good
266
(B) The Evaluation
Brief Description: Four studies have been conducted evaluating the
effectiveness of TFC. In the first a matched comparison design was used,
young people were matched by age, sex, and date of commitment to the
State training school. The second study compared the effectiveness of
TFC versus typical community treatment for children leaving the state
mental hospital. The third study is made up of three groups of foster
parents and placed conditions from the TFC programme on the groups to
evaluate how the conditions affected disruption rates for children in
ordinary foster care. The fourth study included evaluations of the
effectiveness of two treatment models for male adolescents with histories
of chronic delinquency.
Evaluation Type: Randomised Controlled Trial
Comparison Group Received:
Study 1 – another programme
Study 2 – typical community treatment
Study 3 - Comparison group 1: assessment only; Comparison group 2:
payment only
Outputs Specified by Evaluation:





Reduction in arrests
Increased programme completion and supervision scores
Better relations with adults
Fewer relations with delinquent peers
Lower rates of problem behaviour
Outcomes Specified by Evaluation:
 Better outcomes
 Significantly fewer arrests
 More time spent in the home
LM or Theory of Change Specified by Evaluation:
267
Results: Outputs:



More TFC students complete their treatment programmes
TFC students have better supervision scores, consistent
discipline, better relations with adults and fewer relations with
delinquent peers
TFC students had lower rates of problem behaviour occurrence
per day
Results: Outcomes:



TFC led to better outcomes for children and families
One year on TFC participants had significantly fewer arrests
TFC youth incarcerated less often, and spent more time living at
home
Other Evaluation Notes:
In 1990 rates of incarceration for the first two years after treatment and
programme completion for those on the TFC programmme were much
lower than those who received treatment on other community placed
programmes.
Quality of Evaluation: High
Sample: Good
Measures: Good
Control Group: Good
Other Innovation: N/A
Replication: Good
Citation: High
268
C. Contact and Review Information
Internet:
www.colorado.edu/cspv/publications/factsheets/blueprints/FSBPM08.html
Five principle references:
Borduin, C.M., Mann, B.J., Cone, L.T., Henggler, S.W., Fucci, B.R., Blaske,
D.M., and Williams, R.A. (1995). Multisystemic treatment of serious
juvenile offenders: Long-term prevention of criminality and violence.
Journal of Consulting and Clinical Psychology 63(4):569-578
Chamberlain, P. (1994). Family Connections: Treatment Foster Care for
Adolescents with Delinquency. Eugene, OR: Castalia Publishing
Chamberlain, P., and Friman, P.C. (1997). Residential programs for
antisocial children and adolescents. In Handbook of Antisocial Behavior,
edited by D.M. Stoff, J. Breiling, and J.D. Maser. New York, NY: John
Wiley & Sons, pp. 416-424
Chamberlain, P., and Reid, J.B. (1991). Using a specialized foster care
community treatment model for children and adolescents leaving the
state mental hospital. Journal of Community Psychology 19:266-276
Dishion, T.J., and Andrews, D.W. (1995). Preventing escalation in
problem behaviors with high-risk young adolescents. Journal of Consulting
and Clinical Psychology 63(4):538-548
Contact Details Progamme:
Patricia Chamberlain, Ph.D.
Clinic Director, Oregon Social Learning Center
160 East 4th Street
Eugene, OR 97401
Phone: (541) 343-2388
Fax: (541) 343-2764
Email: pattic@oslc.org
Website: www.oslc.org
Contact Details: Evaluation:
269
Gerard Bouwman
TFC Consultants, Inc.
1163 Olive Street
Eugene, OR 97401
Phone: (541) 343-2388
Fax: (541) 343-2764
Email: gerardb@mtfc.com
Website: www.mtfc.com
First review: Emma Sherriff
Second review:
15-Nov-04
270
Programme: Triple P: Positive Parenting Program
A: The Programme
Programme Type:
Prevention of severe behavioural, emotional and developmental problems.
Brief Description:
The triple program is a multi-level system of intervention that seeks to
prevent severe behavioural, emotional and developmental problems by
improving the knowledge, skills and confidence of parents. The program,
which has 5 levels of increasing intervention, has been developed as the
result of over 25 years of scientific research, validation and evaluation.
Several evaluations have revealed Triple P is successful in improving
behavioural problems.
Scope:
Target Population:
The program targets parents of children at various stages of
development, who may display either specific, or multiple, moderate to
complex behavioural problems. The program is also available in a wide
range of formats and can therefore accommodate families and
communities with different needs and with different preferences as to the
type, intensity and mode of assistance they require (for example families
living in rural areas).
Although initially designed for 0-12 year olds, Triple P has recently been
extended to include 12-16 year old teenagers.
Longer Description:
The program was developed by the Parenting and Family Support Centre
at the University of Queensland and is broadly based around the concept
of self-regulation of parenting skills. The program aims to: promote the
development of non-violent and protective environments; promote
development, health and social competencies in children; reduce
incidence of child abuse and mental illness, behavioural problems and
homelessness; to improve parenting skills. These aims are reflected in
the 5-level approach of Triple P:
Level One – Universal Triple P: Mass Media Dissemination Media iniatives including television series’, newspaper columns and radio
coverage of parenting issues.
271
Level Two : Selected Triple P: Information through Primary Care Services
Brief seminars, self-help resources specific to developmental stage or
particular behavioural issues.
Level Three: Primary Care Triple P Emerging mild behaviour or development problems are addressed in four
15 minute consultation sessions with an accredited Triple P practitioner,
access to tip sheets and skills training.
Level Four: Standard, Group and Self-directed Triple P Teaching of skills applied to a broad range of child behaviours in home
and community settings. Standard: 10 hour sessions with accredited
practitioner. Particularly appropriate for kids with moderate to severe
behavioural problems. Group: 8 sessions for 10-12 parents. Early
intervention strategy for current behaviour problems. Self-Directed: 10
week self-help workbook and telephone consultation.
Level Five: Enhanced Triple PIndividually tailored for families with complex problems (e.g.
communication problems, parental maladjustment, partner support issues
or continual problems. Activities include anger and stress management).
There are also several other specialist Triple P programmmes.
Risks targeted by the programme:
Dysfunctional parenting practice
Conduct problems
Outputs and outcomes sought by the programme:
- more positive relationships
- more positive attitudes
- improvements in behavioural conduct
- prevention of problems in the family, school and wider community
- improved parenting practice
Specified LM or Theory of Change:
Chain of effect:
Dysfunctional parenting conduct problems delinquent behaviour
By providing evidence-based parenting advice and support such as simple
routines and small changes the chains of effect can be interrupted. The
272
program incorporates interventions at various stages in this chain in order
to prevent severe behavioural problems developing or getting worse.
Hypothesised LM or ToC:
Links to Other Programmes:
Parenting skills programmes.
Quality of Programme: Good
LM or TofC: Good
Target Population Specified: Good
Attention to Ethics: no information
Consistency/Fidelity: difficult to ascertain since the programme has
many levels and caters to the differing needs of many different groups of
children. However, the central theme is the enhancement of parenting
skills and this is consistent throughout each level and type of programme
delivery.
273
(B) The Evaluation
Brief Description:
There have been numerous evaluations of the Triple P program and its
various component interventions, which have consistently shown positive
effects on outcomes for those children whose parents have participated in
the program. The following relates to an evaluation undertaken by Bor et
al (2002) who evaluated the effects of Triple P enhanced and standard
programmes on 87 pre-school children with co-occurring disruptive
behaviour and attentional/hyperactive difficulties.
Evaluation Type:
Randomised control trial design with three conditions; enhanced Triple P,
standard Triple P and waitlist control. Data was obtained at three time
periods (pre-intervention, post-intervention and 1 year follow-up) by way
of 90 minute semi-structured interviews and parent-report measures.
Comparison Group Received:
Control group received the intervention one year after the study was
completed.
Outputs Specified by Evaluation:
Outcomes Specified by Evaluation:
Child behaviour.
Parenting practices.
Parenting satisfaction and competence.
Parental conflict.
LM or Theory of Change Specified by Evaluation:
Results: Outputs:
Results: Outcomes:
274
At the post-intervention stage children in the enhanced and standard
Triple P programmes displayed lower levels of disruptive behaviour than
children in the waitlist control group. However, there were no significant
differences between standard and enhanced programmes on any measure
of disruptive behaviour.
At the post-intervention stage mothers in both the enhanced and
standard Triple P programs reported significantly lower levels of
dysfunctional parenting practices than those in the wait list condition. In
addition, these mothers report more parenting satisfaction and
competence than the mothers in the waitlisted group.
Finally, the parents of children in the treatment groups experience lower
levels of conflict over parenting issues (self-reported) than those in the
waitlisted group.
All of these gains measured at the post-intervention stage were
maintained long-term according to a one year follow up study
Other Evaluation Notes:
ANOVAs indicated that there was no significant difference across
conditions on any of the measures at the pre-intervention stage which
indicates that all three groups were well matched prior to intervention.
No significant differences were reported on child behaviour measures
between those receiving the enhanced Triple P or Standard Triple P
interventions.
Quality of Evaluation:
Sample: Good
Measures: Good
Control Group: Good
Other Innovation:
Replication:
Citation: High
275
C. Contact and Review Information
Internet: www.triplep.net
Five principle references:
Bor, W., Sanders, M.R. & Markie-Dadds, C. (2002). The Effects of the
Triple P-Positive Parenting Program on Preschool Children with
Co-occuring Disruptive Behaviour and Attentional/Hyperactive
Difficulties. Journal of Abnormal Psychology, 30, 6, pp.571-587.
Sanders, M.R., Markie-Dadds, C. & Turner, M.T. (2003). Theoretical,
Scientific and Clinical Foundations of the Triple P Positive
Parenting Program: A Population Approach to the Promotion of
Parenting Competence. Parenting Research and Practice
Monograph No 1.
Sanders, M.R. (1992) Every Parent: A positive approach to children’s
behaviour. Sydney: Addison Wesley.
Sanders, M.R., Markie-Dadds, C., Tully, L. & Bor, B. (2000). The Triple
P Positive Parenting Program: A comparison of enhanced,
standard and self-directed behavioural family intervention for the
parents of children with early onset conduct problems. Journal of
Consulting and Clinical Psychology, 68, 624-640.
Sanders, M.R. & McFarland, M. (2000). The treatment of depressed
mothers with disruptive children: A controlled evaluation of
cognitive behavioural family intervention. Behaviour Therapy,
31, pp.89-112.
Contact Details Progamme:
Prof. Matthew R. Sanders,
Parenting and Family Support Centre,
The University of Queensland,
St Lucia
QLD 4072
Australia
m.sanders@psy.uq.edu.au
Contact Details: Evaluation:
Prof. Matthew R. Sanders,
Parenting and Family Support Centre,
The University of Queensland,
St Lucia
QLD 4072
276
Australia
m.sanders@psy.uq.edu.au
First review: Sarah Blower
Second review:
277
programme records
ID
1
programme
HeadStart
programme_type
Early Intervention (providing high quality services to children
from low income backgrounds to prepare them for school)
brief_description
HeadStart aims to promote healthy development in children from
birth to five years, in order to prepare them for school, and
enhance their quality of life.
scope
Over 800,000 children each year
target_population
Children from birth to age 5 from low-income families
longer_descriptio
HeadStart has expanded from a summer, in 1965, to a
year-round programme. HeadStart provide their children with
nutritious meals, opportunities for social, emotional and
intellectual enhancement which will make them more prepared
for school. The children are put in touch with healthcare and
support services to assist their families.
Educational topics encompassed include art, music, movement,
storytelling, learning about books, words, numbers and their
environment. Teachers try to create secure relationships with
each child. Children with disabilities and special needs receive
specialist provision in all areas.
Health service includes medical and dental care. Vision and
hearing tests, a dental check up and immunisation is available
to all.
Parents are encouraged to participate in setting goals for their
child's development. Home visiting is carried out, and classes
are provided for those who wish to attend. Parents are elected
to the programme's policy council.
risks_targetted
low income, lack of parental interest.
outputs_outcome
To improve school readiness on commencement of education
To improve physical health
To improve social skills
To promote intellectual development
To promote good parenting and parental interest in child
development
specified_LM_TO
HeadStart provides children with services that will ensure
school readiness and improve their overall quality of life.
hypothesised_LM
links
Early HeadStart is a programme serving infants and toddlers
following evidence that age 0-3 is the most vital in child growth
and development.
quality
High
278
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli Good
evaluation_descri
In 2000, a nationally representative sample of 3,200 children
took part in a Family and Child Experiences Survey (FACES).
Follow-ups were conducted on children who took part in the
1997 FACES survey, and their 'whole child' scores were
compared with the national average.
evaluation_type
n
comparison_grou
Longitudinal Survey of Families and Children
N/A
outputs_specified Scores on excercises
outcomes_specifi
Intellectual Improvement
Reading Skills
School Readiness
LM_ToC_specified
results_outputs
Significant improvements in scores on programme tests
results_outcomes Significant improvements in preliteracy skills
Significant improvements in adjustment
Significant improvements in social competence
Significant improvements in overall intellectual ability
other_evaluation_ There is a randomised controlled evaluation in progress the
'Building Futures: Head Start Impact Study', for which the
results will soon be available.
quality_of_evaluati High
sample
Good
s
measures
control_group
N/A
other_innovation
N/A
replication
Good
citation
C
internet
High
_TOC
www.acf.hhs.gov/programs/core/ongoing_research/faces/fac
es_pubs_reports.html
Good
www.headstartinfo.org
www.acf.hhs.gov/programs/core/ongoing_research/faces/fac
es00_4thprogress/faces00_4thprogress.pdf
five_principle_ref
Abbott-Shim, M., Lambert, R., & McCarty, F. (2000). Structural
model of Head Start classroom quality. Early Childhood
Research Quarterly, 15 (1), 115-134.
Administration on Children, Youth and Families. (2002). A
descriptive study of Head Start families: FACES technical
report I.Washington, DC: U.S. Department of Health and Human
279
Services.
Bryant, D. M., Burchinal, M., Lau, L. B., & Sparling, J. J. (1994).
Family and classroom correlates of Head Start children’s
developmental outcomes. Early Childhood Research Quarterly,
9, 289-309.
Fishel, J. E., Storch, S. A., Spira, E. G., & Stolz, B. M. (2003).
Enhancing emergent literacy skills in Head Start: First year
curriculum evaluation results. Presented at Biennial Meeting of
the Society for Research in Child Development,Tampa, FL.
McKey, R. H., Condelli, L., Ganson, H., Barrett, B. J., McConkey,
C., & Plantz, M. C. (1985). The impact of Head Start on
children, families, and communities. (DHHS Publication No.
OHDS 85-31193). Washington, DC: U.S. Government Printing
Office.
contact_details_pr
Building 330 C Street
S.W. Washington
D.C. 20201
Mary E. Switzer
Phone: 202-205-8572
Email: whill@acf.dhhs.gov
contact_details_ev Dr Michael L. Lopez
Federal Project Officer
Child Outcomes Research and Evaluation
Office of Planning, Research and Evaluation
Administration for Children and Families
Department for Health and Human Services
USA
Phone: 202-205-8212
Email: milopez@acf.hhs.gov
first_review
Emma Sherriff
17/11/04
second_review
280
ID
2
programme
Early Childhood Care and Education Project (ECEP)
programme_type
Early Intervention (progressing towards ‘school readiness’,
whilst having some impact on safety, health and mental health)
brief_description
This project employs the full range of evidence-based
strategies available to early childhood care and education (child
care, early intervention, and HeadStart). It aims to demonstrate
that lower child-staff ratios, smaller group size, homogenous
age groups, and high quality staff training contribute to a better
quality learning experience for children. The evaluation also
aims to review existing services that can be accessed.
scope
Up to 100 children across 15 ECEP Child Care Centers
target_population
Children 0-5 years
longer_descriptio
School Readiness - HeadStart curricula is taught to groups of 6
for infants, 12 for toddlers and 18 for preschoolers. Basic
skills in literacy and language are combined with lower
child-staff ratios and homogenous age groups.
Physical Health - Child safety issues in the classroom are
addressed in training and consistently monitored.
Social/Emotional Development - there is emphasis on forming
positive, supportive child-staff and peer relationships.
Mental Health - increased one-on-one time with staff will
reduce the risk of future mental health difficulties.
Teaching staff are given high quality training in the first
instance.
risks_targetted
classroom safety issues, lack of time with teacher, basic
reading difficulties, mental health problems
outputs_outcome
School readiness
Good mental health
Good physical health
High levels of safety
specified_LM_TO
The project provides a means by which programmes can work
together to prepare students for a seamless transition to basic
education.
hypothesised_LM
links
Uses HeadStart as a model in the amalgamation of curricula
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
281
consistency_fideli High
evaluation_descri
There is a thorough evaluation of all projects, regarding each
adaptation to teaching method, and surveys of trained
educational practitioners.
evaluation_type
Randomised Controlled Trial of up to 100 children (used to
assess the pre-school day care the children received)
comparison_grou
Typical child-staff ratio, varied age groups, basic staff training
outputs_specified Safety
outcomes_specifi
School readiness
Mental health
Physical health
LM_ToC_specified Subtle alterations to programmes such as HeadStart can
significantly improve school readiness, and later, school
performance.
results_outputs
n
Lower rates of infectious disease
Lower rates of accidents and physical harm
results_outcomes An improvement in educational outcomes for children
A positive early social and emotional development
A high level of mental development
(these are predictors of high school performance in later
childhood)
other_evaluation_ Conclusions are reached which can be practically applied by
providers of educational services for the early years.
quality_of_evaluati High
sample
Good
measures
Good
control_group
Good
other_innovation
N/A
s
replication
citation
High
internet
www.berksiu.org
C
www.hhdev.psu.edu/hdfs/faculty/greenberg.html
www.prevention.psu.edu/pubs/docs/regulat99.pdf
_TOC
M., Zins, J. E.,
Low
five_principle_ref
Greenberg, M. T., Weissberg, R. P., Utne O'Brien,
Fredericks, L., Resnik, H., & Elias, M. J. (2003). Enhancing
school-based prevention and youth development through
coordinated social, emotional, and academic learning, American
Psychologist, 58, 466–474.
Greenberg, M. T. (2004). Current and future challenges in
school-based prevention: The researcher perspective.
Prevention Science, 5, 5–13.
282
contact_details_pr
Beth Liddle
Berks County Intermediate Unit
1111 Commons Boulevard
P.O. Box 16050
Reading
PA 19612-6050
USA
Phone: 610-987-8542
Email: betlid@berksiu.org
contact_details_ev Mark T. Greenberg PhD
Prevention Research Center
Penn State University
109 South Henderson Building
University Park
PA 16802
USA
Phone: 814-863-0112
Fax: 814-865-2530
Email:mxg47@psu.edu
first_review
Emma Sherriff
20/11/04
second_review
283
ID
3
programme
Parents In Partnership - Parent Infant Network
programme_type
Early Intervention (Parental training in caring for a newborn)
brief_description
PIPPIN aims to help new parents effectively interact with their
new-born via 50 hours pre and after birth training, including
parental observations and their meaning, their perceptions of
their capacity to parent and own self-esteem.
scope
9089 parents reached; 161 professionals involved
target_population
ethnic minority and non-english speaking parents,
disadvantaged, teenage and unsupported mothers, mothers
with previous history of depression, mothers with previous
pregnancy or neo-natal loss, physically and mentally
diadvantaged parents.
longer_descriptio
The programme comprises of these two stages:
Prebirth- 3 x 2 hr group meetings (1 per week) from week 24
of pregnancy, 3 x 2 hr review and support sessions (1 per
fortnight) in late pregnancy, and 1 x 1 hr home or hospital visit
after birth.
Afterbirth - 6 x 2 hr group meetings (1 per week) with their
babies until 3-5 months old. These are all conducted at
institutions of NHS Trusts and charities.
Midwives, health visitors, family and social workers, child birth
and parenting educators, counsellors, nursery nurses and
childcare workers advise on emotional aspects of having and
bringing up a child, inc: how the birth affects you as parents,
emotions you will feel when baby is crying, communication
skills to use with partner and baby, etc. The focus is on the
couples developing practical and emotional skills.
risks_targetted
social exclusion, lack of support, mental health difficulties,
previous miscarriages/infant deaths, physical and mental
disadvantage
outputs_outcome
To offer services in response to educational and support
needs of childbearing families in Britain
To offer services which are cost efficient, self-supporting and
responsive to the financial limitations of NHS services and new
families
To assist families in recognising developmental stages of the
family life cycle and the influence of various stages on
relationships
To assist families in healthy adaptation to parenthood
To assist families in the development of knowledge, attitudes
and life skills
To improve NHS services so that all families giving birth in NHS
284
hospitals will participate in antenatal and postnatal education
programmes
285
specified_LM_TO
hypothesised_LM
Helping prospective parents to develop skills that will assist
them in bringing up their child reduces the likelihood of
impairment to the development of their child.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
Summary of feedback from 163 parents to a five point
questionnaire completed before and after professional input.
evaluation_type
Five point Parental questionnaire (Report of the results of a
complete Home Office evaluation pending)
comparison_grou
N/A
outputs_specified High participant satisfaction
outcomes_specifi
Lifestyle adaptation
Coping skills
Reduction in anxiety
Increased confidence
LM_ToC_specified
results_outputs
highly cost effective
results_outcomes Less anxiety
Less vulnerability to depression
s
To offer programmes for high risk and ethnic minority families
Greater
satisfaction in their relationship with their baby and
who are currently underserved by any NHS antenatal or partner
postnatal parent education programme
Increased confidence as parents
An increase in child-centred attitudes
The ability to use a wider repertoire of skills in coping
other_evaluation_ The Home Office is waiting on evaluation forms from the
remainder of the parents participating, before publishing the
final report.
quality_of_evaluati High
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
None
286
citation
High
internet
www.pippin.org.uk
five_principle_ref
Parr, M. (1996) Support For Couples In The Transition to Parent
Education. British Journal Midwifery, 6, (3): 160-165
Parr, M., Whittaker, V., and Paden, L. (1997). Adjustment to
Family life. In Henderson, C. and Jones, K. (Eds.) Essential
Midwifery, London: Mosby
Parr, M. (1995). Why PIPPIN was developed: Some research
findings. Stevenage: PIPPIN.
Woollett, A., and Parr, M. (1997). Psychological tasks for
women and men in the postpartum. Journal Reproductive and
Infant Psychology, 15: 159-183
Pugh, G., De'Ath, E., and Smith, C. (1994) Confident Parents,
Confident Children: Policy Practice in Parent Education and
Support. London: The National Children's Bureau
Buist, A., Westley, D., and Hill, C. (1999) Antenatal prevention
of postnatal depression, Archives of Womens' Mental Health 1:
167-173
contact_details_pr Joanne Sturges (Chief Executive)PIPPIN
Birch Centre Annex
Highfield Park
Hill End Lane
St Albans
Herts
AL4 0RB
ENGLAND
Phone: 01727 899099
contact_details_ev Carol Blomfield RGN RM Dip H.E, Project Coordinator
first_review
Emma Sherriff
20/11/04
second_review
287
ID
4
programme
Prenatal and infancy home visiting by nurses
programme_type
Early Intervention (promoting the well-being of first-time
low-income mothers and their children)
brief_description
The intervention aims to provide mothers with services in order
to improve their family’s quality of life. This includes: home
visiting by trained nurses, referrals to community resources,
and the development of the family's own resources, from birth
to the child's second birthday.
scope
Serves between 9,000-10,000 families in 23 states annually
target_population
First-time low income mothers and their families, especially
women under age 19
longer_descriptio
This includes parenting training and classes, transportation
services, assesses their support networks, provides
counselling, and aids in the seeking of employment/education.
The trained nurses provide this help and links to health
services that may not have been resourced. In addition, there
is treatment in the form of counselling for problems such as
domestic violence, and mental health problems, such as
depression and schizophrenia. The nurses helped the mothers
to elimnate use of alcohol, cigarettes and drugs. Other health
based intervention included: helping mothers improve their
diets, maintaining proper exercise, and showing how to identify
pregnancy complications. Nurses were also involved in
preparig parents for early care of a newborn and encouraging
appropriate use of the healthcare system.
risks_targetted
low income, social exclusion, lack of support
outputs_outcome
To improve pregancy outcomes
To improve child health and development
To improve families' economic self-sufficiency
specified_LM_TO
NFP services enhance the functioning of lone parent families
by providing practical services and support. This, then, will
have a positive impact on child outcomes.
hypothesised_LM
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
Three high quality impact studies which evaluate the effects of
the interventions. Impact is measured and evaluated at 4 years
and 15 years after the study took place.
evaluation_type
Longitudinal Impact Study
288
comparison_grou
N/A
outputs_specified
outcomes_specifi
Parents education, employment, life skills, problem behaviours,
reproduction, parenting
Child health, social/emotional, linguistic and cognitive
development
Teens criminal behaviour problems, sexual activity and
substance use
LM_ToC_specified
results_outputs
results_outcomes Better outcomes for poor, unmarried mothers
Better developmental outcomes for their children
Better outcomes in terms of substance use, antisocial and
n
criminal behaviour and sexual activity in their teens
other_evaluation_
quality_of_evaluati High
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
High
citation
High
internet
five_principle_ref
www.researchforum.org/project_general_168.html
Olds, D. L. (2002). Prenatal and infancy home visiting by
nurses: From randomised trials to community replication.
Prevention Science 3(3): 153-172.
Olds, D. L., Robinson, J., O’Brien, R., Luckey, D. W., Pettitt, L.
M., Henderson, C. R., Ng, R. N., Korfmacher, J., Hiatt, S., and
Talmi, A. (2002). Home visiting by nurses and by
paraprofessionals: A randomized controlled trial. Pediatrics
110(3): 486-496.
_TOC
contact_details_pr David Olds PhD
Department of Psychiatry
University of Colorado Health Services Center
Denver
ied
USA
CO 80262
s
Phone: (303) 864-5200
Email: Olds.David@tchden.org
contact_details_ev Same as above
first_review
Emma Sherriff
20/11/04
second_review
289
ID
5
programme
Home-Start International
programme_type
Early Intervention (providing support and training to isolated
lone parents)
brief_description
The programme provides support, friendship and practical help
to families. Homestart volunteers meet families in their home,
reassure parents that their difficulties are not unusual,
emphasise the pleasures of family life, develop a trusting
relationship with the family, encourage parents strengths and
competencies, help families widen their relationship networks,
and access support and services available in the community.
scope
Helping families worldwide
target_population
Families with at least one child under school age, who struggle
to cope with ill health, disability, poverty and other adversities.
longer_descriptio
Volunteers work with their individual family and provide them
with support in practical and other contexts. The volunteer
becomes a friend to the parent and child, helping them to cope
with their difficulty.
The family is strengthened by emphasising the strengths of the
parent, in order to encourage their confidence in parenting.
Home-Start volunteers help families widen their social network,
and show them how best to access the services that are
available in their area.
risks_targetted
Social isolation, poor mental health, poor physical health
outputs_outcome
To reduce social exclusion
To provide practical assistance
To widen family support networks
To provide friendship and emotional support
To build parenting confidence
specified_LM_TO
hypothesised_LM
Providing high quality support to families will improve their
child's quality of life.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
A 'family support outcomes' exploratory study, of families
receiving the service for 6 months. There is a major 3 year
research project following on from this.
290
comparison_grou
N/A
outputs_specified High level of service satisfaction
outcomes_specifi
Increased competency in basic household tasks
Increased competency in running a household
LM_ToC_specified
results_outputs
Higher risk Homestart mothers showed the greatest
satisfaction
Significantly less need of personal social services.
results_outcomes Changes in most families
other_evaluation_ As with other programmes of this nature there was a
reasonably high drop out rate, which has impact on the
interpretation of the results.
quality_of_evaluati Fair
n
sample
Fair
measures
Good
control_group
N/A
other_innovation
N/A
replication
Low
citation
High
internet
www.home-start.org.uk
www.home-start.org.uk/site/public.html
s
five_principle_ref
Van der Eyken, W. (1990). Home-start: A four-year
evaluation. Leicester: Home-start Consultancy.
contact_details_pr Brian Waller (Director)
2 Salisbury Road
C
Leicester
LE1 7QR
_TOC
ENGLAND
Phone: +44 (0)20 7631 4364
Email: brian@home-start-int.org
contact_details_ev Dr Colette McAuley
G2 7 Lennoxvale
Queens University
ied
University Road
Belfast
s
Northern Ireland
BT7 1NN
ty
Phone: +44 (0) 2890 245133 ext. 4586
ption
Email: c.mcauley@qub.ac.uk
first_review
Emma Sherriff
20/11/04
291
evaluation_type
Small scale exploratory study (long-term comparative cross
nation study evaluating Home-Start outcomes is pending)
292
second_review
293
ID
6
programme
NewPin
programme_type
Prevention (providing support to mothers bringing up children in
difficult circumstances)
brief_description
The NewPin programme seeks to ameliorate emotional stress,
reduce depression, increase self-esteem and improve
parent-child relationships. Volunteers provide practical and
emotional support, including counselling.
scope
Across the UK and replication in Australia
target_population
NewPin targets low income mothers living in poor conditions,
who have suffered domestic violence and rejection.
longer_descriptio
The training provided allows volunteers, who are mothers to
support other mothers in similar circumstances.
NewPin volunteers provide practical support, (e.g. budgeting,
cooking, coping in a crisis), and emotional support (group and
individual counselling programmes). This means that both
supporting and supported mother benefit.
The mother’s health visitor makes referrals to the programme.
risks_targetted
low income, poor living conditions, domestic violence, social
isolation, relationship problems, problems with children's health
and behaviour
outputs_outcome
To reduce emotional stress
To reduce depression
To increase mothers self esteem
To improve parent-child relationships
specified_LM_TO
hypothesised_LM
Preventing depression and emotional problems in parents will
improve quality of life in their children.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
The evaluation looked at 214 referrals in 1992. There was a
63% response rate to the survey. Users were asked about
take up and the usefulness of NewPin as a programme.
evaluation_type
Quasi-representative sample survey
comparison_grou
N/A
outputs_specified
outcomes_specifi
Parenting confidence
Mental health
294
LM_ToC_specified
results_outputs
results_outcomes Greater level of confidence in mothers struggling to cope with
raising families
Marked improvement in mothers mental health
other_evaluation_ Although NewPin is a strong intervention, there was a large
drop out rate, which may affect the interpretation of the
results.
quality_of_evaluati High
sample
measures
Good
Good
control_group
Good
other_innovation
N/A
replication
High
citation
High
internet
www.newpin.org
five_principle_ref
Cox, A.D., Pound, A., Mills, M., Puckering, C., Owen, A.L.:
Evaluation of a home visiting and befriending scheme for young
mothers: Newpin.
J Roy Soc Med 1991, 84:217-220.
Mondy, L; Bowditch, P. (1999). The first NEWPIN in Australia: a
partnership approach towards breaking the cycle of
destructive family relationships. In: 7th Australasian
Conference on Child Abuse and Neglect, Perth, WA, October
1999: conference proceedings. Canning Bridge, WA: Promaco
Conventions, 1999, volume 2, p779-785
Mondy, L. P., & Mondy, S. (2004). Situating NEWPIN in the
context of parent education and support models Children
Australia, 29(1), 19-25.
Oakley, Ann et al., "Supporting Vulnerable Families: An
Evaluation of Newpin," Health Visitor, May 1995;
68(5):188-191.
Pound, A. & Mills, M. (1985). A pilot evaluation of Newpin.
Newsletter of the Association of Child Psychology and
Psychiatry, 70, 13-15.
Pound, A. (1994). NEWPIN: A Befriending and Therapeutic
Network for Carers of Young Children. London: HMSO.
contact_details_pr National NewPin
Sutherland House
35 Sutherland Square
Walworth
London
ENGLAND
295
SE17 3EE
Phone: 020-7358 5900
Fax: 020-7701 2660
Email: info@newpin.org.uk
296
contact_details_ev Ms Linda Mondy via Christine Sinclair,
NewPin Burnside
13 Blackwood Place
North Parramatta
New South Wales
NSW 2151
Phone: 9671 7016
Email: csinclair@burnside.org.au
first_review
Emma Sherriff
20/11/04
second_review
297
ID
7
programme
Fairstart
programme_type
Early Intervention (intervening before birth and in the early
stages of the child's life to reduce the chances of further
health problems)
brief_description
Fairstart aimed to reduce child-maltreatment in the future, and
considerably improve the child’s health. Six programmes help
mothers to access support from their families, there is an
immunisation programme and breastfeeding clinic. Various
tests regarding the child's health are carried out.
scope
Babies and young children in Thunder Bay
target_population
Expectant mothers whose babies are at risk of health problems
longer_descriptio
There were six programmes, each helped the mothers to
access family support, immunise their babies, and ensured
they breast-fed. The child's hearing is tested by an audiologist,
sight by an optimetrist, and early years screeners test their
general level of health including vulnerability to disease.
risks_targetted
health risks, maltreatment
outputs_outcome
To reduce child-maltreatment
To reduce the risk of health problems in Fairstart babies
To considerably improve the child's health
To provide family support to new parents
specified_LM_TO
hypothesised_LM
Providing health screening, support and training to new parents
will reduce the potential for child-maltreatment and ill health in
later childhood.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
This programme was evaluated by a randomised control trial of
six projects (there was a potentially tenuous relationship
between Fairstart and a reduction in child maltreatment)
evaluation_type
Randomised Controlled Trial
comparison_grou
Typical state health provision
outputs_specified
outcomes_specifi
Health of baby
Behaviour of mother before birth
Health of baby after-birth
Behaviour of mother after birth
298
LM_ToC_specified
results_outputs
results_outcomes In 4 of the 5 Fairstart programmes marked improvement could
be observed in:
health of baby and behaviour of mother before birth
the health of the baby
the behaviour of parent after birth
the child’s early development.
other_evaluation_
quality_of_evaluati High
sample
Good
measures
Good
control_group
Good
other_innovation
N/A
replication
None
citation
High
internet
www.fairstart.ca/
Fairstart JK Screening Booklet (all age groups)
www.fairstart.ca/ click on JK Screening Booklet
five_principle_ref
None available
contact_details_pr Seven Community Partners
Thunder Bay District Health Unit
999 Balmoral Street
Thunder Bay
Ontario
USA
P7B 6E7
Phone: 625-8817 or 625-8819
Fax: 628-8664
e-mail: info@fairstart.ca
contact_details_ev Same as above
first_review
Emma Sherriff
20/11/04
second_review
299
ID
8
programme
The Florida Programme
programme_type
Early Intervention (to improve the level of care disadvantaged
mothers provide to their premature babies)
brief_description
The central aim of the Florida programme is to enhance the
care given to the infant (all of low birth weigtht) by the
disadvantaged mother, and improve the quality of the home
environment.
scope
Babies from disadvantaged families in Florida
target_population
The babies targeted by the intervention had low birth weights
of under 1800 grams and the majority were from ethnic minority
backgrounds (59% African American).
longer_descriptio
Child development specialists, mainly paediatric nurses were
allocated to each family participating to advise on care. The
programme improves child development, and maintains ‘mother
development’ by providing health screenings, immunisation and
advice. While the baby was in intensive care there were twice
daily contact of up to 90 minutes, and after discharge two
home visits per month.
risks_targetted
low birth weight, low income
outputs_outcome
To enhance infant care
To improve the quality of the home environment
To improve child development
To maintain mother development
specified_LM_TO
hypothesised_LM
Preventing difficulties that may arise for uneducated teenage
mothers in bringing up their children will prevent further health
problems and child maltreatment.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
Outcomes for 107 children with the 114 low weight babies.
Three-fifths of children were followed up for twelve months
with about a quarter monitored for twelve years.
evaluation_type
Longitudinal Randomised Controlled Trial
comparison_grou
Basic state provision
outputs_specified
outcomes_specifi
Mother-baby interaction
Physical development
Mental development
Emotional development
300
LM_ToC_specified
results_outputs
results_outcomes Significantly improvement in the way mothers interacted with
their children
Enhancing their physical, mental and emotional development
Less than 5% of babies participating suffered developmental
delay
other_evaluation_ The use of a structured programme of treatments and advice
giving allows us to see a clear representation of the effects of
the intervention.
quality_of_evaluati High
sample
Good
measures
Good
control_group
Good
other_innovation
N/A
replication
High
citation
Low
internet
//pediatrics.aappublications.org/cgi/content/full/104/6/e74
five_principle_ref
Resnick MB et al The Impact of Low Birth Weight, Perinatal
Conditions, and Sociodemographic Factors on Educational
Outcome in Kindergarten PEDIATRICS Vol. 104 No. 6 December
1999, p. e74
McCormick MC Has the prevalence of handicapped infants
increased with improved survival of the very low birth weight
infant? Clin Perinatol 1993; 20:263-277
Kitchen WH, Rickards AL, Doyle LW, Ford GW, Kelly EA,
Callanan C Improvement in outcome for very low birth weight
children: apparent or real? Med J Aust 1992; 157:154-158
Blackman JA Neonatal intensive care: is it worth it?
Developmental sequelae of very low birthweight. Pediatr Clin
North Am 1991; 38:1497-1511
Hack M, Klein NK, Taylor HG Long-term developmental
outcomes of low birth weight infants. Future Child 1995;
5:176-196
contact_details_pr Michael B. Resnick EdD
Professor and Director
Maternal Child Health & Education Research & Data Center
University of Florida
Department of Pediatrics
P.O. Box 100296
Gainesville
FL 32610-1361
Tel: 352-334-1360
301
Suncom: 625-1360
Fax: 352-334-1361
302
contact_details_ev Same as above
first_review
Emma Sherriff
20/11/04
second_review
303
ID
10
programme
Syracuse Family Development Program
programme_type
Early Intervention (providing teenage mothers with the
information, skills and resources to bring up their child)
brief_description
SFD aims to improve the lives of children born to poor,
uneducated teenage mothers by providing information on how
to bring up their child e.g. feeding, use of resources and
maintaining contact with their child's school. Health care
services are given prior to birth and there is a day care facility.
scope
Teenage mothers living in Syracuse
target_population
The project targeted poor, black, uneducated, teenage mothers.
longer_descriptio
The intervention itself was intensive in that it provided
information on how to bring up children, feeding, use of local
resources and the importance of maintaining contact with the
child’s school. For the children enriched day care, a daily
pre-school programme which focused on developing verbal
communication skills for the first four and a half years of their
lives. Prior to the birth mothers were provided with a range of
educational and health services. Trained staff visited the
mothers offering practical advice.
risks_targetted
Poverty, lack of parental experience, health problems for
mother and child, lack of education
outputs_outcome
To provide health care during pregnancy
To provide practical parenting skills
To access services in the community
To provide day care that ensures educational development
To provide children from uneducated families with the linguistic
skills to learn
specified_LM_TO
hypothesised_LM
Providing the skills, information and resources for poor,
uneducated teenage mothers to bring up their children correctly
will improve the child's development and prevent impairment
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
Syracuse conducted short and long-term follow-ups of the 82
participants were matched against the control group of 74.
evaluation_type
Longitudinal Randomised Controlled Trial
comparison_grou
Typical provision
304
outcomes_specifi
Intelligence scores
Likelihood of committing crime
LM_ToC_specified
results_outputs
results_outcomes Higher intelligence scores than the control group
Less likely to commit crime in adulthood
other_evaluation_ There is a tenuous relationship between the intervention and
the intelligence of each child. The intervention is of high quality,
and the use of a longitudinal study only enhances this.
quality_of_evaluati High
sample
Good
measures
Good
control_group
Good
other_innovation
N/A
replication
Low
citation
High
internet
www.dreamworld.org/sfc/
Blueprints Promising Programmes
www.colorado.edu/cspv/blueprints/promising/programs/BBP14
.html
five_principle_ref
Lally, J.R., Mangione, P.L., & Honig, A.S. (1988). The Syracuse
University Family Development Research Program: Long-Range
Impact on an Early Intervention with Low-Income Children and
their Families. In D.R. Powell, & I.E. Sigel (Editors), Parent
Education as Early Childhood Intervention: Emerging Direction in
Theory, Research, and Practice. Annual Advances in Applied
Developmental Psychology, Volume 3. Norwood, NJ: Ablex
Publishing Corporation.
Lally, J.R., Mangione, P.L., Honig, A.S., & Wittner, D.S. (1988,
April). More Pride, Less Delinquency: Findings from the
Ten-Year Follow-Up Study of the Syracuse University Family
Development Research Program. Zero to Three, 13-18.
Aos, Steve, Robert Barnoski, and Roxanne Lieb, Watching the
Bottom Line: Cost-Effective Interventions for Reducing Crime in
Washington, Olympia, Washington: Washington State Institute
for Public Policy, 1998.
Honig, Alice S., J. Ronald Lally, and Deborah H. Mathieson,
"Personal and Social Adjustment of School Children after Five
Years in the Family Development Research Program," Child
Care Quarterly, Vol. 11, No. 2, 1982, pp. 136-146.
Lally, J. Ronald, Peter L. Mangione, and Alice S. Honig, "The
Syracuse University Family Development Research Program:
305
Long-Range Impact on an Early Intervention with Low-Income
Children and Their Families," in D. R. Powell and I. E. Sigel
(eds.), Parent Education as Early Childhood Intervention:
Emerging Direction in Theory, Research, and Practice. Annual
Advances in Applied Developmental Psychology, Volume 3,
Norwood, N.J.: Ablex Publishing Corporation, 1988.
306
outputs_specified
307
contact_details_pr Syracuse Family Center
Po Box 6724
Teall Avenue Station
New York
USA
NY 13217-6724
Email: syrfc@aol.com
contact_details_ev Dr. Alice S. Honig
Professor Emerita of Child Development
Syracuse Family Development Research Program (FDRP)
202 Slocum Hall
Syracuse University
Syracuse, NY 13244
Phone: (315) 443-4296
Fax: (315) 443-9402
Email: ahonig@mailbox.syr.edu
first_review
Emma Sherriff
20/11/04
second_review
308
ID
11
programme
Educational Priority Areas
programme_type
Early Intervention (preventing educational underachievement in
young people from low income backgrounds)
brief_description
EPA's focus on improving young people's language skills and
enhancing parent participation in the education process (the
likely cause of educational underachievement among young
children) Set up in 1968, they are action research projects
based in five deprived areas of England and Scotland.
scope
Five areas in England and Scotland
target_population
Young children living in low income, high crime areas.
longer_descriptio
Language skills such as communication, reading aloud, are
taught to groups pre-schoolers as part of traditional and typical
child care.
Visits to the parental home are made by the scheme leader on
a weekly basis to inform them of their child's progress, with a
view to motivate them to participate in their child's education in
the future.
risks_targetted
low income, educational underachievement, involvement in
crime, lack of parental participation in education
outputs_outcome
To improve language skills
To increase parental participation in education
To improve educational achievement
specified_LM_TO
hypothesised_LM
Providing educationally-based care for children to prevent
impairment due to learning diffficulty.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
An evaluation of all five projects in the deprived areas of
England and Scotland.
evaluation_type
Meta-analysis of the results of five projects
comparison_grou
No information
outputs_specified The concept of educational priority is viable
outcomes_specifi
Educational ability
Contact with adults
LM_ToC_specified
309
results_outputs
Educational Priority is viable
results_outcomes Boosted educational abilities
Increased contact with adults
other_evaluation_ Any initial achievement declined through the intervention. The
benefits are difficult to maintain. The children gained, but it
proved difficult to get nursery schools to act on appropriate
models of linguistic disadvantage, cognitive deficits and
emotional deprivation.
quality_of_evaluati High
sample
Good
measures
Good
control_group
other_innovation
N/A
N/A
replication
Low
citation
Low
internet
www.bopcris.ac.uk/
five_principle_ref
Halsey, A.H., Department of Education & Science, and Social
Science Research Council. (1972). Educational priority: volume
1: E.P.A. problems and policies. London: HMSO
Payne, J., Department of Education & Science. (1974).
Educational priority. London: HMSO
contact_details_pr J Payne
Department of Education & Science
contact_details_ev Professor A H Halsey
Department of Sociology
University of Oxford
Manor Road
Oxford
OX1 3UQ
Email: chelly.halsey@nuf.ox.ac.uk
Tel: (01865-2) 78521
first_review
second_review
Emma Sherriff
20/11/04
310
ID
12
programme
Early Steps
programme_type
Early Intervention (to meet the needs of infants and toddlers
with physical, cognitive, communicative, social, emotional, or
adpative disability)
brief_description
To meet the needs of infants and toddlers from 0-3 yrs with
physical and mental conditions and their families. Early Steps is
provided as a locally based program to meet the needs of
infants and their families. Their services are designed to meet
the needs of an infant or toddler with a disability in one of five
developmental areas.
scope
3,595 Dec 2003
target_population
Children between birth and 36 months diagnosed with a
physical or mental condition
longer_descriptio
Early Steps is provided as a locally based programme to meet
the needs of infants and toddlers with a diagnosed physical
and mental conditions and their families. These disorders
include genetic disorders, congenital, neonatal, or postnatal
infections that affect the central nervous system, sensory
impairments, chronic or degenerative orthopedic and/or
neurological conditions, neonatal Intraventricular Hemorrhage,
posthemmorragic hydrocephalus, periventricular leukomalacia
or other significant intracranial disorders, technology
dependence for ongoing medically fragile condition, exposure
to known teratogens or drugs shown to cause birth defects
and findings of effects of such exposure, psychiatric
disturbances of infancy and childhood, and conditions arising
from a distressing event occurring during the neonatal period.
The local Early Steps closely with the Department of Education,
the Agency for Health Care Administration, and with other
providers to ensure the most effective early intervention
services. There are 16 services available as part of the
programme: audiology, speech-language pathology,
occupational therapy, physical therapy, special instruction,
health services, nursing services, vision services, social work
services, medical services, transportation, nutrition services,
family training, psychology services, service coordination, and
assistive technology.
An Individual Family Service Plan (IFSP) is a strategy for
providing services to the child. The team made up of the child's
parents, other family members, an advocate, the intake
coordinator, the family service coordinator, an evaluation
representative and early intervention service providers.
The IFSP team discuss the child's abilities and needs in order to
formulate the most beneficial service plan.
risks_targetted
physical and mental conditions
311
outputs_outcome
To meet the needs of infants and toddlers with physical and
mental conditions
To provide support to the families of these children
312
specified_LM_TO
hypothesised_LM
Providing specialised services to children with specialised
needs to improve their development and prevent/ease
impairment.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descry
A review of 1094 Louisiana service provider reports on children served,
services provided and entrances to/exits from the program.
n
evaluation_type
Outcome related performance review
comparison_grou
N/A
outputs_specified
outcomes_specifi
Needs of children and their families met
LM_ToC_specified
results_outputs
results_outcomes
Needs of children and their families met
other_evaluation_
quality_of_evaluati
Medium
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
Low
citation
Low
internet
www.oph.dhh.state.la.us
www.eikids.com/la/matrix/default.asp
five_principle_ref
contact_details_pr Sharanya Krishnan, Health Education Specialist
Louisiana Supreme Court Building
Loyola Avenue
New Orleans
LA 70112
Phone: 504-599-1072
Email: smkrishn@dhh.la.gov
313
contact_details_ev
first_review
same as above
Emma Sherriff
20/11/04
second_review
314
ID
programme
13
Healthy Start
programme_type
Prevention of ill health and improving pregnancy outcomes
brief_description
Healthy Start aims to improve the health of participants
between pregnancies, improve pregnancy outcomes and
promote positive parenting skills to assure a healthy start for
you and your baby.Healthy Start is a programme that helps
mothers to have the healthiest pregnancy possible.
scope
target_population
Any pregnant women who lives in Duval County can enrol.
Also, any child from birth to age three who lives in Duval
County is eligible.
longer_descriptio
Healthy Start is a voluntary and free program available to all
families in the community wanting to deliver and care for a
healthy baby. Prospective participants can contact their
healthcare provider or Healthy Start and ask to fill out a Healthy
Start screening form. The form is a short questionnaire and
answers are confidential.The Healthy Start programme
includes emotional support and counselling, case management,
home visits, childbirth education, information and referrals
and substance abuse counselling for expectant mothers.
Educational materials and classes to assist the mothers in
breastfeeding, family planning, smoking cessation, healthy
eating, immunization, child safety and parenting.
risks_targeted
Poor parenting
outputs_outcome
Better Parenting
specified_LM_TO
hypothesised_LM
Providing prospective parents with vital skills for caring for a
child will reduce child maltreatment and improve child quality of
life.
links
quality
High
LM_ToC
Good
target_pop_specif
Good
attention_to_ethic
Good
consistency_fideli
High
evaluation_descri
California, Healthy Start
Beginning in 1991, Healthy Start grants were provided by the
State Department of Education to local school systems and
their collaborative partners to integrate child and family
services. Grants are awarded to schools and their
collaborative partners to create more child and family centered
services systems, at or near school sites. The initiative is built
around the premise that educational success, physical health,
emotional support, and family strength are inseparable goals. A
315
ption
special emphasis is placed on improved school performance.
An early evaluation by SRI showed that student behavior,
performance, and school climate improved in Healthy Start
Schools. Families' unmet needs for basic goods and services
were reduced by half, and children and families gained access
to a broad array of services. Currently, there are about 400
grantees with almost 1,200 school sites. All grantees are
required to submit an annual report of schoolwide data for
each school as well as information on core clients. A recent
comparison_grou
N/A
outputs_specified
outcomes_specifi
LM_ToC_specified
results_outputs
results_outcomes
other_evaluation_
quality_of_evaluati
sample
measures
control_group
other_innovation
replication
citation
internet
five_principle_ref
contact_details_pr Jeff Goldhagen M.D
Duval County Health Department
515 W. 6th Street
Jacksonville
Florida
USA
SFL 32206 630-3300
Phone:
Email:
contact_details_ev
first_review
Emma Sherriff
20/11/04
second_review
evaluation (1997) based on 138 grantees showed the
following:
316
Test scores for schools in the lowest quartile improved
substantially with reading scores for the lowest performing
elementary schools increasing by 25% and math scores by
50%. Middle and high school students who were most in need
improved their grade point averages by almost 50%.
Student's health issues, especially preventive care, are being
addressed where they previously ignored.
Families reported improvement in filling basic needs such as
housing, food and clothing, transportation, finances and
employment.
Students receiving Healthy Start services decreased their drug
use.
Family violence was decreased.31
Healthy Start's report features a number of statements from
providers. John Nelson, the Principal of Vista Square
Elementary School, Chula Vista, CA reported his school's
approach to student monitoring. "We look at each and every
child, every quarter, to find out their academic progress, their
behavior progress, their social needs, and their emotional
needs. . . we have meetings with each of the classroom
teachers to discuss each and every child, we develop plans
for those children identified at-risk. Those plans become the
accountability for the staff to insure that we make referrals
either to the Center, …homework center, nurse contacts,
Student Study Team contacts or to counseling. Then we follow
up and monitor on a quarterly basis, so the individual plan
becomes almost like a hospital chart for monitoring the
progress of a patient. This…insures we are matching services
to their needs. We are a low-income and a very high
English-limited school…(yet) three of the four grades tested at
grade level…Healthy Start is a major component in student
achievement."
Contact: Lisa Villarreal, Director, California Community-School
Partnerships/Healthy Start Field Office, 530-754-6343,
lrvillarreal@ucdavis.edu
317
ID
14
programme
Promoting Alternative THinking Strategies (PATHS)
programme_type
Early Intervention (to prevent or reduce behavioural and
emotional problems)
brief_description
PATHS is a comprehensive programme which promotes
emotional and social competencies, reduces aggression and
behaviour problems in children while improving the educational
process. There is also information and activities for parents.
scope
Selected schools in the US
target_population
Elementary school children
longer_descriptio
The curriculum is taught three times per week for a minimum of
20-30 minutes a day. Teachers provide systematic,
developmentally based lessons, materials, and instructions for
teaching their students emotional literacy, self control, social
competence, positive peer relations, and interpersonal problem
solving skills. Its key objective is to prevent or reduce
behavioural problems.
Lessons include instruction in identifying and labelling feelings,
expressing feelings, assessing the intensity of feelings,
managing feelings, understanding the differences between
feelings and behaviours, delaying gratification, controlling
impulses, reducing stress, self-talk, reading and interpreting
social cues, understanding the perspectives of others, using
steps for problem solving and decision-making, having a
positive attitude towards life, self-awareness, nonverbal
communication skills, and verbal communication skills. Teachers
are trained in a two to three day workshop and in bi-weekly
meetings with the curriculum consultant.
risks_targetted
behaviour problems, emotional problems, aggression
outputs_outcome
Improved self control
Improved understanding and recognition of emotions
Increased ability to tolerate frustration
Use of more effective conflict-resolution strategies
Improved thinking and planning skills
Decreased anxiety/depressive symptoms
Decreased symptoms of sadness and depression
Decreased report of conduct problems, including aggression
specified_LM_TO
By enhancing the protective factors of emotional and social
competence, aggression and behaviour problems can be
prevented.
hypothesised_LM
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
318
consistency_fideli High
evaluation_descri
Three controlled studies, using one year PATHS implementation
with pre, post and follow up data.
evaluation_type
Longitudinal Randomised Controlled Trial
comparison_grou
Nothing
outputs_specified Conflict resolution strategy
outcomes_specifi
n
Self control
Understanding and recognising emotions
Ability to tolerate frustration
Thinking and planning skills
Anxiety/depressive symptoms
Conduct problems
Sadness and depression
Report of conduct problems and depression
LM_ToC_specified
results_outputs
Use of more effective conflict resolution strategies
results_outcomes Improved self control
Improved understanding and recognition of emotions
Increased ability to tolerate frustration
Improved thinking and planning skills
Decreased anxiety/depressive symptoms
Decreased conduct problems
Decreased symptoms of sadness and depression
Decreased report of conduct problems and depression
other_evaluation_
quality_of_evaluati High
sample
Good
measures
s
control_group
Good
other_innovation
N/A
replication
Low
citation
High
internet
C
www.modelprograms.samhsa.gov/template_cf.cfm?page=mod
el&pkProgramID
Good
Curriculum materials:
www.channing-bete.com/positiveyouth/pages/PATHS/PATHS.
_TOC
five_principle_ref
Greenberg, M.T., Kusche, C. & Milhalic, S.F. (1998). Blueprints
for Violence Prevention, Book Ten: Promoting Alternative
Thinking Strategies (PATHS). Boulder, CO: Center for the Study
and Prevention of Violence.
contact_details_pr Carol A. Kusche, Ph.D.
ied
Psychoanalyst and Clinical Psychologist
PATHS Training, LLC
s
927 10th Avenue East
Seattle, WA 98102
319
Phone and Fax: (206) 323-6688
Email: ckusche@attglobal.net
320
contact_details_ev Mark T. Greenberg, Ph.D.
Prevention Research Center
Human Development and Family Studies
Pennsylvania State University
109 Henderson Building South
University Park, PA 16802-6504
Phone: (814) 863-0112
Fax: (814) 865-2530
Email: mxg47@psu.edu
first_review
Emma Sherriff
26/11/04
second_review
321
322
ID
15
programme
Adolescent Pregnancy Prevention
programme_type
Prevention (to promote prevention as a strategy for reducing
teen pregnancy rates in the county)
brief_description
The programme aims to mobilise the Duval County community,
its residents, service providers and teens to address
pregnancy prevention from family planning and youth
development perspectives.
scope
Adolescents in the Duval County
target_population
Adolescents
longer_descriptio
The programme features life skills development, adolescent
health, parental education, and social marketing.
risks_targetted
teenage pregnancy, adolescent health problems, lack of
parental education
outputs_outcome
To prevent teenage pregnancy
To develop life skills
To improve adolescent health
To provide parental education
To market socially the issue
specified_LM_TO
hypothesised_LM
Providing education and contraceptive services to adolescents
will reduce rates of teenage pregnancy.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descry
RCT Pending preliminary state evaluation suggests that the program has had
significant impact on live births from teenage pregnancies. It is a variation of recommended steps
included in the National Strategy to Prevent Teenage Pregnancy.
evaluation_type
Statistical analysis of state statistics
comparison_grou
N/A
outputs_specified
outcomes_specifi
Reduced teenage pregnancies
Reduced births for teenagers
LM_ToC_specified
results_outputs
results_outcomes
Reduced teenage pregnancies
Reduced births for teenagers
other_evaluation_
quality_of_evaluati
Medium
323
sample
measures
Good
Good
control_group
N/A
other_innovation
N/A
replication
High
citation
High
internet
www.dchd.net/maternalchildhealth.htm
five_principle_ref
contact_details_pr Duval County Health Department
Main Office
515 W. 6th Street
Jacksonville
Florida
USA
FL 32206-6300-330
Phone: (904) 630-3255
contact_details_ev Dr William Livingood
Director Institute for Health, Policy and Evaluation Research
Duval County Health Department
900 University Blvd. North, Suite 604,
Florida
Jacksonville
FL 32211
USA
Phone: Bus (904) 630-3255
Fax: (904) 665-3111
Email: william_livingood@doh.state.fl.us
first_review
second_review
Emma Sherriff
20/11/04
324
ID
16
programme
Sure Start Plus
programme_type
Early Intervention (reducing the risk of long term social
exclusion, strengthening families and improving well-being)
brief_description
To reduce the risk of long-term social exclusion and poverty
from teenage pregnancy.To improve health and learning,
strengthen families and communities, and improve social and
emotional well-being.
scope
4000 teenagers (August 2004)
target_population
Teenagers and their families in 33 Health Action Zones across
England.
longer_descriptio
The relevant agencies provide pregnant teenagers with
access to healthcare and contraceptive advice. During the
early stages of pregnancy counselling services are provided to
assist informed decisions about the pregnancy.
Teenagers are also supported in caring practically for their
child. Sure Start Plus encourages parents to get back into
education or employment e.g. NVQ schemes. I
n addition, the families of the pregnant teenagers are brought in
to offer support to them and their child. Early bonding between
parent and child is encouraged, and children with emotional
and behavioural difficulties are identified early.
risks_targetted
Teen pregnancy, social exclusion, impairment to development
outputs_outcome
To reduce long-term social exclusion
To improve health and learning
To strengthen families and communities
To improve social and emotional well-being
specified_LM_TO
hypothesised_LM
Providing services and support to pregnant teenagers will
improve their health and their child's health, whilst giving them
the ability to cope with bringing up their child.
links
Sure Start
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
An SSRC Service Delivery Study evaluates the interim
progress of the Sure Start Plus programme.
evaluation_type
In depth interviews and focus groups, interviews and surveys
on 20 pilot programmes and interviews with staff.
325
outputs_specified
outcomes_specifi
Social isolation
Self confidence
Housing
Education
Health Services
Relationships
LM_ToC_specified
results_outputs
Enables access to the appropriate benefits
results_outcomes Most impact on helping women out of social isolation
Helps women to gain self-confidence
n
Helps to find housing
Helps to access education
Helps to access health services
Helps to improve relationships
other_evaluation_ A final report presenting findings of the evaluation will be
presented in December 2004.
quality_of_evaluati Fair
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
s
citation
None
internet
www.teenagepregnancyunit.gov.uk
C
www.dfes.gov.uk/teenagepregnancy/dsp_content.cfm?pageid
=74
_TOC
five_principle_ref
High
Wiggins, M., Austerberry, H., Rosato, M., Sawtell, M., and
Oliver, S. (2003). Sure Start Plus National Evaluation Delivery
Study: Interim Findings
contact_details_pr Samantha Akita - Programme Manager
Teenage Pregnancy Unit
Skipton House Room
580 D80 London Road
London
ied
England
s
SE1 6LH
ty
Phone: 020 7972 3715
Email: Samantha.akita@doh.gsi.gov.uk
ption
contact_details_ev Sure Start Plus National Evaluation Team
Phone: 020 7612 6397
Email: surestartplus@ioe.ac.uk
326
comparison_grou
N/A
327
first_review
Emma Sherriff
20/11/04
second_review
328
ID
programme
programme_type
brief_description
children
17
State Children's Health Insurance Program (SCHIP)
Prevention of Ill health in children from low income families
The state funds services provided by primary care trusts required by these
scope
Across the USA
target_population
children from low income backgrounds
longer_descriptio
Check-ups, medicines and the use of hospital facilities for children whose
income falls below the Medicaid threshold.
risks_targeted
ill health, low income
outputs_outcome
Better quality of health
Monitored development
specified_LM_TO
hypothesised_LM
Providing better health care services to children from low income family
backgrounds will improve their quality of life and ability to progress in education
links
Medicaid
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
An evaluation of Child Health Plus- the New York state arm of
SCHIP -interviewed the parents of 3,954 children (n = 1,828
upstate). Children enrolled for at least 9 months were included
in the stratified sample. In addition there were medical chart
reviews, cost analysis, analysis of datasets and provider
studies.
evaluation_type
Stratified sample surveys - Quasi-representative
comparison_grou
N/A
outputs_specified Improved access to care
Improved utilisation of care
outcomes_specifi
Improved care
Improvement on outcome measures
Improved asthma care
LM_ToC_specified
results_outputs
Improved access to care
Improved utilisation of care
results_outcomes Improved care
Improvement on outcome measures
Improved asthma care
other_evaluation_ There was a generally high level of satisfaction, but care was
not up to desired standards. Costs also increased for primary
care provision.
329
quality_of_evaluati High
330
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
Low
citation
High
internet
www.aap.org/advocacy/slides
five_principle_ref
AMERICAN ACADEMY OF PEDIATRICS: Implementation
Principles and Strategies for the State Children's Health
Insurance Program Committee on Child Health Financing
PEDIATRICS Vol. 107 No. 5 May 2001, pp. 1214-1220
Halfon, N., M. Inkelas, H. DuPlessis, and P.W. Newacheck.
1998. Measuring Access to Coverage and Health Care in
SCHIP. Presented at Learning from CHIP II, Department of Health
and Human Services, May 11, Washington, D.C. ---. 1999.
Challenges in Securing Access to Care for Children. Health
Affairs 18(2):48-63.
SCHIP's Steady Enrollment Growth Continues." Cambridge, MA:
Mathematica Policy Research, Inc., May 2003, Marilyn Ellwood,
Angela Merrill, and Wendy Conroy
"Implementation of the State Children's Health Insurance
Program(SCHIP): Synthesis of State Evaluations. Background
for the Report to Congress." Cambridge, MA: Mathematica
Policy Research, Inc., March 2003, Margo Rosenbach, Marilyn
Ellwood, Carol Irvin, Cheryl Young, Wendy Conroy, Brian
Quinn, and Megan Kell.
"Characteristics of SCHIP Eligibility and Enrollment Data
Systems: Feasibility for Supporting Research on SCHIP."
Cambridge, MA: Mathematica Policy Research, Inc., June 2002,
Angela Merrill, Wendy Conroy, and Brian Quinn
contact_details_pr
contact_details_ev Dr Peter Szilagyi, MD, MPH
University of Rochester
Department of Pediatrics
C/o Center for Child Health Research
1351 Mt. Hope Avenue, Suite 130
Rochester
NY 14620
Tel: 585-275-1544
first_review
Emma Sherriff
second_review
notes
331
on
332
ID
18
programme
The Abstinence Only Education Program
programme_type
Prevention (promoting abstinence as a healthy choice)
brief_description
The mission of the Abstinence Only Education Program is to
promote abstinence as a healthy choice and a positive lifestyle
through the implementation of programs designed to change the
culture and individual behavior about out of wedlock sexual
activity.
The program goals are: 1) to implement programs for school
aged children; 2) to implement programs for parents and
interested adults; 3) to reduce the incidence of out-of-wedlock
pregnancies and births; and 4) to involve the community in the
development and implementation of programs and activities that
promote and support the abstinence message.
scope
Selected schools and educational institutions across the US
target_population
teenagers attending programme schools and other institutions
longer_descriptio
The programme promotes abstinence and decision making for
healthy life choices. There has been a media campaign to
encourage abstinence until marriage. A comprehensive
network of 17 local projects in 12 counties that provide
abstinence education and activities in schools, youth centers,
group homes, detention centers and adult rehabilitation centers.
risks_targetted
Premature sexual activity, teenage pregnancy
outputs_outcome
To reduce premature sexual activity
To promote abstinence as a positive lifestyle choice
specified_LM_TO
Educating and campaigning about teenage pregnancy will
considerably reduce the proportion of incidences.
hypothesised_LM
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
737 programme participants were included in the follow-up
study, a vital statistics comparison (with state rates), an
examination of pre-programme trends and attitudes towards
abstinence and sexual behaviour.
evaluation_type
Longitudinal stratified survey
comparison_grou
N/A
333
outputs_specified Abstinence rates
outcomes_specifi
Live births
Attitudes towards abstinence and risk-taking behaviour
Personal value
Health benefits of abstinence
LM_ToC_specified
results_outputs
95% abstinence success rate
results_outcomes Live birth rates reduced by 22% for 16 yrs, 15% for 17 yrs,
11% for 15 yrs and 19% for 18 yrs
Attitudes to abstinence more favourable
Positive influence on risk and protective factors
Increase in personal value
Recognition of health benefits of abstinence
other_evaluation_
quality_of_evaluati High
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
Low
citation
High
internet
www.teenpregnancy.org/america
www.noappp.org
www.medinstitute.org
www.azdhs.gov/phs/owch/pdf/abstinence_final_report2003.p
df
five_principle_ref
Donahue, M.J. (1987). Promoting abstinence: Is it viable? Paper
presented at an Office of Adolescence Pregnancy Programs
technical workshop. Washington, DC
Lecroy & Milligan Associates, Inc. (2002). Abstinence Only
Education Program media and the public relations campaign
evaluation report June 2002. Phoenix, AZ: ADHS, Office of
Women's and Children's Health
Lecroy & Milligan Associates, Inc. (2001). Abstinence Only
Education Program media and the public relations campaign
evaluation report June 2001. Phoenix, AZ: ADHS, Office of
Women's and Children's Health
contact_details_pr Sarah Rumann, Health Program Manager
Office of Women's and Children's Health
150. N 18th Ave
Suite 320
Phoenix
Arizona
USA
Arizona 85007
334
Phone: (602) 364-1421
Fax:
(602) 364-1495
Email: rumanns@azdhs.gov
335
contact_details_ev Joe S. McIlhaney, Jr., MD, Founder/President
Leroy & Milligan Associates, Inc.
The Medical Institute for Sexual Health
P.O. Box 162306
Austin
TX 78716-2306
Voice:
Fax:
Email:
first_review
(512) 328-6268
(512) 328-6269
jmcilhaney@medinstitute.org
Emma Sherriff
20/11/04
second_review
336
Refusal skills
337
ID
19
programme
The Girl Neighborhood Power! Program
programme_type
Prevention (to reduce negative behaviour among teenage girls,
particularly teenage pregnancy and substance use)
brief_description
Girl Neighborhood Power aims to reduce substance use, to
prevent premature sexual activity and pregnancy, to increase
girls' knowledge and use of health care, promoting healthy
behaviours including nutrition, increasing girls knowledge about
career opportunities, and building girls' confidence in
academic, sport and other domains.
scope
Girls in four US communities
target_population
All girls of 9-14 years of age attending middle schools in four
US communities.
longer_descriptio
The essence of the program is in providing individual support
and resources to girls. The program includes some health
education, access to healthcare, mentoring,
before/after-school activities (including recreation, support and
cultural enrichment), opportunities to get involved in community
service, journal writing and career development.
risks_targetted
premature sexual activity, teenage pregnancy, substance use,
lack of confidence
outputs_outcome
To prevent premature sexual activity
To prevent teenage pregnancy
To prevent substance use
To increase knowledge and use of health care
To promote healthy behaviour
To increase knowledge about career opportunities
To build confidence
specified_LM_TO
hypothesised_LM
Providing girls with information about healthy behaviour and
helping them to develop themselves as individuals will reduce
their likelihood of becoming teen mothers.
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
Uses of qualitative and quantitative method to evaluate program
effectiveness. A comparison group was not used. Only girls
involved in the fourth year of the program were evaluated.
evaluation_type
Survey and Focus Group of Participants
comparison_grou
N/A
338
outputs_specified
outcomes_specifi
Teenage pregnancy
Self confidence
Social Skills
Academic ability
Health risk behaviours
Self expression
LM_ToC_specified
results_outputs
results_outcomes Reduced likelihood of teenage pregnancy (the longer enrolled,
reduced likelihood of becoming pregnant)
Increased self-confidence
Increased development of social skills
Increased academic ability
Lower levels of health risk behaviours
n
Positive self expression
other_evaluation_ Evaluators found it difficult to identify the impact of the program
on the participants fully, as child development in various
domains is difficult to measure. Additionally, the goals and
outcomes of the programs and parental involvement varied
according to area.
quality_of_evaluati High
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
None
citation
Low
internet
http://www.hmhb.org/Girlpower/
www.urban.org/UploadedPDF/410373_GNP-Study.pdf
five_principle_ref
National Research Council and Insitute of Medicine. (2000).
After School Programs to Promote Child and Adolescent
Development: Summary of a Workshop.
Zweig, J.M, and Van Ness, A. (2001). The National Study of
Girl Neighborhood Power: An Out-of School Program for Girls
Ages 9 to 14. Washington D.C: The Urban Institute
contact_details_pr George Guido, Chair
National Healthy Mothers, Healthy Babies Coalition
121 North Washington St., Suite 300
Alexandria, VA 22314
Tel: 703-836-6110
Fax: 703-836-3470
info@hmhb.org
contact_details_ev Janine, M. Zweig, Senior Research Associate
2100 M Street, N.W.
339
Washington,
DC 20037
Phone: (202) 833-7200
Email: paffairs@ui.urban.org
first_review
Emma Sherriff
20/11/04
second_review
340
ID
20
programme
Family Planning Program
programme_type
Prevention/Early Intervention (aims to reduce teen pregnancy
rates substantially by 2010)
brief_description
In order to focus our efforts and accomplish our stated
purpose, we have set two goals for ourselves. These include:
reducing the rate of teen pregnancy in girls aged 15-17 to 46
pregnancies per 1,000 population by 2010. Increasing the
number of women using an effective birth control method.
scope
Girls in Seattle and King County
target_population
Teenage girls aged 15-17
longer_descriptio
The programme addresses physical development, promotion of
sexual health, prevention of disease, affection, interpersonal
relationships, body image, and gender roles.
It spans the school years (grades 5-12 and secondary special
education) and uses an abstinence-based approach.
Information related to the prevention of pregnancy, HIV and
other sexually transmitted diseases is provided.
The programme aims to promote positive and healthy sexuality
in adulthood. It particularly focuses on the needs of public
schools with diverse communities. A wide spectrum of beliefs
on sensitive issues are discussed and family involvement is
encouraged.
risks_targetted
teen pregnancy, ill health, sexually transmitted diseases,
negative body image, negative personal relationships
outputs_outcome
To reduce the rate of teenage pregnancy in teenage girls aged
15-17 by 2010
To increase the number of women using an effective birth
control method
specified_LM_TO
hypothesised_LM
Providing education and increasing health care services in the
field will significantly reduce rates of teenage pregnancy
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descry
Evaluation Pending 2010
evaluation_type
comparison_grou
341
outputs_specified
outcomes_specifi
LM_ToC_specified
results_outputs
results_outcomes
other_evaluation_
quality_of_evaluati
sample
measures
control_group
other_innovation
replication
citation
internet
www.metrokc.gov/
You can download the complete curriculum from this URL:
http://www.metrokc.gov/health/famplan/flash/index.htm
five_principle_ref
contact_details_pr Public Health Seattle and King County
999 3rd Avenue, Suite 1200
Seattle
USA
WA 98104
Phone:
Email:
contact_details_ev
first_review
Emma Sherriff
20/11/04
second_review
342
ID
21
programme
Healthy Schools, Healthy Communities
programme_type
Prevention (providing healthcare screening and serviced to
high risk children)
brief_description
The programme was set up in 1994 to develop school-based
primary care programmes to serve high-risk children. These
school based health centres provide vulnerable adolescents
with counselling, mental and dental health services, nutrition
and health education.
scope
Over 160,000 at-risk school aged children
target_population
Children and adolescents living in low income areas
longer_descriptio
HSHC programmes provide diagnostic laboratory and radiologic
services, comprehensive risk assessments, well child
services, immunisations against vaccine-preventable diseases,
screening for elevated blood lead levels, communicable
diseases and cholesterol, eye, ear and dental screening for
children, preventive dental treatment services, emergency
medical and dental services, and pharmaceutical services.
Additional services provided include: violence prevention
activities, fitness programmes, home visits, wellness
promotion, parenting groups and self-esteem enhancement
activities.
risks_targetted
Ill health, impairment to physical development
outputs_outcome
To improve adolescent health
To prevent ill health in adolescents
specified_LM_TO
hypothesised_LM
Early screening and treatment in health will prevent impairment
to physical and psychological health in later life
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descry
Primary Care Effectiveness Review is the current evaluation in progress
results are pending. Preliminary findings suggest that the healthcare services provided to at risk
children demonstrably improves their health.
evaluation_type
comparison_grou
outputs_specified
outcomes_specifi
LM_ToC_specified
343
results_outputs
results_outcomes
other_evaluation_
quality_of_evaluati
sample
measures
control_group
N/A
other_innovation
N/A
replication
citation
High
High
internet
http://bphc.hrsa.gov/HSHC/Default.htm
five_principle_ref
contact_details_pr La Verne M. Green, Director
Center for School-Based Health
Division of Programs for Special Populations
Bureau of Primary Health Care
4350 East-West Highway, 9th Floor
Bethesda, MD 20814
Phone: (301) 594-4470
Fax: (301) 594-2470
Email: lgreen@hrsa.gov
contact_details_ev
Phone:
Email:
first_review
Emma Sherriff
28/11/04
second_review
344
ID
23
programme
The Independent Living Program
programme_type
Early Intervention (to assist young people in out-of-home
placements in successfully establishing themselves in the
community as adults)
brief_description
The Teen Independent Living Program aims to assist young
people in out-of-home placements to make plans for their
future, and make a successful transition to adulthood. This
includes preventing involvement in crime and premature sexual
behaviour.
scope
251 young people
target_population
All young people 16+ in foster care or in a group placement due
to abuse or neglect.
longer_descriptio
The programme includes many activities which each have a
financial incentive, these payments will contribute to a lump
sum which will assist in the young person purchasing
furnishings or paying deposit on accommodation.
Independent Living classes are offered by or coordinated by a
Community Resource Person (up to 75 hours): $3 an hour,
approved driver's education training: $15, working with a
Community Resource Person (age 14 to exit) (up to $25 a
year): $2 an hour, attending a regional workshop (age 14-18):
$20 a workshop, attending the Teen Conference (age 16-18):
$50 a conference, active participation in Youth Advocacy
group (up to 2 years): $40 a year.
Membership in an Independent Living workgroup (age 15 to
exit): $25 a year, completion of high school diploma/GED: $100,
maintaining a job for 6 months or 2 summers (age 16 to exit):
$25 for 6 months, maintaining a bank account (age 16 to exit):
$20 a year ,making and keeping medical appointments (age 16
to exit): $10 a year.
Participants must keep the Youth Organizer up to date: $50 at
exit, pass high school Life Skill Class ($25), positive legal
behavior: $50 at exit, completion of exit interview: $20 at exit,
investigation of post-secondary options or access: $20,
develop and follow money management with a
Community Resource Person: $10 a year, positive progress on
a case plan: $10 a quarter, working with a mentor (age 16 to
exit): $25 a year, and volunteering (non-court ordered): $25 at
exit.
risks_targetted
Crime and antisocial behaviour, lack of support, low income,
premature sexual activity, teenage pregnancy
outputs_outcome
To prevent involvement in crime and premature sexual
behaviour
To provide assistance in making plans regarding housing,
employment, education etc.
specified_LM_TO
345
hypothesised_LM
Providing looked after adolescents with the skills and
resources to set up on their own will prevent difficulties when
346
links
quality
High
LM_ToC
Good
target_pop_specif Good
attention_to_ethic Good
consistency_fideli High
evaluation_descri
A follow up study was conducted however only a small
percentage of the sample participated in the follow-up. There
was not sufficient evidence to show that the Independent
Living Program resulted in an increase in own home ownership
or rental, or of reduced teenage pregnancy in the long term.
The use of a randomised controlled trial (RCT) would have
enhanced the representativeness of the statistics.
evaluation_type
Longitudinal follow-up study of 251 participants
comparison_grou
N/A
outputs_specified
outcomes_specifi
Increased independence
Increased capability
Reduced likelihood of involvement in crime
Reduced likelihood of becoming a teenage/young parent
LM_ToC_specified
results_outputs
results_outcomes Young people become more independent
Young people become more capable
Less likely to be involved in crime
Less likely to become a teenage/young parent
other_evaluation_ The programme had a roughly 26% drop out rate for the 18
month period analysed.
quality_of_evaluati Fair
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
s
Low
citation High
internet
www.state.sd.us/social/CPS/IndepLiving/
www.dhhs.state.nh.us/DHHS?TEENINDEPENDLVG/default.htm
C
_TOC
www. Cjcj.org/programs/independent.php
leaving care.
Report:
http://www.dhhs.state.nh.us/DHHS/DCYF/LIBRARY/Program+
Report-Plan/dcyf-progress-rpt.htm
347
five_principle_ref
NH Division .(2002). The NH Division for Children, Youth and
Families Annual Progress and Services Report
contact_details_pr NH DHHS Division for Children
Youth and Families
129 Pleasant Street
Concord
USA
NH 03301-3857
Phone: (603) 271-8140
contact_details_ev Same as above
first_review
Emma Sherriff
20/11/04
second review
348
ID
30
programme
The Medicaid Program
programme_type
Prevention (to prevent ill health and teenage pregnancy in low
income families)
brief_description
The Medicaid programme provides young people, from low
income backgrounds and their families, with comprehensive
health services, including birth control and early screening.
scope
Across US
target_population
Persons of low-income including young people of poor
backgrounds. Individuals are eligible for Medicaid if they meet
the requirements for the Aid to Families with Dependent
Children (AFDC) programme that were in effect in their State on
July 16, 1996, or more liberal criteria. Pregnant women whose
family income is below 133 percent of the Federal Poverty
Level (services to these women are limited to those related to
pregnancy, complications of pregnancy, delivery, and
postpartum care). All children born after September 30, 1983
who are under age 19, in families with incomes at or below the
Federal Poverty Level.
longer_descriptio
Medicaid provides family planning services and supplies,
prenatal care, and physician services. Early and periodic
screening, diagnostic, and treatment (EPSDT) services are
provided to children (under age 21).
As well as, inpatient and outpatient hospital services, vaccines
for children, nursing facility services for adults (aged 21 or
older), rural health clinic services, home health care for
persons eligible for skilled-nursing services, federally qualified
health-center (FQHC) services, and ambulatory services of an
FQHC that would be available in other settings.
Laboratory and x-ray services, pediatric and family nurse
practitioner services, and nurse-midwife services are provided
where required.
risks_targetted
Ill health, teenage pregnancy
outputs_outcome
To provide comprehensive health services to low income
families
To prevent ill health
To prevent teenage pregnancy
specified_LM_TO
hypothesised_LM
Providing health services including screening and
contraceptive advice will reduce ill health and teenage
pregnancies in these adolescents.
links
quality
High
LM_ToC
Good
target_pop_specif Good
349
attention_to_ethic Good
consistency_fideli High
evaluation_descri Initial rct trials in the mid 1960s by Alpert suggest that children receiving
Medicaid support had on average 75% more well child visits and 32% fewer sick child visits. The
Medicaid outcome measures are analysed using state and national statistics as the programs operate
on a state-wide basis.
evaluation_type
RCTs and Statistical analysis of outcome measures (CSHCN Survey)
comparison_grou
N/A
outputs_specified
outcomes_specifi
reduction in teen pregnancy rates
reduction in ill health
reduction in poverty
LM_ToC_specified
results_outputs
results_outcomes reduction in teen pregnancy rates
reduction in ill health
reduction in poverty
other_evaluation_
quality_of_evaluati
High
sample
Good
measures
Good
control_group
N/A
other_innovation
N/A
replication
High
citation
High
internet
www.cms.hhs.gov/medicaid/
http://www.aap.org/research/pdf00/FY2000FullReport.pdf
five_principle_ref
Greenberg, M. (1998). Medicaid and the Uninsured.
Washington, DC: Kaiser Family Foundation.
Marquis, M.S., and S.H. Long. 1996. Reconsidering the Effect
of Medicaid on Health Care Services Use. Health Services
Research 30:791- 808.
Enrollment in the State Child Health Insurance Program, A
Conceptual
Halfon N, Inkelas M, Newacheck PW. Framework for Evaluation
and Continuous Quality Improvement. Milbank Quarterly.
1999;77(2).
Newacheck, P., D. Hughes, M. Pearl, and N. Halfon. 1998. The
Role of Medicaid in Ensuring Children's Access to Care. Journal
of the American Medical Association 280:1789-93.
350
Rosenbaum, S., K.A. Maloy, J. Stuber, and J. Darnell. 1998.
Outstationed Medicaid Enrollment: Policy Implications for
Welfare Reform and CHIP. Health Policy and Child Health.
Washington, D.C.: George Washington University Center for
Health Policy Research.
U.S. General Accounting Office. 1995. Health Insurance for
Children: Many Remain Uninsured despite Medicaid Expansion.
GAO/HEHS-95- 175. Washington, D.C.
351
contact_details_pr Centers for Medicare & Medicaid Services
7500 Security Boulevard
Baltimore
MD 21244-1850
Phone: 877-267-2323
contact_details_ev
first_review
Emma Sherriff
25/11/04
second_review
352
Download