NREPP RATING ANALYSIS BY THE CALIFORNIA HEALTHY KIDS RESOURCE CENTER
SMARTTEAM
Program Abstract Posted on NREPP
SMARTteam (Students Managing Anger and Resolution Together) is a multimedia, computer-based violence-prevention intervention designed for 6th through 9th
graders (11- to 15-year-old students). The program is based on social learning theory as well as a skill acquisition model that approaches learning as a five-stage
process ranging from novice to expert, with learners at each stage having different needs. The software's eight modules use games, graphics, simulations,
cartoons, and interactive interviews to teach conflict-resolution skills in three categories: anger management, dispute resolution, and perspective-taking. Anger
management focuses on anger-control training; dispute resolution assists students in learning and using negotiation and compromise skills to resolve disputes;
perspective-taking allows students to understand that others may have views and feelings different from their own. The various modules can be used separately or
together in a sequential manner. Once installed on computers, SMARTteam is easy to use, requiring only rudimentary computer skills on the part of the students.
A. Does this program meet the minimum program requirements for inclusion on the Science-Based Programs List?
⌧
YES
This universal violence prevention program targets middle school students.
NO
Program Requirements
⌧ Universal, selective, and/or indicated prevention program
⌧ Targets one or more alcohol, tobacco, drug, disruptive behavior, and/or violence outcomes
⌧ Targets students in one or more grades K-12
B. Do this program’s NREPP ratings meet the minimum research ratings for inclusion on the Science-Based Programs List?
YES
⌧
NO
NREPP reports at least one behavioral outcome related to tobacco use, alcohol and other drug use, disruptive behavior, and/or violence for
SMARTteam. However, these behavioral outcomes related to disruptive behavior are not rated at or above the minimum standards on all criteria.
NREPP’s Quality of Research Ratings by Criteria (0.0-4.0 scale)
Reliability
Validity
Fidelity
Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Overall
Rating
Outcome 1: Self-awareness/self-knowledge
2.5
2.3
2.5
2.0
2.3
3.0
2.4
Outcome 2: Intent to use nonviolent strategies in resolving conflicts
2.5
2.3
2.5
2.0
2.3
3.0
2.4
Outcome 3: Beliefs supportive of violence
3.0
2.8
2.5
2.5
2.8
3.0
2.8
Outcome 4: Prosocial behavior
2.5
1.8
2.8
1.5
1.5
2.5
2.1
Outcome 5: Trouble-causing behavior
2.8
2.3
2.5
2.0
2.3
3.0
2.5
Outcome
Ratings posted on NREPP Web site: March 2007
CHKRC NREPP Rating Analysis Completed: September 2007
Download analysis at http://www.californiahealthykids.org/nrepp.html
Page 1 of 2
NREPP RATING ANALYSIS BY THE CALIFORNIA HEALTHY KIDS RESOURCE CENTER
SMARTTEAM
Behavioral Outcome(s) Reported by NREPP
Outcome 4: Prosocial behavior
Self-reported incidence of prosocial behavior was measured using six items asking students how many times they performed particular prosocial behaviors in the
last 30 days. The percentage of SMARTteam participants reporting prosocial behaviors increased from pretest to posttest (p < .01), with as much as a doubling in
the percentages of students engaging in behaviors such as assisting other students in solving problems (15% to 30%). Rates of name-calling (at least twice)
declined pretest to posttest (45% to 23%), a statistically significant decrease.
Reliability
Validity
Fidelity
Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Study Design
NREPP Ratings for
SMARTteam
2.5
1.8
2.8
1.5
1.5
2.5
Pre-experimental
CDE Minimum Ratings
2.0
2.0
2.0
2.0
2.0
3.0
Experimental or
Quasi-experimental
NREPP Criteria
Outcome does not meet
minimum standard for all
criteria.
Meets Minimum?
Outcome 5: Trouble-causing behavior
Students reported the number of times they had been in trouble at home, in the community, and at school in the last 30 days. Students were significantly less likely
to get into trouble at home, in the community, or at school after participating in SMARTteam. The pretest-posttest changes were substantial: The percentages of
students reporting never getting into trouble at home and at school increased from 13% to 32% and from 33% to 44%, respectively.
Reliability
Validity
Fidelity
Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Study Design
NREPP Ratings for
SMARTteam
2.8
2.3
2.5
2.0
2.3
3.0
Pre-experimental
CDE Minimum Ratings
2.0
2.0
2.0
2.0
2.0
3.0
Experimental or
Quasi-experimental
NREPP Criteria
Meets Minimum?
Ratings posted on NREPP Web site: March 2007
CHKRC NREPP Rating Analysis Completed: September 2007
Download analysis at http://www.californiahealthykids.org/nrepp.html
Outcome does not meet
minimum standard for all
criteria.
Page 2 of 2