NASC 2012 ANNUAL CONFERENCE
AUGUST 6, 2012
Ray Wahl
Deputy State Court Administrator
Why Evidence Based Practices Matter
If a program doesn’t target criminogenic factors, it
doesn’t lower recidivism (Bonta et al. 2008)
Focusing on the wrong offenders, increases the
likelihood of recidivism (Bonta, Wallace-Capretta & Rooney, 2000)
Programs that adhere to principles of
effective intervention result in lower
recidivism rates while programs that don’t
have higher recidivism rates (Gendreau P., French S.A.,
and A. Taylor, 2002)
If we want to see results, we have to use approaches that
work
Principles of Effective Intervention
Risk Principle—focus on offenders at high risk for
future criminal offending
Need Principle—target criminogenic needs
Treatment Principle—use behavioral
approaches
Program Fidelity—ensure quality
delivery
Why These Principles Matter
Better Outcomes
Andrews, Bonta & Hogue, 1990; Andrews & Bonta, 2006
Importance of
Program Fidelity
Why Program Quality Matters
Savings in
Juvenile
Programs
Source: Washington State Institute of Public Policy 2011
Why Program Quality Matters
Savings in
Adult
Programs
Source: Washington State Institute of Public Policy 2011
Importance of Program Fidelity
Fidelity to the
model and
program
delivery affect
offender
recidivism
rates.
Barnoski & Aos, (2004) Outcome Evaluation of Washington
State’s Research-Based Programs for Juvenile Offenders. WISP.
Importance of Program Fidelity
“What seems to most strongly characterize
effective CBT programs is high quality
implementation as represented by low
proportions of treatment dropouts, close
monitoring of the quality and fidelity of the
treatment implementation, and adequate CBT
training for the providers.”
Landenberger,& Lipsey, (2005). “The Positive Effects of Cognitive-Behavioral Programs for Offenders: A
Meta-Analysis of Factors Associated with Effective Treatment.” Journal of Experimental Criminology.
Importance of Program Fidelity
Fidelity to the
model and
program
delivery affect
the bottom
line.
Barnoski & Aos, (2004) Outcome Evaluation of Washington
State’s Research-Based Programs for Juvenile Offenders. WISP.
Ensuring Program
Fidelity
Assessment of Programs
We use a risk assessment to make
sure we aren’t mixing offenders or
focusing on low risk offenders
We use case planning to make sure
we are targeting criminogenic needs
and matching offenders to the most
appropriate programs
But how do we know if the programs we send
offenders to are doing any good?
Identifying Effective Programs
Focuses on higher risk offender
How do I
know if a
program is
effective for
treating
offenders?
Targets criminogenic needs
Use s evidence-based interventions
Bases program design on proven
theoretical model
Matches offender to treatment type
Ensure s quality delivery of program
Uses appropriate rewards and
punishers
Impact of the Numbers of Favorable
Features on Recidivism
Average
Practice
Number of
Favorable
Features
Distribution of
Programs
Percentage
Reduction in
Recidivism
0
7%
+12
1
50%
-2
2
27%
-10
3
15%
-20
4
2%
-24
Source: Adapted from Lipsey, 1997, 2005, cover 509 juvenile justice studies
Qualities of Good Programs
Ask These Questions
Is there stable leadership?
What training does staff receive?
What is there knowledge of EBP ?
Is there ongoing monitoring of program – quality assurance process
Is there a manual of operation? – Program must be researched based
What risk factors do they focus on ?
Do they use cognitive behavioral approaches – practice skills?
What is the dosage?
Do they focus on medium and high risk offenders?
What are their dropout rates?
Assessment Process Overview
Develop Case
Plan Based
on Risk
Assessment
Match Offender
to Effective
Services
Integrate
Program
Evaluation into
RFP & Contract
Use a
Validated Risk
Assessment
Measure Program
Outcomes in
Multiple Areas
Provide Ongoing
Expert Technical
Assistance
Evaluate Program
Annually Using a
Validated,
Standardized Tool
Provide Specific
Feedback to the
Program
What Utah is Doing to Ensure
Fidelity in Programs
Assessing programs using a research-based program
assessment tool
Each item on the assessment tool is related to reductions in
recidivism
The tool examines whether programs are implementing EBP
models with fidelity
Programs are provided with feedback on their progress and
ongoing assistance to improve
Recidivism is measured and linked to program assessment
results and provided to probation management and programs
Pre/Post tests measuring changes in offender attitudes and
behaviors
What Utah is Doing to Ensure Fidelity in
Programs Across the System
Validated risk instrument
Case Planning model
Correctional Program Checklist – program improvement
Certification of probation staff
Training, training , training
A vision statement that included EBP
Report Cards/Rich information system
Judicial/Legislative support
Contact Information
Ray Wahl – Deputy State Court
Administrator
rayw@utcourts.gov
801-578-3805