EVIDENCE-BASED PRACTICE:
RESOURCES AND STRATEGIES FOR
CITIZEN REVIEW PANELS
Alicia Luckie, MS
Edi Winkle, MSW
1
Evidence-Based Practices
Approaches to practice that are
validated by some form of
documented scientific evidence. These
practices can range from supported to
well-supported based on the strength
of the research design.
2
Evidence-Based Programs
A program that uses a defined
curriculum or set of services that, when
implemented with fidelity, have been
validated by some form of documented
evidence. These can range from
supported to well-supported based on
the strength of the evidence.
3
Evidence Informed Practices
Practices that use the best
available research and practice
knowledge to guide program
design and implementation
within context.
4
EBP &EIP
Shared Components:
Logic Model
Manual/Protocol
Not Harmful
Accepted Practice
Commitment to CQI &Ongoing Evaluation
EvidenceInformed
Emerging
•Ongoing
collection of
pre/post Data
•Peer Review
Supported
Promising
•All elements of •All elements of
emerging, plus: promising, plus:
•1 study, quasiexperimental
design with
control or
comparison
group
•Document all
implementation
activities
•model fidelity
Evidence Informed
•2 randomized
trials or 2 between
group studies (or
comparable
methodology)
Well
Supported
•All elements
of supported,
plus:
•Multiple site
replication
•one year
sustained effect
5
Evidence-Based
Practices VS. Programs
EB practices could be
skills, techniques, and
strategies that can be
used in various settings
EB programs consist of
collections of practices
that are done within
known parameters
6
Best Practices
Best Practices = Evidence-Informed Practices
Different term but same concept
Do the best practice and program design we can with
the knowledge and information we have access to
7
Evidence-Based Limitations
Small body
of research
in our type
of work
Diversity of
potential
target
population
Cookie
cutter fit
Ethical
issues in
research
design
Cost
Feasibility
of program
design
Core
component
availability
Staff
available
to deliver
services
Other
program
constraints
8
Stop, Need to Know
KNOW
How do you find
detailed info on a
specific
model/practice?
What are the
intervention
components?
Needs of
Community
Who should we
talk to?
What about
adaptation and fit?
Target Population
Where do we find
information on
EB/EI?
Targeted Outcomes
Then Consider…
9
Getting Started in Exploring EB/EI
Where do
we find
information
about
them?
•Registries
•Developer
Materials
•Journals
•Other Lists
10
Registries
Typically a searchable online resource
with programs and practices that have
been reviewed and rated
Assist the public in identifying
approaches that have been
scientifically tested
Information may be
• Rigorously reviewed
• Only voluntary
• Independent and objective
11
Using Registries
A Few Favorites
Multiple Registries Available
California Evidence-Based
Clearinghouse for Child Welfare
They each use different
criteria
SAMHSA Model Programs
Guide (NREPP)
Programs will be ranked
differently between registries
Promising Practices
Network
A few to get you started
with…
Wisconsin Clearinghouse for
Prevention Resources
12
Practice Examples
Parent Training
Incredible
Years
Safe Care
Circle of
Security
13
Current Picture
Potential Program
Program Outcomes
Target Population
Population Eligibility
Program Setting
Type of Service
Staff/Training
Qualifications
Length of Program
Resources and Costs
Program Materials
Availability and Support
14
PROGRAM COMPARISON EXAMPLE
Sections
Getting Started in Exploring EB/EI
Where do
we find
information
about
them?
•Registries
•Developer
Materials
•Journals
•Other Lists
15
Other Resources
Child Welfare Information
Gateway
• Clearinghouse for a wealth of
information
• Search feature that allows user to
narrow terms and time frames
• User friendly
• Librarians on staff
www.childwelfare.gov
Understanding Evidence
“The Matrix”
• Evidence based decision-making as
you think about ways to prevent
violence in your community
• Offers local practitioners and others
working to prevent violence
knowledge and resources for using
evidence in their decision making
process
• CBCAP Evidence-Based Program and
Practice Matrix
• Ranks programs in the CBCAP/PART
continuum according to review by
other registries
• Only a guide for reporting and
identifying potential programs
http://vetoviolence.cdc.gov/evidence/
#&panel1-1
www.friendsnrc.org
16
Challenges
Multi-Disciplinary Groups
• Diverse Systems
• Educating across systems (definitions and
language)
• Fragmented System (services)
Focus/Planning
•
•
•
•
Where to start? (w/limited resources, time, etc.)
Multiple programs
Determining levels of evidence
Educating Stakeholders
17
Strategies to Address Challenges
1) Multi-disciplinary Group – consider who is at the table. (law enforcement, judges, doctors, mental
health, etc.)
2) Use Registries/other resources to show programs that work. (CEBC, Child Trends, CDC)
3) Encourage Teams – Focus on a topic area such as infant mental heath/substance abuse/shaken
baby.
4) Focus on 1 Evidence-Based Program each year.
5) Add prevention programs and other service providers to CRPs. They help teams to produce better
outcomes.
6) Create a Learning to Action Network (ie. Strengthening Families/protective factors)
7) Advocate for Policy Changes – (ie. Home Visiting Legislation and Child Sexual Abuse Prevention)
8) Statewide Prevention Plan – include CBCAP Lead and other prevention partners.
18
Edi Winkle
bb ewinkle@friendsnrc.org
(918) 279-6682
Alicia Luckie
aluckie@friendsnrc.org
(334) 567-3291
19