www.cebc4cw.org
September 2014
The California Evidence-Based Clearinghouse
for Child Welfare (CEBC)
In 2004, the California Department of Social Services, Office of
Child Abuse Prevention contracted with the Chadwick Center for
Children and Families, Rady Children’s Hospital-San Diego in
cooperation with the Child and Adolescent Services Research
Center to create the CEBC.
The CEBC website was launched on 6/15/06.
The mission of the California Evidence-Based Clearinghouse for
Child Welfare (CEBC) is to advance the effective implementation
of evidence-based practices for children and families involved
with the child welfare system.
September 2014
The CEBC Website:
A searchable database of programs that can be
utilized by professionals that serve children and
families involved with the child welfare system.
Each program description contains easily
accessible and vital information, including, at a
minimum, a CEBC Scientific Rating, citations and
summaries of relevant published peer-reviewed
research studies conducted on the program, a
brief description of the program, and training
and contact information.
September 2014
CEBC Beyond the Website
 Technical Assistance to advance the use of EBPs that
address the needs of California Counties
 Informal consultation to those outside of California
to help advance the use of EBPs that address the
needs of their systems (additional web-based
resources to be available in 2015)
September 2014
Guidance for the CEBC
Advisory Committee
California DSS - Child and Family Services Division
County Child Welfare Departments
County Welfare Directors Association of California
California Child Welfare Training Organizations
Public & Private Community Partners
National Child Welfare Consultants
September 2014
Guidance for the CEBC
Implementation Science Panel
Greg Aarons, PhD-University of California, San Diego
Mark Chaffin, PhD-University of Oklahoma Health Sciences Center
Patti Chamberlain, PhD-Oregon Social Learning Center
Larry Palinkas, PhD-University of Southern California, School of Social Work
Sonja Schoenwald, PhD-Medical University of South Carolina
September 2014
Scientific Panel
Richard P. Barth, PhD - University of Maryland
Lucy Berliner, MSW - Harborview Clinic for Sexual Assault & Traumatic Stress
Mark Chaffin, PhD - University of Oklahoma Health Sciences
Stan Huey, Jr., PhD University of Southern California
Laurel Leslie, MD, MPH - Tufts University School of Medicine
Benjamin E. Saunders, PhD - Medical University South Carolina
Haluk Soydan, PhD - University of Southern California
September 2014
CEBC Team
Chadwick Center for Children and Families
Rady Children's Hospital-San Diego
Charles Wilson, MSSW
Project Director
John Landsverk, PhD
Scientific Director
Cambria Rose Walsh, LCSW
Project Manager
Jennifer Rolls Reutz, MPH
Research Program Specialist
Jennifer Demaree, MS
Content and Design Specialist
Rhonda Williams, MA
Research Associate
Chris Perkins
Project Analyst
Molly Robb
Project Coordinator
September 2014
What is Evidence-Based Practice
(EBP)?
September 2014
CEBC’s Definition of EBP
for Child Welfare
Best Research
Evidence
Best Clinical
Experience
EBP
Consistent with
Family & Client
Values
[Institute of Medicine (IOM), 2001]
September 2014
The CEBC Review Process
September 2014
CEBC Process
Identify topic areas
Narrow down program list
Work with program representative
to gather information
Review research on each program
Rate program, if applicable
September 2014
Scientific Rating Process
The Scientific Rating Scale
September 2014
Scientific Rating Scale
[**Based on a Continuum**]
NR
September 2014
Best Research Evidence
September 2014
Important Concepts
Randomized Controlled Trial
Peer-Reviewed
September 2014
1 = Well-Supported by Research Evidence
• 2+ rigorous randomized controlled trials (RCTs)
• One RCT has shown practice to have sustained
effect of at least one year beyond the end of
treatment
September 2014
2 = Supported by Research Evidence
• 1+ RCTs
• One RCT has shown practice to have a sustained effect
of at least six months beyond the end of treatment
September 2014
3 = Promising Research Evidence
• At least one study utilizing some form of control (e.g.,
untreated group, placebo group, matched wait list study)
has established the practice's benefit over the control, or
found it to be comparable to a practice rated a 1, 2, or 3
on this rating scale or superior to an appropriate
comparison practice
September 2014
4 = Evidence Fails to Demonstrate Effect
• Two or more randomized controlled trials (RCTs) have
found the practice has not resulted in improved
outcomes, when compared to usual care
• Preponderance of evidence does not support the efficacy
of the practice
September 2014
5 = Concerning Practice
If multiple outcome studies have been conducted, the
overall weight of evidence suggests the intervention
has a negative effect upon clients served.
and/or
There is case data suggesting a risk of harm that:
a) was probably caused by the treatment; and
b) the harm was severe and/or frequent
and/or
There is a legal or empirical basis suggesting that,
compared to its likely benefits, the practice constitutes
a risk of harm to those receiving it.
September 2014
NR = Not able to be Rated
There is no case data suggesting a risk of harm that: a) was
probably caused by the treatment; and b) the harm was severe
and/or frequent
There is no legal or empirical basis suggesting that, compared
to its likely benefits, the practice constitutes a risk of harm to
those receiving it.
The practice does not have any published, peer-reviewed study
utilizing some form of control that has established the practice's
benefit over the control, or found it to be comparable to a
practice rated 3 or higher on the CEBC or superior to an
appropriate comparison practice.
The practice does not meet criteria for any other level on the
CEBC Scientific Rating Scale.
September 2014
Strengths & Limitations
• Rating scale is clear cut
• Numbering system is easy to follow
• May miss high quality research and
null studies by relying on published, peerreviewed research
September 2014
Child Welfare System Relevance Level
High:
Designed or commonly used for child welfare clients.
Medium:
Designed or is commonly used for populations similar
to child welfare clients.
Low:
Designed for populations with little apparent similarity
to the child welfare services population.
September 2014
CEBC Process
Identify topic areas
Narrow down program list
Work with program representative to gather information
Review research on each program
Review each program and rate, if applicable
Post program information
September 2014
Number of Programs by Rating
Total= 339 programs as of September 30, 2014
September 2014
Child Welfare Outcomes
We also examined whether programs had included outcomes from
the Child and Family Services Reviews in their published, peerreviewed research:
Safety
Permanency
Well-Being
*In order to determine whether the program addressed a particular Child
Welfare Outcome, the research evidence must include studies evaluating
measures relevant to that Child Welfare Outcome.
September 2014
What You Can Find on the
CEBC Website
September 2014
Topics Currently on the Website
41 topics are clustered in the following areas:
• Anger Management, Domestic Violence,
and Substance Abuse
• Behavior Management including Parent
Training
• Core Child Welfare Services including
Placement and Reunification
• Engagement and Parent Partnering
Programs
• Mental Health
• Prevention and Early Intervention
• Support Services for Youth in the Child
Welfare System
September 2014
Other Resources
on the CEBC Website
September 2014
Implementation Tools- Selection Guide
• Selecting a practice that is a good fit with one's organization goes
beyond choosing a practice that is scientifically rated a "1" on the
website.
• The Selection Guide is based on the work of Trisha Greenhalgh and
her colleagues (2004).
• Greenhalgh conducted a systematic literature review that
addressed the question: "How can we spread and sustain
innovations in health service delivery and organization?"
• Using the key findings of this review, we have designed the
Selection Guide which is posted on the CEBC website.
• This guide is designed to assist child welfare professionals in
selecting which practices highlighted on the CEBC website to
implement in their agency.
September 2014
Online Trainings
Recordings of Webinars
•
•
•
•
•
•
•
Approaches and Outcomes for Implementing Evidence-Based
Practices in Child Welfare
Assessing Evidence-Based Practices in Child Welfare: A
Benefit-Cost Approach
Evidence-Based Treatments (EBTs) for Ethnic Minority Youth:
What We Know and What We Don’t Know
Integrating Evidence-Based Practice into Strategic Planning:
Building an Evidence-Based Continuum of Services
Knowing the Best of What’s Out There: Understanding and
Identifying Evidence-Based Practices in Child Welfare
Parenting Programs for Children Birth-8: What is the Evidence
and What Seem to be the Common Components?
"So Much Trauma, So Many Interventions: How Do We
Choose?“ (Parts 1 and 2)
September 2014
Practical Application of the CEBC
Website
September 2014
Using the Website
• Basic information is provided in the brief outline
• More detailed information allows a user to drill down to
get further information:
Research
Information that helps plan
implementation strategy
(Training, Identified Resources,
Minimum Provider Qualifications)
September 2014
Finding Information Fast
• Using the Search Tools
– Aside from searching by program name, the website
allows one to quickly identify programs by:
•
•
•
•
•
Topic Area
Scientific Rating
Child Welfare System Relevance Level
Child Welfare Outcomes
Age of Child
September 2014
Information for Students and
Professors
• Sample Lesson Plan for using the CEBC in
the classroom
• How to Conduct a Literature Review
• Other information on how the CEBC can
be helpful for students and professors
September 2014
For More Information about
the CEBC:
Sign up for Email Alerts of new programs
and content: www.cebc4cw.org/emailalerts
Visit the Website: www.cebc4cw.org
Contact Us – info@cebc4cw.org
September 2014
38
For More Information:
Cambria Rose Walsh, LCSW, Project Manager
Chadwick Center- Rady Children’s Hospital-San Diego
CEBC E-Mail: info@cebc4cw.org
CEBC Website: www.cebc4cw.org
September 2014