521: QSR Training: “Refresher Session”
Learning Objectives
• Identify the core components of PA’s Child
Welfare Practice Model
• Describe the roles and responsibilities of being a
QSR reviewer.
• Explain the core components of the QSR
Protocol, scoring, and providing feedback.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
2
Agenda
• Welcome and Introductions
• Core Components of Pennsylvania’s Child
Welfare Practice Model
• Roles and Responsibilities of a QSR Reviewer
• Interviewing Refresher
• Indicators and Scoring
• Feedback
• Questions, Next Steps, and Closing
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
3
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
4
What is Your Role?
Each pair of reviewers will conduct case reviews:
• Case file review
• Interviews
• Roll-Up Sheet
• Provide feedback to the caseworker (and supervisor)
• Present scoring rationale and recommendations at the
Case-Specific Team Debriefing
• Complete a QSR Written Case Review Summary.
Reviewers may also be invited to attend the Exit
Conference.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
5
Responsibilities of a QSR Reviewer
• Rate results/outcomes, not intentions (except
Practice Performance Indicators 1a and 8).
• Remember that this is a review of the system, not
individual caseworker;
• Rate the current child/youth status, not the past or future
(unless required by the parameters of the indicator).
• Follow the principles of the Practice Model and give
feedback in a constructive way, including improvement
needs, as well as strengths.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
6
Interview Refresher: Prior to the Interview
• Review the interview schedule and identify potential
questions.
• Identify the lead interviewer and note taker for each
interview.
• Remember that you are a reviewer who is responsible for
evaluating the system, not a caseworker responsible for
case management.
• Tune into self- Get in touch with feelings/concerns and
beliefs/values.
• Learn something about the interests of the child/youth to
better engage him/her.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
7
Interview Refresher: During Each Interview
•
•
•
•
•
Clarify purpose and roles
Recognize family strengths
Be patient with family stories
Listen more than talk
Use QSR questions and indicators to keep you on
track
• Always ask about the child’s safety
• Gather information, do not identify solutions
• Avoid leading questions
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
8
Interview Refresher: After the Interview
• Do not share information between interviewees
• Resist reaching conclusions/scoring before all
interviews
• Note areas needing confirmation or follow-up
• Contact your Site Lead and/or next interviewee if you
are running behind
• Contact your Site Lead to arrange any additional
interviews you.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
9
Child/Youth and Family Status Indicators
•
•
•
•
•
•
•
•
•
•
•
Safety: Exposure to Threats of Harm
Safety: Risk to Self/Others
Stability
Living Arrangement
Permanency
Physical Health
Emotional Well-Being
Early Learning and Development
Academic Status
Pathway to Independence
Parent or Caregiver Functioning
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
10
Practice Performance Indicators
•
•
•
•
•
•
•
•
•
•
•
•
Engagement Efforts
Role and Voice
Teaming
Cultural Awareness and Responsiveness
Assessment and Understanding
Long-Term View
Child/Youth and Family Planning Process
Planning for Transitions and Life Adjustments
Efforts to Timely Permanence
Intervention Adequacy and Resource Availability
Maintaining Family Relationships
Tracking and Adjusting
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
11
What Time Period is Considered in Scoring?
Child/Youth and Family Status Indicators look at
the past 30 days
– Exceptions are: Stability and Academic Status
Practice Performance Status Indicators look at the
past 90 days
– Exceptions are: Planning for Transitions and Life Adjustments
and Efforts to Timely Permanence

NOTE: Recent performance improvements have some
influence on scores
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
12
How are Cases Scored?
•
•
•
•
•
•
•
Each indicator is scored on a scale of 1 – 6
6 – Optimal
5 – Substantial
Acceptable Range
4 – Fair
3 – Marginal
2 – Poor
Unacceptable Range
1 – Adverse
• Maintenance Zone: 6-5
• Refinement Zone: 4-3
• Improvement Zone: 2-1
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
13
The Central Scoring Rules
• Focus on the Focus Measure and Core Concepts in
each indicator.
• Read each indicator’s instructions:
– Stay within the time-based observation windows
associated with each indicator.
– Rate indicators based on events that have occurred or
conditions that were present within the time-based
observation window.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
14
Distinction Between 3 and 4
The Groundhog Rule
If this case were frozen in time as it is
today, would performance or status be
considered acceptable or unacceptable?
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
15
Feedback Session with Caseworker
• Explain the purpose
• Conduct an accuracy check, analysis, and
strengths/challenge assessment
•Note that identification of new facts is common;
•Identify the strengths of the case
•Explain findings – Child/Youth and Family Status
•Explain findings – Practice Performance
•Invite the worker to offer suggestions for improvement
•Offer suggestions not identified by the worker
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
16
Case-Specific Team Debriefing:
Case Presentation Outline
• Brief synopsis of the child/youth/family story (2
minutes)
• Child/Youth and Parent/Caregiver Status
Indicator Rationale (4 minutes)
• Practice Performance Indicator Rationale (4
minutes)
• Next Steps (2 minutes)
• Group Questions/Feedback (3 minutes)
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
17
Purpose of Written Case Review Summary
• Explains the “story” behind the data by providing
the detailed qualitative information to support the
findings
• Provides feedback to Caseworker/Supervisor and
local leadership
• Provides an effective training tool
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
18
Written Case Review Summary
Important reminders:
• Style
• Content
• Final Review
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
19
Site-Specific QSR Information Shared
 QSR Review Team Pairings
 Dissemination of Case Summaries and
Interview Sheets
 Parking
 Security
 Weather
 Other
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
20
Questions/Answers
This is an opportunity for QSR Reviewers to
ask any additional questions that they might
have concerning the material that was
reviewed.
The Pennsylvania Child Welfare Resource Center
521: QSR Training: “Refresher Session”
21