Student Growth Measures in Teacher
Evaluation
Module 4: Scoring an Individual SLO
1
Training Norms
•
•
•
•
Be present.
Respect time boundaries.
Recognize the need for quiet while working.
Use electronics respectfully and appropriately
when prompted.
• Return to large group attention when signaled.
2
Agenda
• Module 1: Introduction to SLOs
• Module 2: Selecting Appropriate Assessments
• Module 3: Using Data to Inform Growth Targets
and Submitting Your SLO
• Module 4: Scoring an Individual SLO
3
The SLO Development Process
STEP 1: Gather and review available data
STEP 2: Determine the interval of instruction and identify content
STEP 3: Choose assessments and set the growth target
STEP 4: Submit your SLO and prepare for approval and review
STEP 5: Final Scoring of the SLO
4
Timeline for SLO Scoring
Adjusted Timeline for SLO
Implementation: 2012‒2013
Timeline for SLO Implementation:
2013‒2014 and Beyond
December 1‒14—Write and submit
SLOs for approval
October—Write and submit SLOs for
approval
December—Receive feedback on the
SLO and, if necessary, revise
November—Receive feedback on the
SLO and, if necessary, revise
January‒End of April—Gather evidence of student progress
By May 1—Complete final submission form and meet with the evaluator to
discuss attainment of the SLO
5
What Comprises an SLO Score?
• An SLO final score represents the percentage of
students that met their growth targets.
• The percentage of students that met the growth
target then falls within a range that corresponds
to one of five descriptive and numerical ratings.
SLO Scoring Matrix
Percentage of Students That Met or
Exceeded Growth Target
Descriptive Rating
Numerical Rating
90‒100
Most Effective
5
80‒89
Above Average
4
70‒79
Average
3
60‒69
Approaching
Average
2
59 or less
Least Effective
1
6
SLO Scoring Example
• A teacher has 100 students included in an SLO.
• 90 students, or 90 percent of students, met their
growth targets.
• This percentage corresponds to a rating of “Most
Effective.”
SLO Scoring Matrix
Percentage of Students That
Met or Exceeded Growth
Target
90‒100
80‒89
70‒79
60‒69
59 or less
Descriptive
Rating
Numerical
Rating
Most Effective
Above Average
Average
Approaching
Average
Least Effective
5
4
3
2
1
7
Additional Scoring Example
• In an SLO with 89 students, 15 students did not meet
their growth targets.
• 74 who met targets divided by 89 students total = 83
percent meeting their growth targets.
• 83 percent corresponds to “Above Average.”
In this example, the following represent thresholds for each
corresponding performance level:
80 out of 89 students met growth target
71 out of 89 students met growth target
62 out of 89 students met growth target
53 out of 89 students met growth target
52 or less students met growth target
-
Most Effective
Above Average
Average
Approaching Average
Least Effective
8
From SLO Approval to Midcourse Review
• After approval, monitor student progress toward the
growth targets
– Interim or formative assessments
• ODE recommends a midcourse check-in
– Suggested timeline: February for full-year course;
otherwise, approximately midpoint in the interval of
instruction
• Bring evidence of student progress to discuss
– Interim/formative assessment data, student work products,
and other evidence that demonstrate growth is occurring
– Identify students off-target and come prepared to discuss
strategies to make up ground
9
SLO Scoring
• A streamlined process improves efficiency and
fairness.
• It is the responsibility of the teacher to organize
and present evidence to the evaluator or local
committee.
10
Preparing for SLO Scoring
• Steps in organizing and presenting the evidence:
1. Include a copy of the original, approved SLO
Template and Checklist.
2. Complete the Individual SLO Scoring Template.
3. Include example copies of the final assessments.
• Include any relevant rubrics or an explanation of how the
assessment was scored (e.g., for a portfolio of work or
performance assessment).
11
Individual SLO Scoring Template
• (Handout 4.1) This template is used to present the
data to demonstrate whether or not targets have
been met for individual students and includes the
aggregate percentage of students meeting the target.
Teacher Name:
School:
SLO Title or Number:
Assessment:
Student
Name
Student
ID
Baseline
Score
Is Baseline
a Pre-test:
Yes or No
Final
Assessment
Score
Growth
Target
Actual
Growth
Met
Objective:
Yes or No
one row
per student
…
% meeting or exceeding target:
Descriptive Rating
Numerical Rating
xx%
…
x
12
Completing the Individual SLO Scoring
Template
• Handout 4.2 provides instructions to complete the
scoring template.
Teacher Name: Mr. Yarmon
SLO Title or Number: Digital Media
Student
Student
Baseline
Is Baseline
Name
ID
Score
a Pretest?
(Yes or No)
School: Harrison Middle School
Assessment: District EOC and Student
Final
Growth
Actual
Assessment Target
Growth
Score
Kylie
George
…
89
34721SV
76
No
86
N/A
% meeting or exceeding target:
Descriptive Rating
Numerical Rating
Portfolio
Met
Objective?
(Yes or No)
Yes
83%
Above
Average
4
13
Cases in Which to Emphasize Use of
Multiple Measures
• Consider 10 students with writing deficiencies in
two different courses: English Composition and
Comparative Government
• Consider the effect of inaccurate growth targets
for those 10 students in two scenarios:
English Composition
Comparative Government
120 students in SLO
40 students in SLO
110 meet growth target
(92%)
30 meet growth target
(75%)
Rating: Most Effective (5)
Rating: Average (3)
14
SLO Scoring Outcome Scenario
• Scoring Example 1 – Mr. Ramirez
• Outcome: 95% met growth target; Most Effective (5)
•
•
•
Verbal and written performance assessment, an essay scored with a rubric,
and a multiple-choice exam.
Three tiers of growth set, based on a pretest, Spanish I data from the
previous year, trend data from Spanish II
Six students did not meet their growth targets
– These six students were in the middle tier of expected growth. All were
students toward the bottom of the middle tier in terms of prior
achievement.
• Q1: With the information you have been given, describe what
aspects of the SLOs appear to be strong.
• Q2: Are there any improvements that you might suggest Mr.
Ramirez make when setting his growth targets next time?
15
SLO Scoring Activity
• In small groups of three, read Handout 4.3 and
use the provided examples and questions to
facilitate a discussion around the SLO scoring
process. Designate one person to record for the
group.
16
Student Growth Measure Scoring
• The local education agency (LEA) will submit the
district plan in the Ohio Teacher and Principal
Evaluation System (eTPES)
– The plan will provide default percentages attributed to
types of student growth measures based on three
categories of teachers.
• The LEA will enter teacher scores into eTPES.
• Provides a consistent process
• Minimizes burden on LEA
17
District Plan Example
Teacher
Category
A (ValueAdded)
B (Vendor
Assessment)
C (LEA
Measure)
ValueAdded
10%‒50%
Vendor
Assessment
10%‒50%
40%
30%
LEA Measure
SLO/Other
Shared
Attribution
10%
0%
Total
50%
10%
10%
50%
40%
10%
50%
18
Variation in Student Growth Measure
Percentages Across Teachers
• Percentages attributed to student growth
measures may vary across teachers if the district
believes there is reason.
– Consistency across similar circumstances
– Comparability across grades and subjects
– Individual teachers do not choose percentage
attributed to measures.
19
Entering Student Growth Measure Scores
Per Teacher
• A worksheet similar to the following will be
completed for each teacher. See Handout 4.4.
LEA Measure
Score
Shared Attribution
Score
SLO 1
_______
Shared Attribution
_______
_______
SLO 2
_______
Vendor 3
_______
SLO 3
_______
Vendor 4
_______
SLO 4
_______
Vendor 5
_______
SLO 5
_______
Value-Added
Score
Vendor Assessment
Score
MRM Composite
_______
Vendor 1
_______
URM Composite
_______
Vendor 2
SLO/Other
Value-Added
Score
Vendor Assessment
Score
SLO/Other
Score
Shared Attribution
Score
Value-Added
Percentage
Vendor Assessment
Percentage
SLO/Other
Percentage
Shared Attribution
Percentage
STUDENT GROWTH MEASURES =
20
Final Student Growth Measure Score
• Once the individual SLO scores are input into eTPES, the
system will generate a final score that incorporates scores
from all student growth measures.
• Teacher index score converted to an effectiveness rating
– Above
– Expected
– Below
21
Reflection
• What stumbling blocks or concerns do you
anticipate that LEAs and teachers will have
around SLO scoring and combined student
growth measure scoring?
• How can this training better address these
stumbling blocks or concerns?
22
End of Module 4
This concludes Module 4: Scoring an Individual
SLO.
23