Evaluator Capacity:
Improving Efficiency, Quality and
Culture
ESE’s Spring Convening 2015
Do Now:
Visit https://todaysmeet.com/springconvening
and create a “nickname.”
Answer the question: What qualities do you
look for in an evaluator?
2
Massachusetts Department of Elementary & Secondary Education
Session Agenda:
Run time: 9:45 AM – 11:00AM
9:45 – 9:50
Do Now
9:50 – 9:55
Why focus on evaluator capacity?
9:55 – 10:05
Stepping Off the Treadmill – Principal Karlene Ross, Northbridge
10:05 – 10:10
Round Robin Intro – Looking at Culture, Efficiency & Quality
10:10 – 10:25
Round Robin 1
10:25 – 10:40
Round Robin 2
10:40 – 10:55
Round Robin 3
10:55 – 11:00
Wrap-up
3
Massachusetts Department of Elementary & Secondary Education
Session Agenda:
Run time: 11:15 AM – 12:30PM
11:15 – 11:20
Do Now
11:20 – 11:25
Why focus on evaluator capacity?
11:25 – 11:35
Stepping Off the Treadmill – Principal Karlene Ross, Northbridge
11:35 – 11:40
Round Robin Intro – Looking at Culture, Efficiency & Quality
11:40 – 11:55
Round Robin 1
11:55 – 12:10
Round Robin 2
12:10 – 12:25
Round Robin 3
12:25 – 12:30
Wrap-up
4
Massachusetts Department of Elementary & Secondary Education
Session Agenda:
Run time: 9:45 AM – 11:00AM
9:45 – 9:50
Do Now
9:50 – 9:55
Why focus on evaluator capacity?
9:55 – 10:05
Courageous Learning – Principal Mary Berle, Berkshire Hills
10:05 – 10:10
Round Robin Intro – Looking at Culture, Efficiency & Quality
10:10 – 10:25
Round Robin 1
10:25 – 10:40
Round Robin 2
10:40 – 10:55
Round Robin 3
10:55 – 11:00
Wrap-up
5
Massachusetts Department of Elementary & Secondary Education
Session Agenda:
Run time: 11:15 AM – 12:30PM
11:15 – 11:20
Do Now
11:20 – 11:25
Why focus on evaluator capacity?
11:25 – 11:35
Courageous Learning – Principal Mary Berle, Berkshire Hills
11:35 – 11:40
Round Robin Intro – Looking at Culture, Efficiency & Quality
11:40 – 11:55
Round Robin 1
11:55 – 12:10
Round Robin 2
12:10 – 12:25
Round Robin 3
12:25 – 12:30
Wrap-up
6
Massachusetts Department of Elementary & Secondary Education
Why focus on
Evaluator Capacity?
Multi-Year Implementation Study
Methodology:
Annual educator interviews and focus groups
across a set of case study districts
Annual statewide surveys of principals and
school staff
Analysis of 110 school staff evaluation files
from three districts
8
Massachusetts Department of Elementary & Secondary Education
Multi-Year Implementation Study
Evaluators find the new evaluation system to be
time consuming.
 Binders of evidence
 Long, complicated observation forms
 Overly broad focus
Many districts have not adopted systematic or
long-term strategies to improve evaluator
capacity
Massachusetts Department of Elementary & Secondary Education
9
Multi-Year Implementation Study
# of Educators Assigned to Each Evaluator
2013-14
2014-15
1-10 Educators
4%
4%
11-20 Educators
33%
29%
21-30 Educators
32%
32%
31-40 Educators
17%
29%
40+ Educators
14%
6%
10
Massachusetts Department of Elementary & Secondary Education
Multi-Year Implementation Study
88% of school staff perceived their own
evaluator’s assessment of their performance as
fair.
 Consistent with 2013-14 data.
But only 45% percent of surveyed staff agreed
that the system as a whole is fair.
 Up from 43% in 2013-14.
11
Massachusetts Department of Elementary & Secondary Education
Improving “Capacity”
This year, ESE established a Professional
Learning Network (PLN) of 8 districts to try out
new ways of improving evaluator capacity.
12
Massachusetts Department of Elementary & Secondary Education
Improving “Capacity”
Evaluator Capacity can be influenced by many
factors. Today we’ll discuss four:
Culture
Efficiency
Quality
Workload
13
Massachusetts Department of Elementary & Secondary Education
14
 Coming Soon
Massachusetts Department of Elementary & Secondary Education
Stepping Off the Treadmill
Karlene Ross, Principal of W. Edward Balmer
Elementary School, Northbridge Public Schools
The Road Travelled
District Goal: Streamlining the Process for
Educators and Evaluators
My Goals:
Goal Setting
Actionable Feedback
15
Massachusetts Department of Elementary & Secondary Education
Courageous Learners
Mary Berle, Principal of Muddy Brook
Elementary School, Berkshire Hills Regional
School District
16
Massachusetts Department of Elementary & Secondary Education
Round Robin
Culture
Efficiency
Quality
Hadley
Northbridge
Weymouth
todaysmeet.com/culture
todaysmeet.com/efficiency
todaysmeet.com/quality
#metoo = “That resonates with me.”
#wecan = “I’m going to try that in my district.”
Massachusetts Department of Elementary & Secondary Education
17
Round Robin
Culture
Efficiency
Quality
Monson
Greater Lawrence
Berkshire Hills
todaysmeet.com/culture
todaysmeet.com/efficiency
todaysmeet.com/quality
#metoo = “That resonates with me.”
#wecan = “I’m going to try that in my district.”
Massachusetts Department of Elementary & Secondary Education
18
Highlights from Today’s Meet
Culture
Efficiency
Quality
Workload
19
Massachusetts Department of Elementary & Secondary Education