Act on Lead Measures - Davis School District

advertisement
Davis School District
Learning First! Special Education Planning Day
“Achieving Your Wildly Important Goals”
Adapted from McChesney, Covey, & Huling, The 4 Disciplines of Execution
Discipline 1:
Focus on the Wildly Important
Discipline 2:
Act on the Lead Measures
Discipline 3:
Keep a Compelling Scoreboard
Discipline 4:
Create a Cadence of Accountability
Table of Contents
Messages from Leaders
3
Discipline 1: Focus on the Wildly Important
5
DSD Special Education Wildly Important Goals (WIGs)
5
Discipline 2: Act on the Lead Measures
9
Discipline 3: Keep a Compelling Scoreboard
14
Discipline 4: Create a Cadence of Accountability
17
Appendix
20
Effect Size
Lead Action Resources
2
Message from Bryan Bowles
Superintendent Davis School District
Why Plan?





Need for planning
Stick to the plan
Same vision so the plan works
We all do our part
End product are students who are well prepared to accomplish the tasks of tomorrow
Message from Glenna Gallo
Utah Special Education Director
During your planning please consider…




Utah’s focus – Improving outcomes for students
IDEA’s focus – College and Career Ready
Utah State Systemic Improvement Plan (SSIP) focus – Improve outcomes in math, grades 6-8
o Root cause: Lack of high expectations and beliefs
o Root cause: Lack of understanding math content and application of the content
o Root cause: A lack of a tiered system of support in secondary settings
DSD and WIGS! How do the three root-causes impact DSD goals?
Message from Kathy Chisholm
Davis School District Special Education Director
Planning process for teams





4DX is a process that enables individuals to accomplish and execute their goals
We will see improved results for S in math proficiency and improving graduation rates
Data drill down reveals we are not improving proficiency rates
Focus as a team to accomplish our goals
Learning First!
3
INTRODUCTION
 The Whirlwind
 A Baseball Story
 To achieve a goal you have never achieved
before, you must start doing things you
have never done before.
 The challenge is executing your most
important goals in the midst of the urgent.
 You are probably already doing it; 4DX
gives you permission to focus on it.
 The 4 Disciplines
 Success story! DSD LEARNING CENTERS
4
Focus on the Wildly Important
~focus~
“The first discipline is to focus our finest effort on the one or two goals that will make all the
difference, instead of giving mediocre effort to dozens of goals. Execution starts with focus.
Without it, the other three disciplines won’t be able to help you.”
ENERGY!
FOCUS!
Apply more energy against the one or two
wildly important goal(s).
WIG Rules
A high-focus, high-performing team must
have something wildly important to focus
on.
If every other area of our practice remained
at the current level of performance, what is
the one area where change would have the
greatest impact?
#1 No team focuses on more than two WIGs
at the same time.
#2 The battles you choose must win the
war.
#3 Senior leaders can veto, but not dictate.
#4 All WIGs mush have a finish line in the
form of “from X to Y by when”.
Eighty percent of the team’s energy will still
be directed at sustaining the whirlwind.
A WIG is fundamental to the heart of
educating students with disabilities; so
much so that the WIG defines our
existence.
5
NOTES…
6
WIG Builder Tool Sample
1.
2.
3.
4.
5.
Brainstorm ideas for the WIG
Brainstorm lag measures for each idea (from X to Y by when)
Rate in order of importance to the organization or to the overall WIG
Test your ideas against the checklist on the facing page
Write your final WIGS(s)
Ideas for the WIG
Current
Result
(from X)
Desired
Result (to
Y)
Deadline
(When)
Rank
Final WIGS
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
7
WIG Checklist – Did you get it right?
Check off each item to ensure your Team Wigs and lag measures meet the standard.
__ Have you gathered rich input both top down and bottom up?
__ Will the Team WIG have a clear, predictable impact on the overall organization WIG or
strategy, not just on team performance?
__ Is the Team WIG the most impactful thing the team can do to drive achievement of the
overall WIG?
__ Does the team clearly have the power to achieve the WIG without heavy dependence on
other teams?
__ Does the WIG require the focus of the entire team, not just of the leader of the subgroup?
__ Is the lag measure written in the format “from X to Y by When”?
__ Can the WIG be simplified any further? Does it start with a simple verb and end with a clear
lag measure?
8
Act on Lead Measures
~clarity~
“The second discipline is to apply disproportionate energy to the activities that drive your lead
measures. This provides the leverage for achieving the lag measures.”
A lag measures tell you if you have achieved
the goal but a lead measure tells you if you
are likely to achieve the goal. We can’t
influence lag measures but we can
influence lead measures. After determining
the WIG, don’t keep your eye on the lag
measure. Focus on the lead measure!
LAG MEASURE
Measures the goal
The formula from X to Y by when in a WIG
provides the lag measure. Leaders fixate
here.
A lead measure foretells the result because
it is PREDICTIVE and it is INFLUENCEABLE. A
team can directly influence the lead
measure
LEAD MEASURE
Predictive: Measures something that leads
to the goal.
Influenceable: Something we can influence
The lead measure foretells the result. Teams
fixate here.
THE LEVER AND THE BOULDER
The data on lead measures make the difference and helps teams to close the gap. Trying to
manage lag measures without understanding the lead measures often yields poor results.
Teams know what the lead measures are, but often don’t FOCUS on the lead measure because
of the crazy whirlwind. Lead measures act like a lever moving a boulder.
9
CHOOSING THE LEAD MEASURES
Who has achieved the goal like yours? What did they do differently? Select activities that will
have the greatest impact on achieve the WIG. We can find lead measures by looking at the
effect size of influencing factors on students. A large effect size strategy will influence and
predict student outcomes (See Appendix for more information on Effect Size).
TRACKING LEAD MEASURE DATA
A team who is serious about their WIG will create a way to
track their lead measures. No data = no leverage = loss of
control of performance on the lead measures.
LEAD MEASURES AND ENGAGEMENT
When teams identify a lead measure, individual team
members engage more thoroughly. A school administrator
may be concerned about flat student growth indicators. An
ineffective administrator might tell the faculty to “just do
better”. An effective administrator would identify lead
measures with high effect sizes (see Appendix) (such as
formative assessment, Piagetian activities, or student-report
grades) upon which the faculty could focus. The faculty
disposition would move from frustrated to engaged.
TWO TYPES LEAD MEASURES
The secret to execution excellence is investing best efforts on
a few activities that have the most impact on the WIGs. Two
types of valid lead measures are:
1) Small outcomes are lead measures focused on achieving a
weekly result, but give individual team members the latitude
to choose his or her own method for achieving it.
PILOT ERRORS
In the 1930s pilot error was
responsible for many fatal
airplane crashes. This was a
concern to their customers.
Pilots got together and
adopted a set of lead
measures now known as a
“preflight checklist”. The
result was fewer crashes
due to pilot error. Today,
the greatest predictor of
arriving safely is the
preflight checklist. The
preflight checklist is a lead
measure of the wildly
important goal of zero
crashes due to pilot error.
The checklist only takes a
few moments but it has
ENORMOUS impact. 100%
compliance with the
checklist is predictive of a
safe landing and
influenceable by the pilots.
2) Leveraged behaviors are lead measures that track the specific behaviors you want the team
to perform throughout the week. They enable the entire team to adopt new behaviors at the
same level of consistency and quality, and provide a clear measurement of how well they are
performed.
Which type of lead measure is best for your team?
10
STEPS TO DEVELOPING HIGH-LEVERAGE LEAD MEASURES
Step 1: Consider the Possibilities
Step 2: Rank by Impact
Step 3: Test Top Ideas… use the following ideas to evaluate your lead measure:






Is it predictive?
Is it influenceable?
Is it an ongoing process or a “once and done”?
Is it a leader's action or a team action?
Can it be measured?
Is it worth measuring?
Step 4: Define the Lead Measures by asking these questions:






Are we tracking team or individual performance?
Are we tracking the lead measure daily or weekly?
What is the quantitative standard (How much, how often, how consistently are we
supposed to perform)?
What is the qualitative standard (How well are we supposed to perform)?
Does it start with a verb or action word?
Is it simple (few words as possible)?
Notes:
A process-oriented lead measure is another way. Somewhere in every process there are leverage
points or critical steps. The critical steps in the process become the lead measures. If the data
show critical steps where performance falters, these steps become lead measures to which the
team can apply concentrated energy.
A project milestone is another way to develop a lead measure. If the WIG is a project, the
project milestone can be effective lead measures but must be evaluated carefully. A milestone
that requires less than six weeks to complete is generally not significant enough to serve as a
good lead measure.
11
LEAD MEASURES MOVE THE LAG MEASURE
Discipline 2 results in a set of lead measures that will move the lag measure on the WIG. Teams
become excited when clear, concise, and measurable lead measures have been identified.
Consider the following example:
12
TRY IT. Use the Lead Measure Builder tool to experiment with creating lead measures for your
WIG:
_____________________________________________________________________________
Lead Measure Builder Tool
1.
Insert the Wildly Important Goal and lag measure
4.
Rank in order of impact on the WIG.
in the top box.
5.
Test your ideas against the checklist.
2.
Brainstorm ideas for lead measures.
6.
Write your final lead measures.
3.
Brainstorm methods for measuring those ideas.
WIG (Move from x to y by ____ as measured by _____.):
Ideas for lead measures
How to measure?
Rank
Final Lead Measures:
Did you get it right? Check off each item to ensure your team Lead Measures will move the lag measure of the WIG:
__Have you gathered rich input on the lead measure format
__Are the lead measures truly measurable? Can you track
he team and others?
performance on the lead measures form day one?
__Are the lead measures predictive—this is, the most
__Are the lead measures worth pursuing? Or will the data
impactful things the team can do to drive achievement of the
cost more to gather than it is worth? Will these measures
Team WIG?
lead to unintended consequences?
__Are the lead measures influenceable—that is, does the
__Does each lead measure start with a simple verb?
team clearly have the power to move the lead measure?
__Is every measure quantified—including quality measures?
______________________________________________________________________________
After Lead Measures have been identified, teams must go on to Discipline 3 to promote
engagement and success.
13
Keep a Compelling Score Board
~engagement~
“The third discipline is to make sure everyone knows the score at all times, so that they can tell
whether or not they are winning.”
Accountability is a frequently recurring
cycle of accounting for past performance
and moving the score forward. This is
where execution actually happens. The
game has been set up – now get into the
game.
Keeping score helps to achieve a WIG in the
middle of a raging whirlwind. When
changing the behavior of a large group of
people, keeping score does the trick. People
play differently when they are keeping
score.

A coach’s scoreboard is not a
players’ scoreboard.

The purpose of a players’
scoreboard is to motivate the
players to win.
Step 1: Choose a Theme.
Step 2: Design the Scoreboard. Keep it
simple, visible, include the lead and lag
measures, and a glance should tell if you
are winning.
Step 3: Build the Scoreboard.
Step 4: Keep It Updated. Who is
responsible, when will it be posted, how
often will it be updated?
Some examples…
CRICKET
GOLF
FOOTBALL
BAR GRAPH
REPORT CARD
ELECTION
TREND LINE
GALLUP POLL
CREDIT SCORE
OLYMPICS
14
SCOREBOARDS THAT WORKED FOR US
15
Scoreboard Builder Tool
Use the template to create a compelling score board. Test your ideas against the checklist on
the facing page.
Team WIG
Lag Measure
Lead Measure 1
Graph
Lead Measure 2
Graph
Scoreboard Checklist – Did you get it right?
Check off each item to ensure that the team scoreboard is compelling and will drive high
performance:
__ Has the team been closely involved in creating the scoreboard?
__ Does the scoreboard track the Team WIG, lag measures, and lead measures?
__ Is there a full explanation of the WIG and measures along with the graphs?
__ Does every graph display both actual results and the target results (Where are we now?
Where should we be?)?
__ Can we tell at a glance on every measure if we’re winning or losing?
__ Is the scoreboard posted in a highly visible location where the team can see it easily and
often?
__ Is the scoreboard easy to update?
__ Is the scoreboard personalized – a unique expression of the team?
16
Keep a Cadence of Accountability
~personal commitment~
“The fourth discipline is to create a cadence of accountability, a frequently recurring cycle of
accounting for past performance and planning to move the score forward.”
Weekly WIG meeting.
Hold the WIG meeting at least weekly and
lasting no longer than 20-30 minutes. Set
an agenda and establish a weekly rhythm of
accountability for driving progress toward
the WIG. THIS DISCIPLINE LITERALLY MAKES
THE DIFFERENCE BETWEEN SUCCESSFUL
AND FAILED EXECUTION.
Non-negotiable rules:
1. Hold the WIG session on the same
day at the same time every
week…maybe more.
2. Never, never, never allow the
whirlwind blast into the WIG
session. No matter what!
17
WIG Session Agenda Tool
Distribute the agenda electronically or on paper at the beginning of the WIG Session. After you
hold the session, check it against the criteria on the next page.
WIG SESSION AGENDA
Where
When
WIG(s)
Commitment
Status
Individual Reports
Team Member
Scoreboard
Update
18
Did you get it right?
Check off each item to ensure that the WIG session will drive high performance:
__ Are you holding WIG sessions as scheduled?
__ Are you keeping the sessions brief, brisk, and energetic (twenty to thirty minutes) ?
__ Is the leader the model for reporting and making commitments?
__ Do you review an updated scoreboard?
__ Do you analyze why you’re winning or losing on each measure?
__ Do you celebrate successes?
__ Do you hold each other unconditionally accountable for your commitments?
__ Does each team member make specific commitments for the coming week?
__ Do you clear the path for each other, finding ways to help team members who encounter
obstacles to keeping their commitments?
__Do you keep the whirlwind out of the WIG session?
19
Appendix
Effect Size
Definition: Effect size is a way of quantifying the effectiveness of a particular intervention in
terms of moving the average. Generally, effect sizes are described as small, medium, and large.
Calculating Effect Sizes: There are many different ways in which to use effect sizes. The DSD
Special Education Department focuses on student progress – not on comparisons between
classes, teaching methods, or other variables.
For example, consider a class or group of students that has been administered a test relating to
the curriculum in both February and June. The data from both assessments can be used to
calculate an effect size. This effect size helps define the impact of teaching over this period.
The easiest way in which to calculate an effect size is to use Excel, using the following formula:
Effect size =
Average (post-test – Average (pre-test)
________________________________
Spread (standard deviation, or sd)
20
Consider this example using Excel:
A
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
Student
John
Paul
Wayne
Brandon
Nathan
Cayden
Britney
Kelsie
Zach
Emma
Average
Spread (standard
deviation or sd
Average of spread
Effect size
B
February test
40
25
45
30
35
60
65
70
50
55
C
June test
35
30
50
40
45
70
75
80
75
85
48 = AVERAGE(B2:B11)
15 = STDEV(B2:B11)
59 = AVERAGE(C2:C11)
21 = STDEV(C2:C11)
18 = AVERAGE(B14:C14)
0.6 = (C13-B13)/C15
The effect size was calculated as:
58-48
Effect size = ________ = 0.60  is this a small, medium or large effect size?
18
(Hattie, 2011)
21
Lead Action Resources
1. Visible Learning (2008) and Visible Learning for Teachers (2012) – John Hattie
10 Most Influential Instructional Strategies
Based on Meta-Analysis
Effect Size
Instructional Strategy
Self-report grades
Response to Intervention
Providing formative evaluation
Classroom discussion
Teacher clarity
1.44
1.28
1.07
0.9
0.9
0.88
0.82
0.77
0.75
0.75
2. Explicit Instruction – Archer
a. Opportunities to Respond
b. Praise Rate
c. I Do, We Do, You Do
d. Vocabulary instruction
3. Mathematical Teaching Practices (Nation Council of Teachers of Mathematics)
a. Establish mathematics goals to focus learning
b. Implement tasks that promote reasoning and problem solving
c. Use and connect mathematical representations
d. Facilitate meaningful mathematical discourse
e. Pose purposeful questions
f. Build procedural fluency from conceptual understanding
g. Support productive struggle in learning mathematics
h. Elicit and use evidence of student thinking
4. Other Instructional Practices
a. White Boards
b. Objective/relevance on board
c. Application to real life
d. Conceptual focus (not just procedural)
5. System Changes
a. Co-teaching math
b. Double math time (regular class and resource math lab period)
c. Not pulling students out of regular math to do resource math
d. Bringing math into other classes
6. See the Special Education 4DX webpage for more resources.
22
Download