To the Presentation Click Here.

advertisement
Outcome Based
Accountability
The Fiscal Policy Studies Institute
Santa Fe, New Mexico
Websites
raguide.org
resultsaccountability.com
Book - DVD Orders
amazon.com
resultsleadership.org
SIMPLE
COMMON SENSE
PLAIN LANGUAGE
MINIMUM PAPER
USEFUL
Outcome Based Accountability
is made up of two parts:
Population Accountability
about the well-being of
WHOLE POPULATIONS
For Communities – Cities – Counties – States - Nations
Performance Accountability
about the well-being of
CUSTOMER POPULATIONS
For Programs – Agencies – and Service Systems
Results and Performance Accountability
COMMON LANGUAGE
COMMON SENSE
COMMON GROUND
THE LANGUAGE TRAP
Too many terms. Too few definitions. Too little discipline
Benchmark
Outcome
Result
Modifiers
Indicator
Measurable Core
Urgent
Qualitative
Priority
Programmatic
Targeted
Performance
Incremental Strategic
Systemic
Measure
Goal
Objective
Target
CoreYour
qualitative
made
upsystemic
jargonobjectives
here
Measurable
urgentstrategic
indicators
Lewis Carroll Center for Language Disorders
DEFINITIONS
OUTCOME
Population
A condition of well-being for
children, adults, families or communities.
Being Healthy - Staying Safe - Enjoying and achieving
Making a Positive Contribution - Economic Well-being
Safe Communities - Clean Environment
INDICATOR
A measure which helps quantify the achievement
of an outcome.
Rate of low-birthweight babies - Rate of confirmed child abuse
Percent 16 & 19 yr. olds with 5 A-C GCSE’s - Rate of volunteering
Rate of child poverty Crime rate - Air quality index
Performance
PERFORMANCE MEASURE
A measure of how well a program, agency or service
system is working.
1. How much did we do?
Three types: 2. How well did we do it?
3. Is anyone better off? = Customer Outcome
From Ends to Means
From Talk
Talk to
From
toAction
Action
Population
OUTCOME
ENDS
Performance
INDICATOR
PERFORMANCE
MEASURE
Customer outcome = Ends
Service delivery = Means
MEANS
IS IT A OUTCOME, INDICATOR OR
PERFORMANCE MEASURE?
OUTCOME 1.
Safe Community
INDICATOR 2.
Crime Rate
PERF. MEASURE 3.
Average Police Dept response time
OUTCOME 4.
An educated workforce
INDICATOR 5.
Adult literacy rate
OUTCOME 6.
People have living wage jobs and income
INDICATOR 7.
% of people with living wage jobs and income
PERF. MEASURE 8. %
of participants in job training who get living
wage jobs
Results – Indicators – Performance Measures in
Amharic, Cambodian, Laotian, Somali, Spanish, Tigrigna, Vietnamese
Translation Guide/Rosetta Stone
Not the Language Police
Ideas
Group 1
Group 2
1. A condition
of well-being
for children,
adults, families
& communities
OUTCOME
RESULT
2.
3.
etc.
TRANSLATION
Back to the Idea
Group 3
etc.
GOAL
POPULATION
ACCOUNTABILITY
For Whole Populations
in a Geographic Area
Fiscal Policy Studies Institute
Santa Fe, New Mexico
www.resultsaccountability.com
www.raguide.org
Community Outcomes
for Christchurch, NZ
1. A Safe City
2. A City of Inclusive and Diverse Communities
3. A City of People who Value and Protect the Natural
Environment
4. A Well-Governed City
5. A Prosperous City
6. A Healthy City
7. A City for Recreation, Fun and Creativity
8. City of Lifelong Learning
9. An Attractive and Well-Designed City
Outcomes for
Children, Families and Communities
A Working List
● Healthy Births
● Healthy Children and Adults
● Children Ready for School
● Children Succeeding in School
● Young People Staying Out of Trouble
● Stable Families
● Families with Adequate Income
● Safe and Supportive Communities
Georgia Policy Council
for Children and Families
RESULTS
● Healthy Children
● Children Ready for School
● Children Succeeding in School
● Strong Families
● Self Sufficient Families
Every Child Matters – Children Act
Outcomes for Children and Young People
Being Healthy: enjoying good physical and mental health and living a
healthy lifestyle.
Staying Safe: being protected from harm and neglect and growing up able
to look after themselves.
Enjoying and Achieving: getting the most out of life and developing
broad skills for adulthood.
Making a Positive Contribution: to the community and to society
and not engaging in anti-social or offending behaviour.
Economic Well-being: overcoming socio-economic disadvantages to
achieve their full potential in life.
Our Health, Our Care, Our Say – White Paper
Outcomes for Adults
1. Health & Emotional Well-being
2. Quality of life
3. Making a positive contribution
4. Exercising choice & control
5. Freedom from discrimination & harassment
6. Economic well being
7. Personal dignity & respect
Note that 8. Effective leadership and (9. Effective commissioning are means and not ends
Source: A New Outcomes Framework for Performance Assessment of Adult Social Care 2006 - 07
REPORT CARDS
Georgia
Dayton, OH
Santa Cruz, CA
Lehigh Valley, PA
Country
New Zealand
Neighborhood
City
Portsmouth, UK
Kruidenbuurt
Tilburg, Netherlands
Leaking Roof
(Outcomes thinking in everyday life)
Experience
Inches of Water
BASELINE
Measure
Not OK
? Fixed
Turning the Curve
Story behind the baseline (causes)
Partners
What Works
Action Plan #2
Outcomes
Criteria for
Choosing Indicators
as Primary vs. Secondary Measures
Communication Power
Does the indicator communicate to a broad range of audiences?
Proxy Power
Does the indicator say something of central importance about the outcome?
Does the indicator bring along the data HERD?
Data Power
Quality data available on a timely basis.
Choosing Indicators
Worksheet
Safe Community
Outcome _______________________________
Candidate Indicators
Communication
Power
Proxy
Power
Data
Power
Measure 1
H M L
H M L
H M L
H
H
H
H
H
L
Measure 2
Measure 3
Measure 4
Measure 5
Measure 6
Measure 7
Measure 8
Data
Development
Agenda
Three Part Indicator List for each Outcome
Part 1: Primary Indicators
● 2 or 3 or 4 “Headline” Indicators
● What this outcome “means” to the community
● Meets the Public Square Test
Part 2: Secondary Indicators
● Everything else that’s any good (Nothing is wasted.)
● Used later in the Story behind the Curve
Part 3: Data Development Agenda
● New data
● Data in need of repair (quality,timeliness etc.)
The Matter of Baselines
H
M OK?
L
Point to Point
History
Turning the Curve
Forecast
Baselines have two parts: history and forecast
The Cost of Bad Outcomes
The costs of remediating problems after they occur
Convergence
of Cost & Revenue
Revenue
$300 billion
Cost
Investment
Track
Invest in prevention to reduce or avoid out-year costs.
COST OF BAD OUTCOMES
United States 1970 to 2010
2005
Newcastle, UK
20.00%
18.00%
16.00%
14.00%
12.00%
10.00%
8.00%
6.00%
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007
Ncle 14.5 14.5 16.8 14.5
Revised 9 Nov 2007
17
15
11.9 10.6
9.5
9.3
Source: Connexions Tyne and Wear, UK
Paulsgrove, Portsmouth, UK
Youth Nuisance
Figure 5: Pre and Post Turning the Curve Exercise
Breakdown of offences committed for the data periods 01/01/04 31/03/04 and 01/01/05 - 31/03/05
250
225
200
175
150
125
100
75
50
25
0
01/01/04 - 31/03/04
Criminal Damage
Public Order
01/01/05 - 31/03/05
Theft
Overall Decrease
MADD
Rebound
Alternative to Traditional Evaluation Methods:
DEMONSTRATING a CONTRIBUTION
to complex change efforts… requires 3 elements:
Given a Curve to Turn
2 …and it had a timely
relationship to….
3 …. a turn in the
curve.
1 We tried a bunch of
stuff that had a credible
chance of making a
difference …
c FPSI
“If I include you,
you will be my partner.
If I exclude you,
you will be my judge.”
- Rosell
Performance
Accountability
For Services, Agencies and
Service Systems
Fiscal Policy Studies Institute
Santa Fe, New Mexico
www.resultsaccountability.com
www.raguide.org
“All Performance Measures
that have ever existed
for any service
in the history of the universe
involve answering two sets of
interlocking questions.”
Program Performance Measures
Quantity
Quality
How
Much
How
Well
did we do?
did we do it?
(#)
(%)
Performance Measures
Effort
How hard did we try?
Effect
Is anyone better off?
Program Performance Measures
Effort
How
Much
How
Well
Effect
Quantity
Quality
Input
Effort
How much
service did
we deliver?
How well
did we
deliver it?
Output
Effect
Program Performance Measures
How much
change / effect
did we produce?
What quality of
change / effect
did we produce?
Effect
Effort
Program Performance Measures
Quantity
Quality
How much
did we do?
How well
did we do it?
Is anyone
better off?
#
%
Effort
Education
Quantity
Quality
How much did we do?
How well did we do it?
Number of
students
Student-teacher
ratio
Effect
Is anyone better off?
Number of 16 olds
with 5 A to C
GCSE’s
Percent of 16 yr olds
with 5 A to C
GCSE’s
Number of fixed
term exclusions
Rate of fixed
term exclusions
Effort
Education
Quantity
Quality
How much did we do?
How well did we do it?
Number of
students
Student-teacher
ratio
Effect
Is anyone better off?
Number of 16 olds
with 5 A to C
GCSE’s
Percent of 16 yr olds
with 5 A to C
GCSE’s
Number with good
school attendance
Percent with good
school attendance
Effort
Pediatric Practice
Quantity
Quality
How much did we do?
How well did we do it?
Number of
patients
treated
Percent of
patients treated
in less than
1 hour
Effect
Is anyone better off?
#
children
fully
immunized
%
children
fully
immunized
(in the practice)
(in the practice)
Effort
Drug/Alcohol Treatment Program
Quantity
Quality
How much did we do?
How well did we do it?
Number of
persons
treated
Percent of
staff with
training/
certification
Effect
Is anyone better off?
Number of clients Percent of clients
off of alcohol &
off of alcohol &
drugs
drugs
- at exit
- 12 months after exit
- at exit
- 12 months after exit
Home Care Services
How much did we do?
How well did we do it?
# visits per week
# of persons
served
Ave length of visit
% service users who say
the service is reliable,
flexible, respectful,
friendly (SPRU))
# visits
Is anyone better off?
# entry into hospital,
residential or nursing care
Rate entry into hospital,
residential or nursing care
# carers report the service
helped the service user
remain at home
% carers report the service
helped the service user
remain at home
Effort
Fire Department
Quantity
Quality
How much did we do?
How well did we do it?
Number of
responses
Response
Time
Effect
Is anyone better off?
# of fires
kept to
room of origin
% of fires
kept to
room of origin
Effort
General Motors
Quantity
Quality
How much did we do?
How well did we do it?
# of production hrs
Employees per
vehicle
produced
# tons of steel
Effect
Is anyone better off?
# of cars sold
% Market share
$ Amount of Profit
Profit per share
$ Car value after
2 years
% Car value after
2 years
Source: USA Today 9/28/98
Effort
Not All Performance Measures Are Created Equal
Quantity
Quality
Quality
How much did we do?
How well did we do it?
Least
Also
Very Important
Important
Effect
Is anyone better off?
Most
Important
RBA Categories Account for All Performance Measures
(in the history of the universe)
TQM
Cost
Process
Input
Quality
Effort
Quantity
Efficiency Admin overhead, Unit cost
Efficiency,
Staffing ratios, Staff turnover
Staff morale, Access, Waiting time,
Waiting lists, Worker safety
Customer Satisfaction
Product
Output
Impact
Effect
(quality service delivery
& customer benefit)
Benefit value
Cost / Benefit ratio
Return on investment
Client results or client outcomes
Effectiveness
Value added
Productivity
RBA Categories Account for All Performance Measures
(in the history of the universe)
TQM
Cost
Process
Input
Quality
Effort
Quantity
Efficiency, Admin overhead, Unit cost
Staffing ratios, Staff turnover
Staff morale, Access, Waiting time,
Waiting lists, Worker safety
Customer Satisfaction
Product
Output
Impact
Effect
(quality service delivery
& customer benefit)
Benefit value
Cost / Benefit ratio
Return on investment
Client results or client outcomes
Effectiveness
Value added
Productivity
RBA Categories Account for All Performance Measures
(in the history of the universe)
TQM
Cost
Product
Output
Impact
Benefit value
*
Customer
Satisfaction
1. Did we treat
you well?
(quality service delivery
& customer benefit)
Effect
Process
Input
Quality
Effort
Quantity
Efficiency, Admin overhead, Unit cost
Staffing ratios, Staff turnover
Staff morale, Access, Waiting time,
Waiting lists, Worker safety
Effectiveness
Value added
Productivity
2. Did we help
you with your
problems?
Cost / Benefit ratio
Return on investment
Client results or client outcomes
* World’s simplest complete
customer satisfaction survey
RBA Categories Account for All Performance Measures
(in the history of the universe)
TQM
Cost
Process
Input
Quality
Effort
Quantity
Efficiency, Admin overhead, Unit cost
Staffing ratios, Staff turnover
Staff morale, Access, Waiting time,
Waiting lists, Worker safety
Customer Satisfaction
Product
Output
Impact
Effect
(quality service delivery
& customer benefit)
Benefit value
Cost / Benefit ratio
Return on investment
Client results or client outcomes
Effectiveness
Value added
Productivity
Effort
The Matter of Control
Quantity
Quality
How much did we do?
How well did we do it?
Most
Control
Effect
Is anyone better off?
Least
Control
PARTNERSHIPS
The Matter of Use
1. First Purpose is to Improve Performance
as a contribution to improving results
2. Avoid the Performance Measurement
Equals Punishment Trap
● Acknowledge the experience as real.
● Work to create a healthy organizational environment
● Start small.
● Build bottom-up and top-down simultaneously.
Comparing Performance
1. To Ourselves First
Can we do better than our
own history?
2. To Others
When it is a fair apples/apples
comparison.
3. To Standards
When we know
what good performance is.
Comparing Performance
1. To Ourselves First
Can we do better than our
own history?
2. To Others
When it is a fair apples/apples
comparison.
3. To Standards
When we know
what good performance is.
Using a Baseline
CHART ON THE
WALL
Comparing Performance
1. To Ourselves First
Can we do better than our
own history?
Reward?
2. To Others
When it is a fair apples/apples
comparison.
3. To Standards
When we know
what good performance is.
Punish?
Comparing Performance
1. To Ourselves First
Can we do better than our
own history?
2. To Others
When it is a fair apples/apples
comparison.
3. To Standards
When we know
what good performance is.
The Matter of Standards
1. Quality of Effort Standards are
sometimes WELL ESTABLISHED
● Child care staffing ratios
● Application processing time
● Handicap accessibility
● Child abuse response time
Effort
Quantity
Effect
BUT
2. Quality of Effect Standards are
almost always EXPERIMENTAL
AND
3. Both require a
LEVEL PLAYING FIELD
and an ESTABLISHED RECORD
of what good performance is.
● Hospital recovery rates
● Employment placement
and retention rates
● Recidivism rates
Advanced Baseline Display
Create targets
only when they are:
FAIR & USEFUL
Goal (line)
Target or Standard
●
Avoid publicly declaring
targets by year if possible.
Your Baseline
Comparison Baseline
Instead:
Count anything better
than baseline as progress.
Effect
Effort
Program Performance Measures
Quantity
Quality
How much
did we do?
How well
did we do it?
Is anyone
better off?
#
%
All Data have two Incarnations
Lay
Technical
Definition
Definition
Graduation Rate
% enrolled June 1 who graduate June 15
% enrolled Sept 30 who graduate June 15
% enrolled 9th grade who graduate in 12th grade
Separating the Wheat from the Chaff
Types of Measures Found in Each Quadrant
How much did we do?
How well did we do it?
# Clients/customers
served
% Common measures
# Activities (by type
of activity)
% Activity-specific
measures
e.g. client staff ratio, workload ratio, staff
turnover rate, staff morale, % staff fully
trained, % clients seen in their own language,
worker safety, unit cost
e.g. % timely, % clients completing activity,
% correct and complete, % meeting standard
Is anyone better off?
% Skills / Knowledge
#
#
#
#
(e.g. parenting skills)
Point in Time
vs. Point to Point
Improvement
% Attitude / Opinion
(e.g. toward drugs)
% Behavior
(e.g.school attendance)
% Circumstance
(e.g. working, in stable housing)
Effort
Choosing Headline Measures and the Data Development Agenda
Quantity
Quality
How much did we do?
How well did we do it?
# Measure 1 ----------------------------
% Measure 8 ----------------------------
# Measure 2 ----------------------------
% Measure 9 -----------------------------
# Measure 3 ----------------------------
% Measure 10 ---------------------------
# Measure 4 ----------------------------
% Measure 11 ---------------------------
# Measure 5 ----------------------------
% Measure 12 ---------------------------
# Measure 6 ----------------------------
% Measure 13 ---------------------------
# Measure 7 ----------------------------
% Measure 14 ---------------------------
#3 DDA
#2 Headline
Effect
Is anyone better off?
# Measure 15 ----------------------------
% Measure 15 ----------------------------
# Measure 16 ----------------------------
% Measure 16 ----------------------------
# Measure 17 ----------------------------
% Measure 17 ----------------------------
# Measure 18 ----------------------------
% Measure 18 ----------------------------
# Measure 19 ----------------------------
% Measure 19 ----------------------------
# Measure 20 ----------------------------
% Measure 20 ----------------------------
# Measure 21 ----------------------------
% Measure 21 ----------------------------
#2 DDA
#3 Headline
#1 Headline
#1 DDA
Select 3 to 5 Performance Measures
at each level of the organization
3-5
3-5
3-5
3-5
?
. .
3-5
3-5
3-5
Be disciplined about what’s most
important.
“Get
over Don’t
it!” get distracted.
Pick the 3 – 5 most important
of the 9 – 15 measures
or create composites.
Customer Outcomes
LR
UR
How
Population
&
Performance
Accountability
FIT TOGETHER
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATION ACCOUNTABILITY
Being Healthy
Rate of low birth-weight babies
POPULATION
OUTCOMES
Staying Safe
Rate of child abuse and neglect
Enjoying and Achieving
Percent with 5 A-C GCSE’s
PERFORMANCE ACCOUNTABILITY
Child Protection Service
# of
investigations
completed
% initiated
within 24 hrs
of report
# repeat
Abuse/Neglect
% repeat
Abuse/Neglect
CUSTOMER
OUTCOMES
Contribution
relationship
Alignment
of measures
Appropriate
responsibility
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATION ACCOUNTABILITY
Healthy Births
Rate of low birth-weight babies
POPULATION
OUTCOMES
Children Ready for School
Percent fully ready per K-entry assessment
Self-sufficient Families
Percent of parents earning a living wage
PERFORMANCE ACCOUNTABILITY
Job Training Program
# persons
receiving
training
Unit cost
per person
trained
# who get
living wage jobs
% who get
living wage jobs
CUSTOMER
OUTCOMES
Contribution
relationship
Alignment
of measures
Appropriate
responsibility
Population Accountability
to which you contribute to most directly.
Outcome:
Indicators:
Every time
you make a
presentation,
use a
two-part
approach
Story:
Partners:
What would it take?:
Role: as part of a larger strategy.
Your Role
Performance Accountability
Service:
Performance measures:
Story:
Partners:
Action plan to get better:
Population Accountability
to which you contribute to most directly.
Result:
Indicators:
Every time
you make a
presentation,
use a
two-part
format
Story:
Partners:
What would it take?:
Role: within the larger strategy.
Your Role
Performance Accountability
Service:
Performance measures:
Story:
Partners:
Action plan to get better:
Different Kinds of Progress
1. Data
a. Population indicators Actual turned curves:
movement for the better away from the baseline.
b. Service performance measures:
customer progress and better service:
How much did we do?
How well did we do it?
Is anyone better off?
2. Accomplishments: Positive activities, not included above.
3. Anecdotes: Stories behind the statistics that show how
individuals are better off.
Framework Crosswalk Analysis
Population Results
(For Population Well-being, Across Communities,
Across Systems)
1. Population
2. Results (Outcomes, Goals)
3. Indicators (Benchmarks)
Data Development Agenda
Report Card
4. Baseline
5. Story behind the baseline
Cost of Bad Results
Research Agenda Part 1
6. Partners
7. What works
Research Agenda Part 2
8. Action Plan (strategy)
9. Funding Plan (budget)
Example
Framework:
Logic
Model
__________
Goal
Program Performance
(For Programs, Agencies and Service Systems)
1. Customers (Clients)
2. Performance measures
Customer results
Quality of Effort
Quantity of Effort
Data Development Agenda
3. Baseline
4. Story behind the baseline
Research Agenda Part 1
5. Partners
6. What works
Agency/program actions
Partner's actions
Research Agenda Part 2
7. Action Plan (strategy)
8. Funding Plan
Outcome
Output
Activity
Input
Board of Directors Meeting
AGENDA
1. New data
2. New story behind the curves
3. New partners
4. New information on what works.
5. New information on financing
6. Changes to action plan and budget
7. Adjourn
What’s Next?
A Basic Action Plan for Outcome Based Accountability
TRACK 1: POPULATION ACCOUNTABILITY
●
●
●
●
Establish outcomes
Establish indicators, baselines and charts on the wall
Create an indicators report card
Set tables (action groups) to turn curves
TRACK 2: PERFORMANCE ACCOUNTABILITY
● Performance measures, and charts on the wall
for programs, agencies and service systems
● Use 7 Questions program by program in management,
budgeting and strategic planning
IN CLOSING
“If you do what you
always did,
you will get what
you always got.”
Kenneth W. Jenkins
President, Yonkers NY NAACP
THANK YOU !
Websites
raguide.org
resultsaccountability.com
------Book - DVD Orders-----amazon.com
resultsleadership.org
EXERCISES
Fiscal Policy Studies Institute
Santa Fe, New Mexico
www.resultsaccountability.com
www.raguide.org
All Children and Young People in the NW Succeed in Literacy and Numeracy
and Can Lead Productive Lives
70
GCSE 5+ A*-C
65
2008 National Target
60
55
How do we
maintain
momentum?
50
45
This is our baseline
40
North West
England
35
North West incl Eng & Maths
England incl Eng & Maths
30
2001
2002
2003
2004
2005
2006
2007
2008
PSA 10
All Children and Young People in the NW Have Healthy Lifestyles
and Productive Lives
Under 18 conception rates per 1000, 15-17 year old females
55
Under 18 Conception Rates
This is our baseline
50
How do we turn
the curve?
45
40
35
North West
30
England
25
2010 National Target
20
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
PSA 3
All Children and Young People in the NW Can Lead Productive Lives
16
14
Percentage NEET
Manchester
Manchester
North West
12
England
10
North West
8
England
6
4
2
2004
2005
Actual Data
2006
2007
2008
2009
Projected reduction required to meet 2010 target
2010
PSA 12
All Children and Young People in the NW Can Lead Productive Lives
80
Percentage of 19 year olds with at least Level 2
qualification
75
2006 National Target
70
How do we maintain
momentum?
65
This is our baseline
North West
England
60
2004
2005
2006
2007
2008
PSA 11
All children and young people in the NW live in stable and safe environments and
Can Lead Productive Lives
10
Percentage care leavers with 5+ GCSEs A*-C
9
8
7
6
This is our baseline
North West
England
5
2002-03
2003-04
2004-05
2005-06
2006-07
2007-08
2008-09
2009-10
PSA
Turn the Curve Exercise: Population Well-being
5 min: Starting Points
- timekeeper and reporter
- geographic area
- two hats (yours plus partner’s)
10 min: Baseline
- pick an outcome, and an indicator curve to turn
- forecast – OK or not OK?
15 min: Story behind the baseline
- causes/forces at work
- information & research agenda part 1 - causes
15 min: What works? (What would it take?)
- what could work to do better?
- each partners contribution
- no-cost / low-cost ideas
- information & research agenda part 2 – what works
10 min: Report convert notes to one page
Two
pointers
to action
4. --------- Off the Wall
ONE PAGE Turn the Curve Report: Population
Outcome: _______________
Indicator
Baseline
Indicator
(Lay Definition)
Story behind the baseline
-----------------------------------------------------
(List as many as needed)
Partners
-----------------------------------------------------
(List as many as needed)
Three Best Ideas – What Works
1. --------------------------2. --------------------------3. ---------No-cost / low-cost
4. --------- Off the Wall
Sharp
Edges
The first step in performance accountability is to
DRAW A FENCE
Around something that has
ORGANIZATIONAL OR FUNCTIONAL IDENTITY
The Whole
Organization
Division A
Division B
Unit
Unit
1
Division C
Creating a Working Baseline
from Group Knowledge
Graduation Rate
75%
Now
Not OK?
Turn the Curve Exercise: Program Performance
5 min: Starting Points
- timekeeper and reporter
- identify a program to work on
- two hats (yours plus partner’s)
10 min: Performance measure baseline
- choose 1 measure to work on – from the lower right quadrant
- forecast – OK or not OK?
15 min: Story behind the baseline
- causes/forces at work
- information & research agenda part 1 - causes
15 min: What works? (What would it take?)
- what could work to do better?
- each partners contribution
- no-cost / low-cost ideas
- information & research agenda part 2 – what works
10 min: Report Convert notes to one page
Two
pointers
to action
4. --------- Off the Wall
ONE PAGE Turn the Curve Report: Performance
Service: _______________
Performance
Measure
Baseline
Performance Measure
(Lay definition)
Story behind the baseline
-----------------------------------------------------
(List as many as needed)
Partners
-----------------------------------------------------
(List as many as needed)
Three Best Ideas – What Works
1. --------------------------2. --------------------------3. ---------No-cost / low-cost
4. --------- Off the Wall
Sharp
Edges
THANK YOU !
WEBSITES:
www.raguide.org
www.resultsaccountability.com
BOOK ORDERS:
www.trafford.com
www.amazon.com
20 Minute
Exercise
2 customers
1 measure
1 measure
Discuss how
we’re doing
2 partners
2 what
works ideas
(1 nc/lc)
Discuss how
to implement
40
20 Minute
Exercise
1 population
POPULATION ACCOUNTABILITY
1. What population are we concerned about?
(e.g. U.S. population)
1 result
1 indicator
2. What condition(s) do we want for this
population? (Americans are free of cancer.)
3. How could we measure these conditions? (
(e.g. cancer rates)
Discuss how
we’re doing
2 partners
2 what
works ideas
(1 nc/lc)
Discuss how
to implement
4. How are we doing on the most important
of these measures? (baseline history)
5. Who are the partners with a role to play
in doing better?
6. What works – what would it take – to do
better? (What is our role?)
7. What do we propose to do?
Some data
for the
Turn the Curve
Exercises
All Children and Young People in the NW Succeed in Literacy and Numeracy
and Can Lead Productive Lives
70
GCSE 5+ A*-C
65
2008 National Target
60
55
How do we
maintain
momentum?
50
45
This is our baseline
40
North West
England
35
North West incl Eng & Maths
England incl Eng & Maths
30
2001
2002
2003
2004
2005
2006
2007
2008
PSA 10
All Children and Young People in the NW Have Healthy Lifestyles
and Productive Lives
Under 18 conception rates per 1000, 15-17 year old females
55
Under 18 Conception Rates
This is our baseline
50
How do we turn
the curve?
45
40
35
North West
30
England
25
2010 National Target
20
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
PSA 3
All Children and Young People in the NW Can Lead Productive Lives
16
14
Percentage NEET
Manchester
Manchester
North West
12
England
10
North West
8
England
6
4
2
2004
2005
Actual Data
2006
2007
2008
2009
Projected reduction required to meet 2010 target
2010
PSA 12
All Children and Young People in the NW Can Lead Productive Lives
80
Percentage of 19 year olds with at least Level 2
qualification
75
2006 National Target
70
How do we maintain
momentum?
65
This is our baseline
North West
England
60
2004
2005
2006
2007
2008
PSA 11
All children and young people in the NW live in stable and safe environments and
Can Lead Productive Lives
10
Percentage care leavers with 5+ GCSEs A*-C
9
8
7
6
This is our baseline
North West
England
5
2002-03
2003-04
2004-05
2005-06
2006-07
2007-08
2008-09
2009-10
PSA
Download