OKLAHOMA QUALITY
IMPROVEMENT COLLABORATIVE
INTERIM TRAINING
Marlene Mason
MCPP Healthcare Consulting, Inc.
October 28, 2010
Training Agenda – October 28, 2010





Review team progress and data collection on short
term measures
Using Logic Models to Link Outcome Measures
Tools and Strategies for Effective Community
Engagement
Develop Implementation Plan
Tying it all Together
2
MCPP Healthcare Consulting
2
Teams Report AIM and Progress

Review current AIM statement and any baseline
data or results of data collection (15 minutes each)
 Cleveland
County
 Comanche County
 Logan County
 Okfuskee County
 Washington County
3
Using Logic Models to Link to Outcome
Measures
We inspect
restaurants
So that
# of inspections
Conditions in the
restaurant don’t
create unsafe food
So that
# of critical violations
Public is sold
food that is
safe to eat
% of critical
violations corrected
within 24 hours
The Logic of
Public Health
5
So that
There are fewer
incidents of
foodborne illness
Rate of food borne illness
MCPP Healthcare Consulting
Why Logic Models?





Show how a program’s activities relate to the
intended outcomes
Link our process outputs to our outcomes
Connect what we do every day to why we do it
Help you plan, evaluate, describe and market your
program
Show your funder how you do what they fund you to
do
MCPP Healthcare Consulting
6
Logic Models Come in all
Shapes and Sizes



As long as the format is legible, logical, and it
works for you, it’s probably fine
Boxes and arrows are not required
New computer software is not required
MCPP Healthcare Consulting
7
Logic Model:
Any Public Health Program
Inputs
Resources
Money
Staff
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Activities
Program
Development
Program
Planning
Materials
Development,
Distribution
Informed,
Targeted
Program
Reduced
Morbidity
Improved
knowledge,
beliefs,
attitudes
Appropriate,
Targeted
Materials
MCPP Healthcare Consulting
Improved
Behaviors
Reduced
Mortality
Improved
Quality of
Life
8
MCPP Healthcare Consulting
9
Components of a Logic Model
Inputs
Resources
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Activities
Inputs:
Resources or the things you start with
such as funding, staff, materials, etc.
Activities or the things you do every
day such as conduct educational
meetings, investigate complaints or
reports of illness, see clients, distribute
materials, etc.
MCPP Healthcare Consulting
10
Components of a Logic Model
Inputs
Resources
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Activities
Outputs:
What you get as a result of the resources and activities you put “in”; Not
an end in itself
Examples: Number of clients seen, attendees in classes or restaurants
inspected
MCPP Healthcare Consulting
11
Components of a Logic Model
Inputs
Resources
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Activities
Outcomes:
The results we expect from our resources and
activities as stated quantifiable, time-framed
performance measures
Examples: results from the process such as the
percent of planned activities that were achieved
or results related to clients or the public such as
improved knowledge, behavior change, reduced
risk or exposure to illness or improved health
status
MCPP Healthcare Consulting
12
Inputs
Outputs
Short Term
Outcomes
When you make a logic
model for a brand new
program, it’s easiest to
begin with what you are
trying to achieve and work
backwards.
MCPP Healthcare Consulting
Intermediate
Outcomes
Long Term
Outcomes
Improve
health of
adolescents
in county
Strengthen
Adolescent
Health and
Youth
Development
13
Inputs
Outputs
Short Term
Outcomes
Intermediate
Outcomes
When you work backwards
through your logic model,
ask HOW?
Long Term
Outcomes
Improve
health of
adolescents
in county
How do we do
this?
Strengthen
Adolescent
Health and
Youth
Development
MCPP Healthcare Consulting
14
Inputs
Outputs
Short Term
Outcomes
When you work backwards
through your logic model,
ask HOW?
How do we do
this?
Intermediate
Outcomes
Individual
Behavior
Change
Systems
Change
MCPP Healthcare Consulting
Long Term
Outcomes
Improve
health of
adolescents
in county
Strengthen
Adolescent
Health and
Youth
Development
15
Inputs
Outputs
Short Term
Outcomes
When you work backwards
through your logic model,
ask HOW?
How do we do
this?
Intermediate
Outcomes
Encourage use
of best practices
in local
programs
Community
partners
maintain or
increase support
for youth
development
Influence policy
decisions
MCPP Healthcare Consulting
Individual
Behavior
Change
Systems
Change
Long Term
Outcomes
Improve
Health of
Adolescents
in WA state
Strengthen
Adolescent
Health and
Youth
Development
16
Inputs
Increase Number
and Strength of
Partnerships
Vision for Long
term Planning
Long term
commitments from
key stakeholders for
development and
implementation of
plan
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you make a logic
model for an existing
program, it’s easiest to
begin with what you are
already doing and work
forwards.
Utilize Data &
Research
MCPP Healthcare Consulting
17
Inputs
Increase Number
and Strength of
Partnerships
Vision for Long
term Planning
Long term
commitments from
key stakeholders for
development and
implementation of
plan
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you work forwards
through your logic model,
ask WHY?
Why do we do
this?
Utilize Data &
Research
MCPP Healthcare Consulting
18
Inputs
Outputs
Increase Number
and Strength of
Partnerships
Intermediate
Outcomes
Long Term
Outcomes
When you work forwards
through your logic model,
ask WHY?
Vision for Long
term Planning
Long term
commitments from
key stakeholders for
development and
implementation of
plan
Short Term
Outcomes
Adolescent
Health Plan
Ongoing
Partnerships
Why do we do
this?
Utilize Data &
Research
MCPP Healthcare Consulting
19
Logic Model:
Any Public Health Program
Inputs
Resources
Money
Staff
Outputs
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Activities
Program
Development
Program
Planning
Appropriate,
Targeted
Materials
Informed,
Targeted
Program
Reduced
Morbidity
Improved
knowledge,
beliefs,
attitudes
Materials
Development,
Distribution
MCPP Healthcare Consulting
Improved
Behaviors
Reduced
Mortality
Improved
Quality of
Life
20
Establishing Process Outcomes
Measures From Logic Model




Develop Logic Model with activities and outputs
(productivity data)
Describe short term, intermediate and long term
outcomes
If outcome is stated as “desired” outcome, then
establish quantifiable measure based on available
output data
Develop data collection tools (if needed) and set
targets for each measure
21
Different Types of Objectives

Process Outputs
 Results

of the work we do every day
Short-term to Long-term Outcomes
 What
has to happen for our long term outcomes to be
achieved

Impact or Goal
 The
end goal—what we’re really after—improved
health outcomes
MCPP Healthcare Consulting
22
Logic Model with Outcome Measures
Activities
Outputs
Short-term Outcomes
Education:

Care coordination

Child development

Childbirth

Breastfeeding

Car seat usage

Nutrition education

STD prevention

Seat belt usage

Oral health

Parenting

Pregnancy prevention

Physical activity

Postpartum depression

Tobacco prevention /
cessation
Assessment and share data
/ information
Referrals and linkage to
services

Transportation

Hispanic clients access
to services

Adopt system for 1
condition

Goal-setting with clients
# of 1st trimester, 2nd trimester,
3rd trimester, Post Partum
packets distributed
# of clients and of visits that
smoking and tobacco
cessation was discussed
# of referrals by type,
including:

Quit Line/tobacco

Education

Substance Abuse

Breastfeeding

Domestic Violence
# of clients receiving initial
family planning teaching
# of community meetings
where MCH data is presented
# of First Steps clients who
have a chosen family planning
method at postpartum
# of Evidence-Based
Practices researched
# of Spanish speakers
referred for care
# of BOH visits where MCH
data is
presented
100% of MSS clients receive
trimester packets at
appropriate times

% of MSS clients
receiving packets
100% of visits, clients have
tobacco cessation discussion

% of MSS clients with
tobacco cessation
discussion
100% of selected referrals are
documented

% of referrals
documented
Increased knowledge of
benefits of breastfeeding

% of women
breastfeeding at
discharge
Improve client knowledge of
unplanned pregnancy risk

% of clients
demonstrating
knowledge through client
survey
Long-term Outcomes
Increase % of women
breastfeeding for at least 2
months
Increase # of women with
successful breastfeeding
experiences
Increase % of women
accessing prenatal care in the
1st trimester
Decrease smoking rate among
women to the State level
Decrease the rate of second
pregnancy within 2 years
23
24
MCPP Healthcare Consulting
Resources

CDC Evaluation Working Group


United Way Outcome Measurement Resource Network:


http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf
How Logic Models Can Help NIDRR Grantees Plan and Demonstrate
Progress:


http://national.unitedway.org/outcomes/
W.K. Kellogg Foundation Logic Model Development Guide:


http://www.cdc.gov/eval
http://www.ncddr.org/du/researchexchange/v09n02/1_logic.html
University of Wisconsin- Extension: Planning and evaluating education and
outreach programs with a logic model:

http://www.uwex.edu/ces/lmcourse/#
MCPP Healthcare Consulting
25
What questions do you have?
MCPP Healthcare Consulting
26
Download

Logic Model Training - National Network of Public Health Institutes