Marlene Mason
MCPP Healthcare Consulting, Inc.
October 28, 2010






Review team progress and data collection on short term measures
Using Logic Models to Link Outcome Measures
Tools and Strategies for Effective Community
Engagement
Develop Implementation Plan
Tying it all Together
MCPP Healthcare Consulting
2
2


Review current AIM statement and any baseline data or results of data collection (15 minutes each)

Cleveland County

Comanche County

Logan County

Okfuskee County

Washington County
3

Using Logic Models to Link to Outcome
Measures

5
We inspect restaurants
So that
# of inspections
Conditions in the restaurant don’t create unsafe food
# of critical violations
So that
Public is sold food that is safe to eat
% of critical violations corrected within 24 hours
So that
There are fewer incidents of foodborne illness
Rate of food borne illness
MCPP Healthcare Consulting


Show how a program’s activities relate to the intended outcomes

Link our process outputs to our outcomes

Connect what we do every day to why we do it

Help you plan, evaluate, describe and market your program

Show your funder how you do what they fund you to do
MCPP Healthcare Consulting
6

Logic Models Come in all
Shapes and Sizes

As long as the format is legible, logical, and it works for you, it’s probably fine

Boxes and arrows are not required

New computer software is not required
MCPP Healthcare Consulting
7

Resources
Money
Staff
Inputs
Activities
Outputs
Program
Development
Program
Planning
Materials
Development,
Distribution
Informed,
Targeted
Program
Appropriate,
Targeted
Materials
MCPP Healthcare Consulting
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Reduced
Morbidity
Improved knowledge, beliefs, attitudes
Improved
Behaviors
Reduced
Mortality
Improved
Quality of
Life
8

MCPP Healthcare Consulting
9

Resources
Inputs
Activities
Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Inputs:
Resources or the things you start with such as funding, staff, materials, etc.
Activities or the things you do every day such as conduct educational meetings, investigate complaints or reports of illness, see clients, distribute materials, etc.
MCPP Healthcare Consulting
10

Resources
Inputs
Activities
Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Outputs:
What you get as a result of the resources and activities you put “in”; Not an end in itself
Examples: Number of clients seen, attendees in classes or restaurants inspected
MCPP Healthcare Consulting
11

Inputs
Activities
Outputs
Resources
Outcomes:
The results we expect from our resources and activities as stated quantifiable, time-framed performance measures
Short Term
Outcomes
Examples: results from the process such as the percent of planned activities that were achieved or results related to clients or the public such as improved knowledge, behavior change, reduced risk or exposure to illness or improved health status
MCPP Healthcare Consulting
Intermediate
Outcomes
Long Term
Outcomes
12

Inputs Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you make a logic model for a brand new program, it’s easiest to begin with what you are trying to achieve and work backwards.
Improve health of adolescents in county
Strengthen
Adolescent
Health and
Youth
Development
MCPP Healthcare Consulting
13

Inputs Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you work backwards through your logic model, ask HOW?
Improve health of adolescents in county
How do we do this?
Strengthen
Adolescent
Health and
Youth
Development
MCPP Healthcare Consulting
14

Inputs Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you work backwards through your logic model, ask HOW?
How do we do this?
Individual
Behavior
Change
Systems
Change
Improve health of adolescents in county
Strengthen
Adolescent
Health and
Youth
Development
MCPP Healthcare Consulting
15

Inputs Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you work backwards through your logic model, ask HOW?
Encourage use of best practices in local programs
How do we do this?
Community partners maintain or increase support for youth development
Individual
Behavior
Change
Systems
Change
Influence policy decisions
Improve
Health of
Adolescents in WA state
Strengthen
Adolescent
Health and
Youth
Development
MCPP Healthcare Consulting
16

Inputs
Increase Number and Strength of
Partnerships
Vision for Long term Planning
Long term commitments from key stakeholders for development and implementation of plan
Utilize Data &
Research
Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you make a logic model for an existing program, it’s easiest to begin with what you are already doing and work forwards.
MCPP Healthcare Consulting
17

Inputs
Increase Number and Strength of
Partnerships
Vision for Long term Planning
Long term commitments from key stakeholders for development and implementation of plan
Utilize Data &
Research
Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
When you work forwards through your logic model, ask WHY?
Why do we do this?
MCPP Healthcare Consulting
18

Inputs Outputs Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Increase Number and Strength of
Partnerships
Vision for Long term Planning
Long term commitments from key stakeholders for development and implementation of plan
Utilize Data &
Research
Adolescent
Health Plan
Ongoing
Partnerships
When you work forwards through your logic model, ask WHY?
Why do we do this?
MCPP Healthcare Consulting
19

Resources
Inputs
Activities
Money
Staff
Outputs
Program
Development
Program
Planning
Materials
Development,
Distribution
Appropriate,
Targeted
Materials
Informed,
Targeted
Program
MCPP Healthcare Consulting
Short Term
Outcomes
Intermediate
Outcomes
Long Term
Outcomes
Reduced
Morbidity
Improved knowledge, beliefs, attitudes
Improved
Behaviors
Reduced
Mortality
Improved
Quality of
Life
20


Develop Logic Model with activities and outputs
(productivity data)

Describe short term, intermediate and long term outcomes

If outcome is stated as “desired” outcome, then establish quantifiable measure based on available output data

Develop data collection tools (if needed) and set targets for each measure
21




Process Outputs

Results of the work we do every day
Short-term to Long-term Outcomes

What has to happen for our long term outcomes to be achieved
Impact or Goal

The end goal—what we’re really after—improved health outcomes
MCPP Healthcare Consulting
22

Activities Outputs Short-term Outcomes Long-term Outcomes











Education:


Care coordination
Child development
 Childbirth
Breastfeeding
Car seat usage
Nutrition education
STD prevention
Seat belt usage
Oral health
Parenting
Pregnancy prevention
Physical activity
Postpartum depression
Tobacco prevention / cessation
Assessment and share data
/ information
Referrals and linkage to services


Transportation
Hispanic clients access
 to services
Adopt system for 1
 condition
Goal-setting with clients
# of 1 st trimester, 2 nd trimester,
3rd trimester, Post Partum packets distributed
# of clients and of visits that smoking and tobacco cessation was discussed
# of referrals by type, including:
 Quit Line/tobacco




Education
Substance Abuse
Breastfeeding
Domestic Violence
# of clients receiving initial family planning teaching
# of community meetings where MCH data is presented
# of First Steps clients who have a chosen family planning method at postpartum
# of Evidence-Based
Practices researched
# of Spanish speakers referred for care
# of BOH visits where MCH data is presented
100% of MSS clients receive trimester packets at appropriate times
 % of MSS clients receiving packets
100% of visits, clients have tobacco cessation discussion
 % of MSS clients with tobacco cessation discussion
100% of selected referrals are documented
 % of referrals documented
Increased knowledge of benefits of breastfeeding
 % of women breastfeeding at discharge
Improve client knowledge of unplanned pregnancy risk
 % of clients demonstrating knowledge through client survey
Increase % of women breastfeeding for at least 2 months
Increase # of women with successful breastfeeding experiences
Increase % of women accessing prenatal care in the
1 st trimester
Decrease smoking rate among women to the State level
Decrease the rate of second pregnancy within 2 years
23

24 MCPP Healthcare Consulting






CDC Evaluation Working Group
 http://www.cdc.gov/eval
United Way Outcome Measurement Resource Network:
 http://national.unitedway.org/outcomes/
W.K. Kellogg Foundation Logic Model Development Guide:
 http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf
How Logic Models Can Help NIDRR Grantees Plan and Demonstrate
Progress:
 http://www.ncddr.org/du/researchexchange/v09n02/1_logic.html
University of Wisconsin- Extension: Planning and evaluating education and outreach programs with a logic model:
 http://www.uwex.edu/ces/lmcourse/#
MCPP Healthcare Consulting
25

MCPP Healthcare Consulting
26