Logic Models Ron Hale Office of Health Promotion & Community Health Improvement April 7, 2008 Las Vegas, NM A logic model is: • A picture of how a program is expected to work. • A systematic and visual way to present relationships among resources, activities, outputs or products, and intended outcomes or changes. • A theory of change, of expected causal relationships Logic Models: • Provide a common framework for understanding a program or set of activities • Show what goes into a program, what the program does, and what the results are • Are at the core of both planning and evaluation • Are often required by funders PLANNING LOGIC MODEL DEVELOPMENT EVALUATION Components of a Logic Model: • Inputs/Resources – – – – Money People Facilities Knowledge/research • Activities • Outputs – – – Products Services provided Numbers of people served • Outcomes – Short-term – Intermediate – Long-term • Indicators/Measures Types of outcomes or changes that can be tracked: 1. Process outcomes: Organizational or coalition functioning 2. Service or program outcomes: Changes in knowledge, behavior, or condition of program participants 3. System outcomes: Community-level changes in organizational relationships, policies, funding patterns, networks, neighborhoods, etc. 4. Health status outcomes: Changes in population health measures Linked Logic Model Components: Inputs Activities Outputs Outcomes Indicators United Way/Urban Institute Logic Model Inputs/ Resources Activities Outputs Short-term Outcomes Intermediate Outcomes Long-Term Outcomes Indicators/ Measures Example: Every day logic model – Family Vacation Family Members Drive to state park Budget Set up camp Car Camping Equipment Cook, play, talk, laugh, hike Family members learn about each other; family bonds; family has a good time Example: Parenting Education & Support Program Situation: INPUTS Staff Money Partners Research During a county needs assessment, majority of parents reported that they were having difficulty parenting and felt stressed as a result OUTPUTS Develop parent ed curriculum Deliver series of interactive sessions Facilitate support groups Targeted parents attend OUTCOMES Parents increase knowledge of child dev Parents better understanding their own parenting style Parents gain skills in effective parenting practices Parents identify appropriate actions to take Parents use effective parenting practices Improved childparent relations Strong families Los Mocosos Community Services, Inc.Child/Parent Mental Health Program Program Logic Model GOAL 1 - Direct Services: Provide mental health interventions and family support services to families with infants and small children who are at risk of social or emotional problems. Long-term aim: To reduce the likelihood of child abuse and neglect and of future behavioral health problems as children grow into adolescence and adulthood. Strategies 1. 2. 3. 4. Provide one-on-one counseling and case management services to high- risk families of infants from birth to age five. Provide parent education and support groups for high-risk families with infants. Provide consultation and clinical supervision to program staff working with high-risk families. Provide psychiatric consultation as needed. Activities/Outputs 1. 2. 3. 4. Family counseling & case management provided to 50 families at three program sites, with approximately 6 sessions per family. Parent/child support & education groups provided to 30 families at three program sites, with minimum of 5 sessions per group. Reflective supervision provided to program staff by appropriately licensed clinical supervisors. 65 hours of psychiatric consultation provided. Outcomes a. b. c. d. e. Reduced levels of parental stress. Improved infant social and emotional development. Enhanced parental awareness of infant cues and needs. Improved family functioning. Parental satisfaction with services. Indicators/Measures a. b. c. d. e. f. Parental Stress Index (PSI) administered at intake, at 6-month intervals, and at exit. Ages & Stages Questionnaire/SocialEmotional (ASQ/SE) administered at intake, at 6-month intervals, and at exit. Clinician progress notes; parent selfassessment survey administered at intake and at exit. NCFAS administered at intake, at 6-month intervals, & at exit. Parent satisfaction survey administered at exit. Treatment plan review (all outcomes) HEALTH COUNCILS AND THE COMMUNITY HEALTH IMPROVEMENT PROCESS C o u n t y Resources DEVELOPMENT ACTION Community Building/Council Development Council Functions H e a l t h C o u n c i l s SYSTEMS Organizational Capacity Council /community Actions Community Assessment CAPACITY Targets of Change Prioritizing and Planning Actions Community and Systems Changes External Capacity Community Health Status Changes Align with DOH plan CONTEXT: Council/DOH relationship; Community history; Political will; Political changes; Resources ($) =; Barriers/Facilitators (interpersonal and structural) 27 Health Promotion Contributions to Reducing DWI Statewide, 1987- 2007 Systems Outcomes (policies) + Population Based Outcomes (behaviors) = Health Status Outcomes HP Strategies (ES #3- 5) 3. Inform/educate/empower about DWI /Alcohol Problems 4. Mobilize for action to solve problems Health Promotion Activities Coordinate 6 key state agencies to support Gallup “March for Jovita” to Santa Fe, 1988 Co-founded Alcohol Issues Consortium (AIC) to provide statewide advocacy/policy strategies in 1998. Met 150 times since. Provide TA, coordinate media advocacy & testify 6 times at Leg. hearings to closedrive-ups Systems Outcomes •Legislation passed for McKinley Co. for Local Liquor Excise Tax Ref., .08 BAC, nuisance bars closed bars, 1989 •DOH/PHD Districts hire DWI Health Educators, late 1980s. •Liquor Excise Tax doubled to 37 million; 33 County DWI Planning Councils formed, 1993 •Drive-ups closed, 1998. 5. Develop State/Local Policies & Plans Coordinate12 key stakeholders in/out of government to undertake legislative action double State’s Liquor Excise Tax, 1992. Health Educators provide 50 hours of technical assistance/training to BHSD/SPFSIG, 2002 for Environmental Strategy Development. TA and policy coordination to toughen Liquor Control Act (LCA) Rules/Regs., effecting 2300 licensees, 2007 8/20/07, Glenn Wieringa •NM First Lady joins national Leadership to Keep Children Alcohol Free, 1999 •DWI Strategic Plan Developed, 2003; DWI Czar hired, 2004 •NM receives 5-year, multimillion dollar federal CSAP grant, 2005 •NM increases penalties for providing alcohol to underage youth, toughest law in USA, 2005 •Tougher LCA Rules/Regs. Enacted, 2007. Health Status Outcomes •Reduced alcoholrelated stats: DWI fatalities, homicides, etc. decrease in McKinley County during the 1990s. •One year after driveup closings, statewide DWI fatalities down 22%. •NM DWI Fatality Rank falls from 1st (worst) to 6th, 19902004. Approx. 2,100 lives saved. •DWI numbers continue to improve. Alcohol -related fatalities at all time low (43%). Systems Thinking Tree Diagram (after K. Kinney) Aim Outcome Measure: Strategies Indicators Major Activities Con Alma Health Foundation Evaluation Logic Model Process Benchmarks Systems Change Outcomes Longer-term Outcomes (Things the program will do or provide) (Outcomes you expect by the end of the grant period.) (Changes for the target population beyond the term of the grant) WHAT IS THE BEST WAY TO CHANGE THE SYSTEM FOR BETTER OUTCOMES? IF WE ARE SUCCESSFUL, WHAT SYSTEMS CHANGE(S) WILL WE SEE OVER THE COURSE OF THE PROJECT? WHAT IS THE ULTIMATE GOAL OF OUR WORK? 1. 1. 1. 2. 2. 2. 3. 3. 3.