HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type them in using the Chat feature. This Webinar will be recorded and posted on websites of the participant CBA programs THIS WEBINAR IS PART OF THE GRANT WRITING PREPAREDNESS SERIES CO-HOSTED BY: SHARED ACTION, AIDS PROJECT LOS ANGELES CAPACITY FOR HEALTH, ASIAN AND PACIFIC ISLANDER AMERICAN HEALTH FORUM CA STD/HIV PREVENTION TRAINING CENTER TODAY’S WEBINAR: WAS DEVELOPED BY: Capacity for Health at APIAHF, a Capacity Building Assistance Program, with offices in San Francisco and Washington D.C. WHO WE ARE: We are funded by The Centers for Disease Control and Prevention (CDC) to provide FREE trainings and one-on-one technical assistance for community-based organizations (CBOs) on: (1) Organizational Infrastructure and Program Sustainability, (2) Evidence-Based Interventions (EBIs) and Public Health Strategies, and (3) Monitoring and Evaluation. Webinar: Developing Logic Models THIS WEBINAR WILL BE RECORDED AND M A D E AVA I L A B L E T H R O U G H O U R W E B S I T E S ALONG WITH COPIES OF THE SLIDES DEVELOPING LOGIC MODELS LeConté Dill, DrPH (c), MPH Experience: Evaluation Consultant at the American Red Cross, AIDS Service Center, and Berkeley Youth Alternatives Centers for Disease Control & Prevention City of Berkeley Public Health Division UC Berkeley Center for Cities & Schools Education: UC Berkeley School of Public Health UCLA School of Public Health Spelman College Teaching: Program Planning & Evaluation Pedagogy Sociology of the Family TOPICS OF THIS WEBINAR Introductions Conversations and Questions Examples of Logic Models What a Logic Model is…and is not The Simple Form of a Logic Model LEARNING OBJECTIVES By the end of this Webinar, participants will: Have expanded their conceptualization of Logic Models Have a toolkit of various types of Logic Models Be able to use Logic Models as a tool for program planning Have at least one practical goal for improving the current elements of their program(s) WHAT A LOGIC MODEL IS … AND IS NOT FIRST QUARTER ON LOGIC… The relationship between elements, and the relationship between an element and the whole SOME HISTORY Logic Models: Were originally created by evaluators in the 1970s Became more popular with the W.K. Kellogg Foundation’s and CDC’s use in the 1990s WHAT IS A LOGIC MODEL? A systematic and visual way to share and present your understanding of the relationships among the resources you have to operate your program, the activities you plan, and the changes or results you hope to achieve. $ ∆ WHAT A LOGIC MODEL IS NOT 1. It is not reality. Is a simple model that represents program intention. 2. It is not complete. It does not display many cultural, social, and environmental factors that influence process and outcomes outside the program 3. Does not prove causal attribution of the intervention to the change 4. It is not a Theory of Change. But it relies on a social or behavioral theory or other theory of change. 5. Doesn’t address: Are we doing the right thing? A THEORY OF CHANGE…PROVIDES RATIONALE It provides rationale for the arrows in a logic model. Program provides cooking classes to teens Learn and practice menu planning & cooking skills Gain knowledge of healthy foods and shopping tips Receive nutritious free food for family Teens eat better Improved nutritional health Teens cook for family weekly It is the scientific or other basis for the “logic” in the logic model. Example from Dr. Lyn Paleo WHY USE A LOGIC MODEL? The road most traveled by… WHY USE A LOGIC MODEL? Makes Program Theory Explicit – “Connects the dots” between resources, activities and outcomes Assists with planning – See where we are, and where we want to be – Identify gaps in goals or activities Clarifies What to Evaluate Helps with communication and consensus-building LOGIC MODEL: SIMPLE FORM SECOND QUARTER EVERYDAY LOGIC MODEL H E A D A C H E Get pills Take pills Headache gone; Return to work Example from Dr. James Glasnapp LOGIC MODELS IN PROGRAM PLANNING W.K. Kellogg Foundation LOGIC MODEL: SIMPLE FORM Source: Kellogg Foundation, Logic Model Development Guide, www.wkkf.org Certain resources are needed to operate the program If you have access to them, then you can use them to accomplish your planned activities Resources / inputs Activities If you accomplish your planned activities, then you hopefully deliver the amount of product or service that you intended Outputs If you accomplish your planned activities to the extent you intended, then your participants will benefit in certain ways If these benefits to participants are achieved, then certain changes in organizations, communities, or systems might be expected to occur Outcomes Impact COMMON ELEMENTS IN LOGIC MODELS Resources / Inputs – What we invest Activities / Outputs – – Activities: What we do Participation: Who we reach “Chain of Outcomes” – – – Short-Term (1 to 3 years) Medium – Term (4 to 6 years) Long – Term (Impact: 7 – 10 years) Connectors – Arrows are really “If-Then Statements” LOGIC MODELS: SIMPLE FORM Resources / Inputs Activities Outputs Outcomes Impact INPUTS FACULTY STAFF MONEY TIME VOLUNTEERS PARTNERS EQUIPMENT OUTPUTS What we do Who we reach ACTIVITIES PARTICIPATION Workshops Counseling Facilitation Product development Curriculum design Trainings Field days Conferences Participants Clients Customers Users OUTCOMES What results for individuals, organizations, communities..… SHORT MEDIUM LONG-TERM Learning Action Conditions Awareness Knowledge Attitudes Skills Opinion Aspirations Motivation Behavior Practice Decisions Policies Social action Human Economic Civic Environment OUTCOMES FOR DIFFERENT TYPES OF PROGRAMS PROGRAMS WITH FACE-TO-FACE CONTACT SHORT MEDIUM LONG-TERM Changes in: [Head, heart, and gut] Changes in: [Actions] Changes in: [Well-being] • • • • • • • •Behavior •Skills • • • • Awareness Knowledge Attitudes Opinion Aspirations Motivation Behavioral intent • • Health Education Financial stability Relationships (including with offspring) Legal condition Addiction condition SOCIAL MARKETING PROGRAMS SHORT MEDIUM LONG-TERM Changes in: Changes in: Changes in: Awareness of campaign Attitudes Behaviors Group norms Understanding of message Aspirations Opinion Motivation Behavioral intent Health Education Financial stability Relationships (including with offspring) Legal condition Addiction condition POLICY AND ADVOCACY PROGRAMS SHORT Media contacts MEDIUM Media reps come to our org for back story Messages and materials developed Media coverage of issues Coalition developed Coalition builds capacity and skills LONG-TERM Regulations or Laws passed and enforced http://www.planning.continuousprogress.org/ TIPS ON CREATING A LOGIC MODEL 1. A logic model should be easy to read and understand by stakeholders who are only somewhat familiar with your program. 2. Make it clear who does what and who receives what. Subject – verb – object 3. Achieve a balance between showing enough detail and not too much detail. LOGIC MODELS: EXAMPLES THIRD QUARTER HIV PREVENTION EXAMPLES www.effectiveinterventions.org/Files/MP_LogicModel.pdf HIV PREVENTION EXAMPLES www.effectiveinterventions.org/Files/SISTA_Logic_Model.pdf HIV PREVENTION EXAMPLES http://www.effectiveinterventions.org/Files/FOY_Logic_Model.pdf HIV PREVENTION EXAMPLES www.effectiveinterventions.org/Files/10-0204_Safety_Counts_Logic_Model_(view).pdf ADDITIONAL EXAMPLES ADDITIONAL EXAMPLES W.K. Kellogg Foundation ADDITONAL EXAMPLES The VERB™ Campaign Logic Model: A Tool for Planning and Evaluation Marian Huhman, PhD, Carrie Heitzler, MPH, and Faye Wong, MPH, RD Preventing Chronic Disease v.1(3); Jul 004 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1253476/ ADDITIONAL EXAMPLES www.cchers.org ADDITIONAL EXAMPLES http://eobhc.net/docs/ FLESHING OUT THE SIMPLE FORM Resources Activities Outputs Outcomes Impact In order to accomplish out set of activities, we will need the following: In order to address our problem or asset, we will conduct the following: Once completed or underway, these activities will produce the following evidence of service delivery: If completed or ongoing, these activities will lead to the following changes in the next 1-3 years, then 4-6 years: If completed, these activities will lead to the following changes in the 7-10 years: CHECKING YOUR LOGIC Are the outcomes really outcomes? Is the longest-term outcome meaningful? Is it logical? Is it realistic? Does it represent the program’s purpose; response to the situation? LINKS TO GOALS AND OBJECTIVES Input/Resources Activities Output Process Objectives Effects/Outcomes Impact Outcome Objectives Goals “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Example from Dr. Julianna Deardorff “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Dr. Julianna Deardorff “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Dr. Julianna Deardorff “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Dr. Julianna Deardorff “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Dr. Julianna Deardorff “Funding, expertise and supplies provided by this project to train community health workers to establish and maintain a misoprostol distribution system and to provide appropriate community health education will result in adequate and consistent supply of misoprostol and a community education network that will lead to increased acceptability of misoprostol and increased use of misoprostol by women. These changes will contribute to improving the health status of the women by reducing the morbidity and mortality related to postpartum hemorrhage.” Dr. Julianna Deardorff Additional Resources W.K. Kellogg Foundation’s Evaluation Handbook: www.wkkf.org/knowledge-center/resources/2010/W-KKellogg-Foundation-Evaluation-Handbook.aspx Diffusion of Effective Behavioral Interventions (DEBI) Project: www.effectiveinterventions.org CDC’s Framework for Program Evaluation in Public Health: http://www.cdc.gov/mmwr/pdf/rr/rr4811.pdf Additional Resources Slides and a recorded version of this webinar will be available on the following websites: AIDS Project Los Angeles- Shared Action www.sharedaction.org Capacity 4 Health, APIAHF www.capacity4health.org CA STD/HIV Prevention Training Center www.stdhivtraining.org Contact us for individualized capacity building assistance CONVERSATION AND QUESTIONS FOURTH QUARTER Thank You!