Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program Chad Green, Program Analyst Lynn McNally, Technology Resource Supervisor Loudoun County Public Schools, VA Virginia DOE Tech Leadership Conference, November 29, 2006 Goals of Presentation 1. Loudoun Tech Leadership Program: The Story 2. Enhancing the Program: Logic Model Framework 3. Research Anchor: Why Use a Logic Model 4. Questions and Answers Loudoun Tech Leadership Program 1. The Story • Spring 2002 - Bill and Melinda Gates (VITAL) • Market to Principals • Roll Out the TAGLIT Survey • The Workshop Plan • Packages Loudoun Tech Leadership Program Loudoun Tech Leadership Program Loudoun Tech Leadership Program Loudoun Tech Leadership Program Loudoun VITAL Participation Spring 2002 - Planning - LM Year 1: 17 workshops, 291 participants – SK Year 2: 10 workshops, 102 participants – SB Year 3: 32 workshops, 360 participants – PT Year 4: 39 workshops, 340 participants – PT End of Year 4 – Look at Benefits Principal • Tech Skills • New Tools • Tech Integration • Data Manipulation • SIP Planning • Manage Change ITRT • Understand Role • Build Partners • Consultant Role • More Visibility Supervisor • More Visibility • Awareness of Initiatives • Understanding of Initiatives • Build Partners Student • Thoughtful Tech Integration • Learning • Motivation • Interest Enhancing the Program 2. Logic Model Framework • What Is a Logic Model? • Components of a Logic Model • Benefits of Logic Models • Example: Loudoun VITAL Program • Using a Logic Model for Evaluation Enhancing the Program What Is a Logic Model? • Provides a graphic description of a program. • Shows the relationship of program resources and activities to expected results. • Makes explicit the underlying theories and assumptions (logic) behind a program’s design. Enhancing the Program Components of a Logic Model • Situation Statement: Mission of program and intended outcomes based on needs • Inputs: Required resources for activities to achieve outcomes • Outputs: Activities and participation rate/ satisfaction of target populations Enhancing the Program Components of a Logic Model (cont.) •Outcomes: Short-, medium-, and long-term benefits for program participants (results) •Assumptions: Supporting evidence of the effectiveness of program design •External Factors: Other potential influences on program’s ability to achieve outcomes • Evaluation: Formative and summative Enhancing the Program Benefits of Logic Models • Goal Setting: Define the specific short-, medium-, and long-term outcomes (results) of a program. • Planning and Design: Clarify the underlying assumptions, relationships, and desired effects of program activities. Enhancing the Program Benefits of Logic Models (cont.) • Communications and Marketing: Clarify and illustrate the program to key stakeholders. • Collaboration: Build buy-in and promote consensus on program design and outcomes. • Evaluation: Focus resources on the most critical and appropriate data to track. Enhancing the Program Example: Loudoun VITAL Program • See handouts. Enhancing the Program Using a Logic Model for Evaluation • Develop essential questions for each column. • Prioritize and select questions given resources. • Identify indicators for each question. • Develop data collection tools for indicators. • Collect and analyze data. • Report results to stakeholders. Research Anchor 3. Why Use a Logic Model • Why do you think the logic model has the components that it has and is a common tool for evaluation? • Is it useful for planning and evaluating educational technology programs in general? Research Anchor Feedback Spirals as Components of Continuous Learning* * Costa, A. L., & Kallick, B. (1995). Research Anchor Feedback Spirals at the Program Level 1. 2. 3. 4. 5. 6. 7. 8. Clarify program goals and purpose (via logic model). Develop implementation and evaluation plan. Implement and monitor priority program activities. Collect, organize, and analyze evidence (data). Review results with various groups. Modify program activities based on new knowledge. Revisit/clarify program goals and purpose. Revisit logic model and action plan.... Questions and Answers 4. Questions and Answers • Loudoun VITAL Program • Logic Model • Our Roles in Loudoun • Chad’s Suit • Lynn’s Haircut • Good Restaurants in Roanoke