Evaluation Plan My County/State’s Intimate Partner Violence Prevention Activities 2010 – 2015 Subtitle FOR MORE INFORMATION, PLEASE CONTACT: My name and address Table of Contents Background of the Evaluation.............................................................................................................3 Purpose of the Evaluation ..................................................................................................................3 Evaluation Questions .........................................................................................................................3 Methods ............................................................................................................................................4 Evaluation Design .........................................................................................................................................................................4 Data Collection ...............................................................................................................................................................................4 Data Analysis ...................................................................................................................................................................................5 Reporting ..........................................................................................................................................7 Timeline ............................................................................................................................................7 Staffing and Budget............................................................................................................................8 Staffing ...............................................................................................................................................................................................8 Budget ................................................................................................................................................................................................9 IPV Prevention Evaluation Plan 2010-2018 Page 2 of 9 Background of the Evaluation Insert a short description of what is being evaluated (PSC activity or prevention strategy) Purpose of the Evaluation List your goals and outcomes (if doing an outcome evaluation) Attach your logic model (if you have one) Evaluation Questions List the specific questions the evaluation will answer (both process and outcome, if relevant). More information about evaluation questions can be found in the GTO Evaluation Step in the Process Evaluation and Outcome Evaluation sections. IPV Prevention Evaluation Plan 2010-2018 Page 3 of 9 Methods Evaluation Design Describe the evaluation design you will use to answer the evaluation questions. For example, will you be using tracking sheets to collect information about a strategy implementation (process evaluation)? From who? When? Will you be doing a post-only evaluation? Will you be doing a pretest-posttest evaluation? (outcome evaluation). More information about evaluation design can be found in the GTO Evaluation Step. Data Collection Describe the tools you will use to collect data, including any surveys, interview questions, etc. Explain who will be collecting the data, when, how it will be collected and your process for storing the data once it has been collected. More information about data collection can be found in Section C: Collecting Data of the GTO Evaluation Step Appendices. Example: Intro language… The specific change that will be measured for each outcome is underlined. For example, in the first goal listed in the table below, we will measure changes in the following systems/ knowledge/attitudes/behaviors: Levels of collaboration Available resources Number and types of risk and protective factors for which data is collected The accessibility of risk and protective factor data How data is catalogued at the state level OUTCOME PROCESS DATA COLLECTION METHOD GOAL: To enhance the continuous collection of and access to risk and protective factor data associated with male perpetration of sexual and domestic violence. By 20XX, the level of collaboration Observed level of Key informant among entities within the collaboration related to interviews prevention system specifically collection of risk and regarding the collection and protective factor data dissemination of data associated with risk and protective factors for male perpetration of sexual and domestic violence will increase by XX%. OUTCOME MEASURES OUTCOME DATA COLLECTION METHOD Observed level of collaboration related to dissemination of risk and protective factor data Review of meeting minutes/agreements IPV Prevention Evaluation Plan 2010-2018 Page 4 of 9 PROCESS MEASURES OUTCOME By 20XX, the available resources for the collection of risk and protective factor data associated with male perpetration of sexual and domestic violence will increase so that they are sufficient for the comprehensive collection of relevant data. By 20XX, the number of risk and protective factors associated with male perpetration of sexual and domestic violence for which statewide data is collected will increase to 80%. OUTCOME MEASURES OUTCOME DATA COLLECTION METHOD Comparison of current and future resource assessments Prevention Resource Assessment Comparison of current and future data needs assessments Data Needs Assessment New question about “knowledge of key components of a healthy relationship” Statewide project surveys (YRBS, CTC, etc.) PROCESS MEASURES PROCESS DATA COLLECTION METHOD GOAL: B By 20XX, men and boys, aged 1124, will demonstrate a XX% increase in knowledge regarding key components of healthy intimate partner relationships For males age 11-18 in school: Youth Risk Behavior Survey and/or CTC For males age 19-24: BRFSS Data Analysis Describe how you will analyze the data. For example, will you be averaging the findings across participants, counties, etc? Will you be coding qualitative interview data? Will you be calculating percent change scores? More information about data analysis can be found in Section E: Analyzing Your Results and Making Conclusions of the GTO Evaluation Step Appendices. Data Collection Method SCCD Survey Coordinate with ambassador program Culture Camp pre & post test Analysis (State level only) Thematic Coding Thematic Coding Crosstab analyses by region Compare with state demographic information Crosstab analyses by region IPV Prevention Evaluation Plan 2010-2018 Page 5 of 9 Summary of state demographic information (U.S. Census?) Crosstab analyses by region Compare with statewide community survey ADD PROCESS METHODS IPV Prevention Evaluation Plan 2010-2018 Page 6 of 9 Reporting Describe how the evaluation team will report and assure the use of the evaluation findings. The plan should point out the format (oral, written, visual, etc.), content, and frequency reports. It should also specify how the findings will be used by the different stakeholders. More information about reporting can be found in Section F: Sharing Your Evaluation Results of the GTO Evaluation Step Appendices. Format of reports Content of reports Frequency of reports How reports will be used by stakeholders Timeline Outline when your evaluation activities will occur. Each of the components of the evaluation should be included in the timeline, such as when the data collection will occur, when data analysis will happen, and when reports or summaries will be written and distributed. Data Collection Method Data Collection Data Analysis Key stakeholder interviews Statewide project surveys (YRBS, CTC, etc.) BRFSS: Present new questions in Aug 2011 Questions added Jan 2012 YRBS: Administered in odd years (2011 is next one – high school students only) Review of meeting minutes/agreements Prevention resource assessment IPV Prevention Evaluation Plan 2010-2018 Page 7 of 9 Report Writing Sharing with Stakeholders and/or CQI (if applicable) Data needs assessment Summary of state demographic information (U.S. Census?) Staffing and Budget Staffing Who will be doing what? In other words, describe (via a table or other clear format) who will be collecting data, entering data, analyzing data, writing reports, sharing findings, etc. This is a general description, not a detailed timeline. Just describe the main roles that each person will have in the evaluation. Data Collection Method Key stakeholder interviews Statewide project surveys (YRBS, CTC, etc.) Review of meeting minutes/agreements Statewide community survey Statewide survey of prevention practitioners/allies Summary of state demographic information (U.S. Census?) Prevention Resource Assessment Data prevention system capacity assessment Who Collects Who Enters Who Analyzes Who Shares Me You Me You Me You Me You Him Her Him Her The empowerment evaluation team and the DELTA/SVPE state coordinators (you, me and him) Him Her Me Me Me You Me IPV Prevention Evaluation Plan 2010-2018 Page 8 of 9 Budget How much will the evaluation cost? Where will funds come from? How will evaluation activities be incorporated into the work of current staff? Data Collection Method Estimated Cost Funding Source Key stakeholder interviews Review of meeting minutes/agreements Prevention resource assessment Data needs assessment Summary of state demographic information (U.S. Census?) Prevention Resource Assessment Data prevention system capacity assessment ? DELTA– FY 2011 Have Funds Been Allocated/Secured? YES/NO YES ? DELTA - FY 2011 YES $11,000 DELTA - FY 2011 YES IPV Prevention Evaluation Plan 2010-2018 Page 9 of 9