Evaluation Plan - template - Strategic Prevention Solutions

advertisement
Evaluation Plan
My County/State’s Intimate Partner Violence Prevention Activities
2010 – 2015
Subtitle
FOR MORE INFORMATION, PLEASE CONTACT:
My name and address
Table of Contents
Background of the Evaluation.............................................................................................................3
Purpose of the Evaluation ..................................................................................................................3
Evaluation Questions .........................................................................................................................3
Methods ............................................................................................................................................4
Evaluation Design .........................................................................................................................................................................4
Data Collection ...............................................................................................................................................................................4
Data Analysis ...................................................................................................................................................................................5
Reporting ..........................................................................................................................................7
Timeline ............................................................................................................................................7
Staffing and Budget............................................................................................................................8
Staffing ...............................................................................................................................................................................................8
Budget ................................................................................................................................................................................................9
IPV Prevention Evaluation Plan 2010-2018
Page 2 of 9
Background of the Evaluation
Insert a short description of what is being evaluated (PSC activity or prevention strategy)
Purpose of the Evaluation
List your goals and outcomes (if doing an outcome evaluation)
Attach your logic model (if you have one)
Evaluation Questions
List the specific questions the evaluation will answer (both process and outcome, if relevant). More
information about evaluation questions can be found in the GTO Evaluation Step in the Process
Evaluation and Outcome Evaluation sections.
IPV Prevention Evaluation Plan 2010-2018
Page 3 of 9
Methods
Evaluation Design
Describe the evaluation design you will use to answer the evaluation questions. For example, will you be
using tracking sheets to collect information about a strategy implementation (process evaluation)? From
who? When? Will you be doing a post-only evaluation? Will you be doing a pretest-posttest evaluation?
(outcome evaluation). More information about evaluation design can be found in the GTO Evaluation
Step.
Data Collection
Describe the tools you will use to collect data, including any surveys, interview questions, etc. Explain
who will be collecting the data, when, how it will be collected and your process for storing the data once
it has been collected. More information about data collection can be found in Section C: Collecting Data
of the GTO Evaluation Step Appendices.
Example:
Intro language…
The specific change that will be measured for each outcome is underlined. For example, in the first goal
listed in the table below, we will measure changes in the following systems/
knowledge/attitudes/behaviors:
 Levels of collaboration
 Available resources
 Number and types of risk and protective factors for which data is collected
 The accessibility of risk and protective factor data
 How data is catalogued at the state level
OUTCOME
PROCESS
DATA
COLLECTION
METHOD
GOAL: To enhance the continuous collection of and access to risk and protective factor data associated with male
perpetration of sexual and domestic violence.
By 20XX, the level of collaboration Observed level of
Key informant
among entities within the
collaboration related to
interviews
prevention system specifically
collection of risk and
regarding the collection and
protective factor data
dissemination of data associated
with risk and protective factors
for male perpetration of sexual
and domestic violence will
increase by XX%.
OUTCOME MEASURES
OUTCOME DATA
COLLECTION
METHOD
Observed level of
collaboration related to
dissemination of risk and
protective factor data
Review of meeting
minutes/agreements
IPV Prevention Evaluation Plan 2010-2018
Page 4 of 9
PROCESS
MEASURES
OUTCOME
By 20XX, the available resources
for the collection of risk and
protective factor data associated
with male perpetration of sexual
and domestic violence will
increase so that they are sufficient
for the comprehensive collection
of relevant data.
By 20XX, the number of risk and
protective factors associated with
male perpetration of sexual and
domestic violence for which
statewide data is collected will
increase to 80%.
OUTCOME MEASURES
OUTCOME DATA
COLLECTION
METHOD
Comparison of current
and future resource
assessments
Prevention Resource
Assessment
Comparison of current
and future data needs
assessments
Data Needs
Assessment
New question about
“knowledge of key
components of a healthy
relationship”
Statewide project
surveys (YRBS, CTC,
etc.)
PROCESS
MEASURES
PROCESS
DATA
COLLECTION
METHOD
GOAL: B
By 20XX, men and boys, aged 1124, will demonstrate a XX%
increase in knowledge regarding
key components of healthy
intimate partner relationships
For males age 11-18
in school:
Youth Risk Behavior
Survey and/or CTC
For males age 19-24:
BRFSS
Data Analysis
Describe how you will analyze the data. For example, will you be averaging the findings across
participants, counties, etc? Will you be coding qualitative interview data? Will you be calculating percent
change scores? More information about data analysis can be found in Section E: Analyzing Your Results
and Making Conclusions of the GTO Evaluation Step Appendices.
Data Collection Method
SCCD Survey
Coordinate with ambassador
program
Culture Camp pre & post
test
Analysis
(State level only)
 Thematic Coding


Thematic Coding


Crosstab analyses by region
Compare with state demographic information

Crosstab analyses by region
IPV Prevention Evaluation Plan 2010-2018
Page 5 of 9

Summary of state demographic
information (U.S. Census?)


Crosstab analyses by region
Compare with statewide community survey
ADD PROCESS METHODS
IPV Prevention Evaluation Plan 2010-2018
Page 6 of 9
Reporting
Describe how the evaluation team will report and assure the use of the evaluation findings. The plan
should point out the format (oral, written, visual, etc.), content, and frequency reports. It should also
specify how the findings will be used by the different stakeholders. More information about reporting
can be found in Section F: Sharing Your Evaluation Results of the GTO Evaluation Step Appendices.
Format of reports
Content of reports
Frequency of reports
How reports will be used by stakeholders
Timeline
Outline when your evaluation activities will occur. Each of the components of the evaluation should be
included in the timeline, such as when the data collection will occur, when data analysis will happen,
and when reports or summaries will be written and distributed.
Data Collection
Method
Data Collection
Data
Analysis
Key stakeholder
interviews
Statewide project
surveys (YRBS, CTC, etc.)
BRFSS:
Present new questions in Aug 2011
Questions added Jan 2012
YRBS:
Administered in odd years (2011 is
next one – high school students
only)
Review of meeting
minutes/agreements
Prevention resource
assessment
IPV Prevention Evaluation Plan 2010-2018
Page 7 of 9
Report
Writing
Sharing with
Stakeholders
and/or CQI (if
applicable)
Data needs assessment
Summary of state
demographic
information (U.S.
Census?)
Staffing and Budget
Staffing
Who will be doing what? In other words, describe (via a table or other clear format) who will be
collecting data, entering data, analyzing data, writing reports, sharing findings, etc. This is a general
description, not a detailed timeline. Just describe the main roles that each person will have in the
evaluation.
Data Collection
Method
Key stakeholder
interviews
Statewide project
surveys (YRBS, CTC,
etc.)
Review of meeting
minutes/agreements
Statewide
community survey
Statewide survey of
prevention
practitioners/allies
Summary of state
demographic
information (U.S.
Census?)
Prevention Resource
Assessment
Data prevention
system capacity
assessment
Who Collects
Who Enters
Who Analyzes
Who Shares
Me
You
Me
You
Me
You
Me
You
Him
Her
Him
Her
The empowerment
evaluation team and
the DELTA/SVPE
state coordinators
(you, me and him)
Him
Her
Me
Me
Me
You
Me
IPV Prevention Evaluation Plan 2010-2018
Page 8 of 9
Budget
How much will the evaluation cost? Where will funds come from? How will evaluation activities be
incorporated into the work of current staff?
Data Collection
Method
Estimated Cost
Funding Source
Key stakeholder
interviews
Review of meeting
minutes/agreements
Prevention resource
assessment
Data needs assessment
Summary of state
demographic
information (U.S.
Census?)
Prevention Resource
Assessment
Data prevention
system capacity
assessment
?
DELTA– FY 2011
Have Funds Been
Allocated/Secured?
YES/NO
YES
?
DELTA - FY 2011
YES
$11,000
DELTA - FY 2011
YES
IPV Prevention Evaluation Plan 2010-2018
Page 9 of 9
Download