Unit 2: Developing an evaluation plan University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation An evaluation plan is your roadmap University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Core steps in program evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Planning… “The more attention you give to planning the evaluation, the more effective it will be.” −The Program Manager’s Guide to Evaluation, 2003 Source: Administration on Children, Youth and Families. (2003). What is program evaluation? In The program manager’s guide to evaluation (Chapter 2). Washington , D.C.: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. Retrieved on October 15, 2007, from http://www.acf.hhs.gov/programs/opre/other_resrch/pm_guide_eval/reports/pmguide/chapter_2_pmguide.html University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Regardless of the particular format, evaluation planning includes the following key steps: University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 1 Engaging stakeholders Who should be involved in helping to define and implement the evaluation? University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 2 Focusing the evaluation What do you want to know? • What is the purpose of your evaluation? • Who will use the information? How will they use it? • What questions will the evaluation seek to answer? University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 3 Collecting information How will you collect the information? • From whom • Methods of data collection University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 4 Analyzing and interpreting What sense do you make of the information collected? University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 5 Using the information How will you report, use, and learn from the findings? University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Management plan • • • • Human subjects protection Timeline Responsibilities Budget University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Our plan for human subjects protection • • • • Actions we will take Who is responsible By when Resources needed University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Culturally competent evaluation What does it mean to be culturally competent when evaluating outcomes? If you say that you are a culturally competent evaluator, what knowledge or skills should you possess? Why should you care about culture? University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Evaluation standards Utility • Serves information needs of intended users Feasibility • Realistic, prudent, diplomatic, frugal Propriety • Legal, ethical, due regard to welfare Accuracy • Reveals and conveys technically accurate information University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Guiding principles for evaluators • • • • • Systematic inquiry Competence Integrity/honesty Respect for people Responsibilities for general and public welfare University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation