Graduate Curriculum Committee Course Proposal Form for Courses Numbered 6000 and Higher Note: Before completing this form, please carefully read the accompanying instructions. Submission guidelines are posted to the GCC Web site: http://www.ecu.edu/csacad/gcc/index.cfm 1. Course prefix and number: PADM 6165 2. Date: 10/31/2011 3. Requested action: X New Course Revision of Active Course Revision & Unbanking of a Banked Course Renumbering of an Existing Course from from # to # Required X Elective 4. Method(s) of delivery (check all boxes that apply for both current/proposed and expected future delivery methods within the next three years): Current or Proposed Delivery Method(s): X On-campus (face to face) Expected Future Delivery Method(s): X Distance Course (face to face off campus) X X Online (delivery of 50% or more of the instruction is offered online) 5. Justification (must cite accreditation and/or assessment by the graduate faculty) for new course or course revision or course renumbering: The MPA faculty have assessed the structure of our curriculum to meet the new accreditation standards of our accrediting body, the National Association of Schools of Public Administration and Affairs (NASPAA). As a result of that assessment, the graduate faculty who comprise the MPA Committee have determined the need to introduce a new course on program evaluation and to revise the content of PADM 6161. This change will allow the students focusing on public policy as an area of emphasis to bridge distinct policy content focused courses. The course will help us address the NASPAA required competency of “To analyze, synthesize, think critically, solve problems and make decisions.” The course was then approved by the Graduate Faculty of the Department of Political Science. 1 Revised 04-06-11 and posted fall of 2011 6. Course description exactly as it should appear in the next catalog: PADM 6165. Program Evaluation (3) P: PADM 6101 or consent of instructor. Theory and practice of program evaluation with attention to the conceptualization and design of an evaluation as well as the methods of measurement. 7. If this is a course revision, briefly describe the requested change: Not applicable. 8. Course credit: 3 Lecture Hours Weekly OR Per Term Lab Weekly OR Per Term Studio Weekly OR Per Term Practicum Weekly OR Per Term Internship Weekly OR Per Term Other (e.g., independent study) Please explain. Total Credit Hours Credit Hours Credit Hours Credit Hours Credit Hours Credit Hours 3 s.h. s.h. s.h. s.h. s.h. s.h. s.h. 3 15 9. Anticipated annual student enrollment: 10. Changes in degree hours of your programs: Degree(s)/Program(s) Master of Public Administration Changes in Degree Hours 0 11. Affected degrees or academic programs, other than your programs: Degree(s)/Program(s) Not applicable Changes in Degree Hours Not applicable 12. Overlapping or duplication with affected units or programs: X Not applicable Documentation of notification to the affected academic degree programs is attached. 13. Council for Teacher Education (CTE) approval (for courses affecting teacher education): X Not applicable Applicable and CTE has given their approval. 14. University Service-Learning Committee (USLC) approval: X Not applicable Applicable and USLC has given their approval. 15. Statements of support: a. Staff X Current staff is adequate Additional staff is needed (describe needs in the box below): 2 Revised 04-06-11 and posted fall of 2011 b. Facilities X Current facilities are adequate Additional facilities are needed (describe needs in the box below): c. Library X Initial library resources are adequate Initial resources are needed (in the box below, give a brief explanation and an estimate for the cost of acquisition of required initial resources): d. Unit computer resources X Unit computer resources are adequate Additional unit computer resources are needed (in the box below, give a brief explanation and an estimate for the cost of acquisition): e. ITCS resources X ITCS resources are not needed The following ITCS resources are needed (put a check beside each need): Mainframe computer system Statistical services Network connections Computer lab for students Software Approval from the Director of ITCS attached 16. Course information (see: Graduate Curriculum and Program Development Manual for instructions): a. Textbook(s) and/or readings: author(s), name, publication date, publisher, and city/state/country. Include ISBN (when applicable). Required Ronald D. Sylvia & Elizabeth M. Gunn. 2004. Program Planning and Evaluation for the Public Manager 3rd Edition, Waveland Press, Prospect Heights, IL.; ISBN-13: 9781577663416 Emil J. Posavac. 2010. Program Evaluation: Methods and Case Studies, ed. 5, Prentice Hall Canada; ISBN 13: 978-0205804979 Plus selected readings Recommended Reading Peter H. Rossi, Mark W. Lipsey, and Howard E. Freeman. 2003. Evaluation: A Systematic Approach, 7th edition. Sage Publications: Thousand Oaks, CA.; ISBN 13: 978-0761908944 3 Revised 04-06-11 and posted fall of 2011 b. Course objectives for the course (student – centered, behavioral focus) Upon completion of this course, students will be able to: 1. identify the diverse purposes of program evaluations within a wide range of environments where evaluations are conducted; 2. describe the conceptual issues and primary methods (including both quantitative and qualitative methods) practitioners use to conduct and assess evaluations; 3. employ conceptual and writing skills in constructing evaluation designs by choosing appropriate methods, developing measurable objectives, collecting data, and critiquing other evaluations; 4. model successful program evaluation techniques by conducting an evaluation of a public program. c. Course topic outline 1. Introduction and course overview a. Where evaluation is used and conducted b. History of program evaluation c. Guiding principles 2. Defining and classifying program evaluation theory a. Defining program evaluation b. Use of evaluation in policy and management processes c. Designing evaluations for multiple settings 3. Needs assessment a. State of the field b. Defining need c. Sources of information d. Using a needs assessment 4. Planning an evaluation a. Steps in conducting an evaluation b. Overview of evaluation models c. Writing a researchable question d. Issues and challenges 5. Selecting criteria, setting standards, and ethical concerns a. Goals and objectives b. Evaluation criteria c. Limitations d. Stakeholders e. Ethical paradigms i. Conflicts of interest ii. Participant protections 6. Developing measures a. Sources of data b. Validity c. Types of measures 7. Formative evaluation and program monitoring a. Formative evaluation i. Definition ii. Design 4 Revised 04-06-11 and posted fall of 2011 iii. Compared to summative evaluation iv. Implementation b. Program records i. Information format ii. Accessibility iii. Comparability c. Common problems 8. Outcome evaluation design a. Design b. Internal and external validity c. Single group evaluation d. Descriptive designs 9. Randomized experimental design a. Making observations b. Dependent variables c. Combining designs 10. Quasi-experimental design a. Group comparison b. Evaluating and critiquing research designs c. Data collection issues d. Project management 11. Using experiments to evaluate programs a. Experimentation design and challenges b. Introduction to survey methodology 12. Sampling a. Methodology b. Limitations c. Ethical issues 13. Analysis of costs a. Role of cost benefit and cost effectiveness designs b. Methodology for cost benefit and cost effectiveness c. Comparing outcomes to costs d. Criticisms of cost analyses 14. Qualitative evaluation methods a. Positivism and grounded theory b. Data collection and measurement issues i. Techniques ii. Appropriate measures 15. Encouraging utilization of program evaluations a. Considering your audience b. Engaging stakeholders c. Evaluating results d. Integrating users e. Presenting results d. List of course assignments, weighting of each assignment, and grading/evaluation system for determining a grade 1. Class participation: 20 % a. Weekly assignments (12) including discussion boards, short papers, and presentations b. Attendance 5 Revised 04-06-11 and posted fall of 2011 2. Midterm exam: 20 % 3. Final exam: 20 % 4. Evaluation project: 40 % A=90 to 100 % B=80 to 89 % C=70 to 79 % F=Below70 % 6 Revised 04-06-11 and posted fall of 2011