ANNUAL PROGRAM ASSESSMENT REPORT 2007-2008 Department: Political Science Program: BA and BS Person Completing the Report: Gibbs Knotts Assessment Plan Mission Statement: The Department of Political Science and Public Affairs is located in the College of Arts and Sciences at Western Carolina University. The department seeks to create a teaching and learning community in which students develop the attitudes, knowledge, and skills required for responsible and effective participation in society. Its primary purpose is to prepare students to function in a broad range of professional fields and activities by providing high quality instruction in political science, pre-law, and public affairs. The department offers an undergraduate major in Political Science. It has minors in Political Science and International Studies. It also offers the Master of Public Affairs (MPA) degree for full-time as well as in-service administrative officials. We also seek to prepare students for further learning through general education and to provide an atmosphere where students and faculty can pursue scholarly activity and service to the region, state, nation, and world. Program Outcome Objectives: Political Science students should be able to: 1. Demonstrate knowledge of national, state, and local political institutions and an understanding of intergovernmental relations. 2. Demonstrate knowledge of Public Administration and the public policy process and be able to identify and discuss the significance of those forces in the national, state, and local levels of government that seek to influence public policy decisions. 3. Identify and analyze contemporary domestic and foreign policy issues and problems that demand and warrant the attention of American policy makers. 4. Demonstrate knowledge of the structures and processes of international institutions and an understanding of international relations. 5. Demonstrate knowledge of the writings of those thinkers whose works have contributed significantly to the field of Contemporary Political Philosophy. 6. Demonstrate an understanding of multiculturalism and the role it plays in contemporary politics. 7. Demonstrate an understanding of data interpretation. 1 Student Learning Outcome(s) Assessed in 2007-08 Objective 1: Demonstrate knowledge of national, state, and local political institutions and an understanding of intergovernmental relations. Method(s) of Assessment A) Pre-post tests for the following courses: 150 American Government and Politics; 190 Active Citizenship; 260 Judicial Process; 303 State and Local Government; 305 Congress; 306 Presidency; 310 Constitutional Law; 407 American Political Parties. B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Continued Discuss learning improvements. outcomes with faculty during Fall Seniors felt these 2008. Prepare a courses established handbook for new the groundwork for faculty setting out the major. departmental Students frequently expectations for identified courses in our Liberal Studies this category as courses. reasons for them choosing this major. Results will be distributed via email to all departmental members in the form of this Assessment Report. We continued to show improvements between the pre-test and post-test in the liberal studies courses. For Fall 2007, 6 of 7 courses showed improvement in PSC 150 and 4 of 4 courses showed improvements in PSC 190. During the Spring 2008, all 5 PSC 150 classes showed improvements. Two important points should be emphasized however. First, there is a lot of variation among levels of improvement in liberal studies courses. Second, there is generally less improvement in liberal studies courses than in upper level classes. PSC 150 and PSC 190 courses averaged about 7 percentage points of improvement. The upper division courses mentioned above showed an average of 16 percentage points of improvement per class. Senior Portfolios mentioned several courses within this Objective that sparked their interest in Political Science. PSC 190 was mentioned as an important class in achieving our first learning objective. 2 Student Learning Outcome(s) Assessed in 2007-08 Objective 2: Demonstrate knowledge of Public Administration and the public policy process and be able to identify and discuss the significance of those forces in the national, state, and local levels of government that seek to influence public policy decisions. Method(s) of Assessment A) Pre-post tests on the following courses: 302 Problems and Policies in American Politics; 304 Public Administration B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Improvements over Consider sources the previous year of lower results. but lower than Design and test average for upper new questions that level courses. can allow us to Some students measure the mentioned the PSC degree of learning 304 course in their of the policy personal statements. making processes. Results will be distributed via email to all departmental members in the form of this Assessment Report. The assessment results for PSC 304 showed improvement from the previous year. There was a 9 percentage point improvement between the pre test and the post test. We recently hired an additional public administration scholar and we will work with him to analyze this learning outcome and develop strategies for improvement. 3 Student Learning Outcome(s) Assessed in 2007-08 Objective 3: Identify and analyze contemporary domestic and foreign policy issues and problems that demand and warrant the attention of American policy makers. Method(s) of Assessment A) Pre-post tests on the following course: 334 US Foreign Policy. B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Tests showed very No action strong improvement. Seniors attached some significance to understanding the role of the US in the world. Results will be distributed via email to all departmental members in the form of this Assessment Report. These courses are electives within the major and thus should indicate strong learning outcomes. Fortunately, the data confirmed this expectation. Students in the PSC 334 course showed considerable improvement during the Spring 2008 semester. The average improvement for this course was 27 percentage points. Student Learning Outcome(s) Assessed in 2007-08 Objective 4: Demonstrate knowledge of the structures and processes of international institutions and an understanding of international relations. Method(s) of Assessment A) Pre-post tests on the following courses: 110 Global Issues; 215 European Political Systems; 216 Politics of Developing Areas; 219 Latin American Politics; 241 International Politics; 317 East Asian Politics; 436 Dynamics of World Order. B) Exit interviews with graduating seniors. C) Senior Portfolio. 4 Results of Implementation Assessment Plan Tests showed strong Discuss learning improvement. outcomes with faculty during Fall Seniors frequently 2008. Prepare a mentioned the handbook for new significance of faculty setting out gaining an departmental international expectations for perspective. our Liberal Studies Seniors frequently courses. mentioned an ongoing interest in international issues and perhaps careers. Results will be distributed via email to all departmental members in the form of this Assessment Report. As the case with Objective 1, students generally performed better in upper division courses than in the liberal studies classes. In Fall 2007, students in PSC 110 improved by an average of 6 percentage points. During the Spring 2008 semester, students in PSC 110 improved by nearly 11 percentage points. Similar to other liberal studies courses, there is considerable variation in learning outcomes. Improvement rates during the Fall ranged from a -12 to 26. In the Spring they ranged from -4 to 28. Students in PSC 216 showed a very high level of improvement at 16 percentage points and students in PSC 219 improved by an average of 14 percentage points. In the PSC 241 course the level of improvement was 13 points and improvement in the PSC 317 course was an impressive 25 points. Student Learning Outcome(s) Assessed in 2007-08 Objective 5: Demonstrate knowledge of the writings of those thinkers whose works have contributed significantly to the field of Contemporary Political Philosophy. Method(s) of Assessment A) Pre-post tests on the following course: 346 Modern Political Thought. B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Strong test results Consider Several seniors feasibility in terms identified the course of staffing and as central. developing a new Several Personal course to serve as Statements referred an alternative to to learning the the one course in importance of this category: theory. American Political Results will be Thought. distributed via email Decision by Fall to all departmental 2008. members in the form of this Assessment Report. This course is a requirement within the major. Consequently, its scores were expected to be strong. These expectations were met, with students on average improving by 27 percentage points, up from 24 percentage points the previous year. 5 Student Learning Outcome(s) Assessed in 2007-08 Objective 6: Demonstrate an understanding of multiculturalism and the role it plays in contemporary politics. Method(s) of Assessment A) Pre-post tests on the following course: 351 Gender in Politics B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Strong test results. Encourage the Students rarely development of mentioned the another course that significance of this would fall into this category. category. Among Personal statements the suggestions is did indicate apprea course on racial ciation of this. relations. Results will be Decision by Fall distributed via email 2008. to all departmental members in the form of this Assessment Report. This course is an elective within the major. Improvements are expected to be high. These expectations were well-met. Students on average improved their score by 27 percentage points, an increase of 8 points from the previous year. Student Learning Outcome(s) Assessed in 2007-08 Objective 7: Demonstrate an understanding of data interpretation. Method(s) of Assessment A) Pre-post tests on the following course: 348 Political Analysis B) Exit interviews with graduating seniors. C) Senior Portfolio. Results of Implementation Assessment Plan Strong test results. Consider the Several seniors advantages and mentioned the disadvantages of significance of this requiring this course and some course for our BA suggested that it be students as well as required for all BS students. majors. Decision by Fall Personal statements 2008. sometimes addressed the significance of these skills. Results will be distributed via email to all departmental members in the form of this Assessment Report. This course was taught each semester and is a requirement for our BS students. Expectations for improved scores were high. During the Fall semester, students improved scores by an average of 38 points and during the Spring semester scores improved by an average of 13 points. 6 Additional Comments: Pre-Post Test The gap between improvements in liberal studies courses and major courses continued in 2007-2008. Our faculty will discuss these results and develop a strategy for addressing this issue during the Fall 2008 semester. This should be part of a larger discussion about the role of liberal studies courses in the department. We need to consider the appropriate class size and the right mix of full-time and part-time instructors. The UNC Tomorrow report and the QEP present a particularly good opportunity for this discussion. Of course, this discussion will also involve a review of the questions that are being asked on the pre-post tests. With different liberal studies instructors, it is possible that teaching styles and approaches may be contributing to the variation at this level. Exit Interviews Most students praised the enthusiasm of the political science and public affairs professors. They also talked about the emphasis on writing and indicated an improvement in their own writing abilities. They also expressed satisfaction with their academic advising. Some students indicated an interest for additional law courses. Our two law courses (PSC 260 and PSC 310) will now be offered annually. We will also discuss the possibility of additional courses with the pre-law advisor. It was difficult to get students to schedule and complete exit interviews. To ensure a higher response rate, the department will consider exit interviews during the portfolio course. The biggest disadvantage with this change is that students would still have one additional semester in residence after completing the exit interview. Portfolios Students identified specific courses that had an impact on their thinking and on their decision to major in Political Science. Among these are: Active Citizenship; Modern Political Thought; Political Analysis; and assorted courses in American politics. During the Spring 2008 semester, the portfolio class had very little formal structure. The department head met with each student and worked one-on-one on the portfolio. For Fall 2008, the portfolio class will meet weekly with the department head. This format will provide a number of areas for improved assessment. In addition to the exit interviews mentioned above, a focus group emphasizing student learning outcomes is being considered during the portfolio class meetings. The department might also consider assessment during PSC 250, Introduction to Political Science. This course is required for all majors and is usually taken by freshmen and sophomores. The course would provide a good opportunity to develop a baseline for student learning outcomes. 7