ANNUAL PROGRAM ASSESSMENT REPORT 2007-2008

advertisement
ANNUAL PROGRAM ASSESSMENT REPORT
2007-2008
Department: Political Science
Program: BA and BS
Person Completing the Report: Gibbs Knotts
Assessment Plan
Mission Statement:
The Department of Political Science and Public Affairs is located in the College of Arts and Sciences at
Western Carolina University. The department seeks to create a teaching and learning community in
which students develop the attitudes, knowledge, and skills required for responsible and effective
participation in society. Its primary purpose is to prepare students to function in a broad range of
professional fields and activities by providing high quality instruction in political science, pre-law, and
public affairs. The department offers an undergraduate major in Political Science. It has minors in
Political Science and International Studies. It also offers the Master of Public Affairs (MPA) degree for
full-time as well as in-service administrative officials. We also seek to prepare students for further
learning through general education and to provide an atmosphere where students and faculty can pursue
scholarly activity and service to the region, state, nation, and world.
Program Outcome Objectives:
Political Science students should be able to:
1. Demonstrate knowledge of national, state, and local political institutions and an understanding of
intergovernmental relations.
2. Demonstrate knowledge of Public Administration and the public policy process and be able to
identify and discuss the significance of those forces in the national, state, and local levels of
government that seek to influence public policy decisions.
3. Identify and analyze contemporary domestic and foreign policy issues and problems that demand
and warrant the attention of American policy makers.
4. Demonstrate knowledge of the structures and processes of international institutions and an
understanding of international relations.
5. Demonstrate knowledge of the writings of those thinkers whose works have contributed
significantly to the field of Contemporary Political Philosophy.
6. Demonstrate an understanding of multiculturalism and the role it plays in contemporary politics.
7. Demonstrate an understanding of data interpretation.
1
Student Learning
Outcome(s) Assessed
in 2007-08
Objective 1:
Demonstrate knowledge
of national, state, and
local political
institutions and an
understanding of
intergovernmental
relations.
Method(s) of
Assessment
A) Pre-post tests for the
following courses:
150 American
Government and
Politics; 190 Active
Citizenship; 260
Judicial Process; 303
State and Local
Government; 305
Congress; 306
Presidency; 310
Constitutional Law;
407 American
Political Parties.
B) Exit interviews with
graduating seniors.
C) Senior Portfolio.




Results of
Implementation
Assessment
Plan
Continued
 Discuss learning
improvements.
outcomes with
faculty during Fall
Seniors felt these
2008. Prepare a
courses established
handbook for new
the groundwork for
faculty setting out
the major.
departmental
Students frequently
expectations for
identified courses in
our Liberal Studies
this category as
courses.
reasons for them
choosing this major.
Results will be
distributed via email
to all departmental
members in the
form of this
Assessment Report.
We continued to show improvements between the pre-test and post-test in the liberal studies courses. For
Fall 2007, 6 of 7 courses showed improvement in PSC 150 and 4 of 4 courses showed improvements in
PSC 190. During the Spring 2008, all 5 PSC 150 classes showed improvements. Two important points
should be emphasized however. First, there is a lot of variation among levels of improvement in liberal
studies courses. Second, there is generally less improvement in liberal studies courses than in upper level
classes. PSC 150 and PSC 190 courses averaged about 7 percentage points of improvement. The upper
division courses mentioned above showed an average of 16 percentage points of improvement per class.
Senior Portfolios mentioned several courses within this Objective that sparked their interest in Political
Science. PSC 190 was mentioned as an important class in achieving our first learning objective.
2
Student Learning
Outcome(s) Assessed in
2007-08
Objective 2:
Demonstrate knowledge
of Public Administration
and the public policy
process and be able to
identify and discuss the
significance of those
forces in the national,
state, and local levels of
government that seek to
influence public policy
decisions.
Method(s) of
Assessment
A) Pre-post tests on
the following
courses: 302
Problems and
Policies in
American Politics;
304 Public
Administration
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.
Results of
Implementation
Assessment
Plan
 Improvements over  Consider sources
the previous year
of lower results.
but lower than
 Design and test
average for upper
new questions that
level courses.
can allow us to
 Some students
measure the
mentioned the PSC
degree of learning
304 course in their
of the policy
personal statements.
making processes.
 Results will be
distributed via email
to all departmental
members in the
form of this
Assessment Report.
The assessment results for PSC 304 showed improvement from the previous year. There was a 9
percentage point improvement between the pre test and the post test. We recently hired an additional
public administration scholar and we will work with him to analyze this learning outcome and develop
strategies for improvement.
3
Student Learning
Outcome(s) Assessed in
2007-08
Objective 3:
Identify and analyze
contemporary domestic
and foreign policy issues
and problems that demand
and warrant the attention
of American policy
makers.
Method(s) of
Assessment
A) Pre-post tests on
the following
course: 334 US
Foreign Policy.
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.
Results of
Implementation
Assessment
Plan
 Tests showed very
 No action
strong
improvement.
 Seniors attached
some significance to
understanding the
role of the US in the
world.
 Results will be
distributed via email
to all departmental
members in the
form of this
Assessment Report.
These courses are electives within the major and thus should indicate strong learning outcomes.
Fortunately, the data confirmed this expectation. Students in the PSC 334 course showed considerable
improvement during the Spring 2008 semester. The average improvement for this course was 27
percentage points.
Student Learning
Outcome(s) Assessed in
2007-08
Objective 4:
Demonstrate knowledge
of the structures and
processes of international
institutions and an
understanding of
international relations.
Method(s) of
Assessment
A) Pre-post tests on
the following
courses: 110 Global
Issues; 215
European Political
Systems; 216
Politics of
Developing Areas;
219 Latin
American Politics;
241 International
Politics; 317 East
Asian Politics; 436
Dynamics of World
Order.
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.
4




Results of
Implementation
Assessment
Plan
Tests showed strong  Discuss learning
improvement.
outcomes with
faculty during Fall
Seniors frequently
2008. Prepare a
mentioned the
handbook for new
significance of
faculty setting out
gaining an
departmental
international
expectations for
perspective.
our Liberal Studies
Seniors frequently
courses.
mentioned an
ongoing interest in
international issues
and perhaps careers.
Results will be
distributed via email
to all departmental
members in the
form of this
Assessment Report.
As the case with Objective 1, students generally performed better in upper division courses than in the
liberal studies classes. In Fall 2007, students in PSC 110 improved by an average of 6 percentage points.
During the Spring 2008 semester, students in PSC 110 improved by nearly 11 percentage points. Similar
to other liberal studies courses, there is considerable variation in learning outcomes. Improvement rates
during the Fall ranged from a -12 to 26. In the Spring they ranged from -4 to 28. Students in PSC 216
showed a very high level of improvement at 16 percentage points and students in PSC 219 improved by
an average of 14 percentage points. In the PSC 241 course the level of improvement was 13 points and
improvement in the PSC 317 course was an impressive 25 points.
Student Learning
Outcome(s) Assessed in
2007-08
Objective 5:
Demonstrate knowledge
of the writings of those
thinkers whose works
have contributed
significantly to the field of
Contemporary Political
Philosophy.
Method(s) of
Assessment
A) Pre-post tests on
the following
course: 346
Modern Political
Thought.
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.




Results of
Implementation
Assessment
Plan
Strong test results
 Consider
Several seniors
feasibility in terms
identified the course
of staffing and
as central.
developing a new
Several Personal
course to serve as
Statements referred
an alternative to
to learning the
the one course in
importance of
this category:
theory.
American Political
Results will be
Thought.
distributed via email  Decision by Fall
to all departmental
2008.
members in the
form of this
Assessment Report.
This course is a requirement within the major. Consequently, its scores were expected to be strong.
These expectations were met, with students on average improving by 27 percentage points, up from 24
percentage points the previous year.
5
Student Learning
Outcome(s) Assessed in
2007-08
Objective 6:
Demonstrate an understanding of multiculturalism and the role it
plays in contemporary
politics.
Method(s) of
Assessment
A) Pre-post tests on
the following
course: 351 Gender
in Politics
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.




Results of
Implementation
Assessment
Plan
Strong test results.
 Encourage the
Students rarely
development of
mentioned the
another course that
significance of this
would fall into this
category.
category. Among
Personal statements
the suggestions is
did indicate apprea course on racial
ciation of this.
relations.
Results will be
 Decision by Fall
distributed via email
2008.
to all departmental
members in the
form of this
Assessment Report.
This course is an elective within the major. Improvements are expected to be high. These expectations
were well-met. Students on average improved their score by 27 percentage points, an increase of 8 points
from the previous year.
Student Learning
Outcome(s) Assessed in
2007-08
Objective 7:
Demonstrate an understanding of data
interpretation.
Method(s) of
Assessment
A) Pre-post tests on
the following
course: 348
Political Analysis
B) Exit interviews
with graduating
seniors.
C) Senior Portfolio.




Results of
Implementation
Assessment
Plan
Strong test results.
 Consider the
Several seniors
advantages and
mentioned the
disadvantages of
significance of this
requiring this
course and some
course for our BA
suggested that it be
students as well as
required for all
BS students.
majors.
 Decision by Fall
Personal statements
2008.
sometimes
addressed the
significance of these
skills.
Results will be
distributed via email
to all departmental
members in the
form of this
Assessment Report.
This course was taught each semester and is a requirement for our BS students. Expectations for
improved scores were high. During the Fall semester, students improved scores by an average of 38
points and during the Spring semester scores improved by an average of 13 points.
6
Additional Comments:
Pre-Post Test
The gap between improvements in liberal studies courses and major courses continued in 2007-2008. Our
faculty will discuss these results and develop a strategy for addressing this issue during the Fall 2008
semester. This should be part of a larger discussion about the role of liberal studies courses in the
department. We need to consider the appropriate class size and the right mix of full-time and part-time
instructors. The UNC Tomorrow report and the QEP present a particularly good opportunity for this
discussion. Of course, this discussion will also involve a review of the questions that are being asked on
the pre-post tests. With different liberal studies instructors, it is possible that teaching styles and
approaches may be contributing to the variation at this level.
Exit Interviews
Most students praised the enthusiasm of the political science and public affairs professors. They also
talked about the emphasis on writing and indicated an improvement in their own writing abilities. They
also expressed satisfaction with their academic advising. Some students indicated an interest for
additional law courses. Our two law courses (PSC 260 and PSC 310) will now be offered annually. We
will also discuss the possibility of additional courses with the pre-law advisor.
It was difficult to get students to schedule and complete exit interviews. To ensure a higher response rate,
the department will consider exit interviews during the portfolio course. The biggest disadvantage with
this change is that students would still have one additional semester in residence after completing the exit
interview.
Portfolios
Students identified specific courses that had an impact on their thinking and on their decision to major in
Political Science. Among these are: Active Citizenship; Modern Political Thought; Political Analysis;
and assorted courses in American politics.
During the Spring 2008 semester, the portfolio class had very little formal structure. The department head
met with each student and worked one-on-one on the portfolio. For Fall 2008, the portfolio class will
meet weekly with the department head. This format will provide a number of areas for improved
assessment. In addition to the exit interviews mentioned above, a focus group emphasizing student
learning outcomes is being considered during the portfolio class meetings. The department might also
consider assessment during PSC 250, Introduction to Political Science. This course is required for all
majors and is usually taken by freshmen and sophomores. The course would provide a good opportunity
to develop a baseline for student learning outcomes.
7
Download