SOSC-03 - Motlow State Community College

advertisement
Page 1 of 3
Motlow State Community College
Action Plan & Outcome Assessment Report for Institutional Effectiveness
Planning Year: July 1, 2013 – June 30, 2014
Assessing Year: July 1, 2012 – June 30, 2013
Unit: Social Sciences
Related Strategic Goal:
3.1 Monitor and improve the effectiveness of educational programs and services.
Action Plan #: SOSC-03
Action Plan Title: Evaluation of General Education Assessment Tool
Desired Outcome: The Department of Social Science will select the optimal method(s) for each social
science course in the general education assessment cycle and begin preparing the needed instruments
for fall 2012 implementation.
Description of Action Plan and Related Activities:
Currently, the Department of Social Science uses the following assessment methods for its general
education courses.
SOCIAL SCIENCE
GENERAL EDUCATION CORE COURSE
CURRENT ASSESSMENT
METHOD
1.
ANTH 2010 Introduction to Anthropology
2.
GEOG 1030 Cultural Geography
3.
GEOG 2010 World Geography
4.
HIST 1110 Survey of World Civilization I
5.
HIST 1120 Survey of World Civilization II
6.
HIST 2010 Survey of American History I
Pre-Test/Post-Test
7.
HIST 2020 Survey of American History II
Pre-Test/Post-Test
8.
HIST 2030 Tennessee History
9.
POLS 1030 American Government
Embedded Assessment
10. POLS 2010 State and Local Government
Embedded Assessment
11. PSYC 1030 General Psychology
Pre-Test/Post-Test
Pre-Test/Post-Test
Pre-Test/Post Test
Page 2 of 3
12. SOCI 1010 Introduction to Sociology
Pre-Test/Post-Test
13. SOCI 1020 Social Problems
Pre-Test/Post-Test
Despite the logistical advantages of online Pre-Test/Post-Test assessment, post-test scores occasionally
reflect a reduction on students successfully meeting the benchmark of 70% pass rate on the post-test.
The Department of Social Science will research the best practices for assessing social science general
education courses among TBR community colleges. The department will select the optimal method(s)
for each social science course in the general education assessment cycle and begin preparing the
needed assessment instruments for general education courses to be taught in fall 2012.
Team Members: Department chair and faculty
Timeline: June 30, 2013
Est. Cost: $0
Budgeted: Included in current budget
Evidence of Success: The Department of Social Science will have determined the optimal method(s) for
each social science course in the general education assessment cycle will have made initial steps toward
preparing the needed assessment instruments needed for fall 2012 GE assessments.
Complete the following when assessing a plan
Current Status: Completed
Describe Progress: General Education assessment for HIST 2010 and SOCI 1010 is complete. Using an
embedded assessment methodology, 26 sections of HIST 2010 were assessed with the following results
obtained. Each SLO was achieved at the specified effectiveness standard of 70%.
Using pre-test/post-test assessment methodology, 14 sections of SOCI 1010 Introduction to Sociology
taught by two full-time and four part-time instructors participated in the assessment via online
administration. Evidently, the version of the pre-test/post-test used online had only 11 questions. That
would indicate that one question used to assess SLO 6 (question 12) and both questions (13 and 14)
used to assess SLO 7 were omitted for some reason. Based on the results, SLOs 1, 2, and 3 were
achieved at the specified effectiveness standard while SLOS 4, 5, and 6 were not. SLO 7 evidently was
not assessed. Generally there were fewer students completing the post-test as compared with the pretest. Questions 10 and 11 actually showed a decline in percent correct from pre-test to post-test.
Describe Needed Changes:
No changes necessary for HIST 2010.
Changes are needed for SOCI 1010. These results were examined and discussed by the full-time
sociology faculty. One faculty member thought that the SLOs were too narrow and should focus on
larger sociological concepts. The wording of the questions was considered to be narrow and confusing
by one faculty member and questions on important topics such as conflict theory and symbolic
Page 3 of 3
interaction were omitted. The faculty did not consider the course content or the teaching
methodologies as responsible for the poor results. It was the consensus of opinion among the faculty
that the results were severely confounded by methodological problems associated with student
compliance with the pre-test/post-test approach. These included relying on students to voluntarily
complete the pre-test/post-test online outside of class and ensuring that every student who completed
a pre-test also completed a post-test. Another factor discussed was that because the score on both the
pre and post-test had no bearing on the student’s actual grade, many students may not have felt that
answering the questions correctly was important to their actual grade. While the online pre-post-test
method offers some advantages, its validity and reliability is suspect.
The following recommendations were made:
1. The full-time sociology faculty should meet to revisit the articulation of the student learning
outcomes and conduct a redesign of assessment questions and methodology for this course.
Specifically, switching to an embedded assessment approach was recommended.
List of Supporting Documentation:

GE Use of Assessment Results for Fall 2012 – shown in body
Date Last Updated: August 22, 2013
Download