Diverse Cultures Assessment Summary (AY 2014-15)

advertisement
Student Learning Outcomes for the UCCS Knowledge Areas
Diverse Cultures
Assessment Procedure
To fulfill the “diverse cultures” requirement of the Core of Common Studies, students select one
course from among the 39 listed in the Bulletin. Student learning in diverse cultures was assessed
in 22 courses in 2014-15 1. Items from exams, essays, assignments, presentations,
papers/projects, reflections, journaling, discussion posts, case analysis and multiple choice tests
were used to score students’ level of proficiency in each of the three learning outcomes. A scoring
rubric categorized students as having exceeded, met or developing the outcome. Instructors
were free to define levels of proficiency according to their own standards. Not every course
assessed all three outcomes. In some courses, information was insufficient to determine whether
the student artifact assessed was in fact related to the learning outcome.
Data summaries were received from the following courses:
ADPR 4600
ANTH 1001
EDUC 1210
EDUC 3240
ENGL 4810
ENGL 4825
ENGL 4840
HEAL 1025
HIST 1401
HIST 1501
HIST 4120
INPS 2010
LEOR 3150
MANA 3035
SOCI 3280
SOCI 4400
SOWJ 2150
SPAN 3300
SPAN 3310
THEO 2420
THEO 4020
1 Some
International and Multicultural Advertising and Public Relations
Introductory Anthropology
Introduction to Schooling in a Diverse Society
Critical Inquiry into Contemporary Issues
Race, Ethnicity and Identity in American Literature and Culture
Native American / Indigenous Literatures
Postcolonial Literatures
Culture and Health
Africa
Survey of East Asian Civilization
American Immigration
Introduction to Peace Studies
The Culturally Diverse Organization
Diversity in Organizations
Race and Family
Social Inequality
Immigrants and their Communities
People and Cultures of Spain
Peoples and Cultures of Spanish America
Bridging the Racial Divide (2 sections)
The Bible in the Jewish Community (2 sections)
assessment results were from the previous academic year.
1
Assessment Results
The tables below summarize the assessment results by objective. Results are displayed by course
section and for the objective as a whole.
Overall, students demonstrated similar proficiency in all three objectives. Between 46% - 49%
were rated as having exceeded the standard for the objective, 38% - 40% met, and 11% - 14%
were developing. Students were rated slightly higher on objective 3 (Critically reflect upon one's
personal and cultural presuppositions and how these affect one's values and relationships.) Results
varied greatly by course.
Objective 1: Identify differences and similarities in communication, values, practices
and beliefs between one's own culture and other cultures.
Summary by course and overall
Course
Percent
exceeds
Percent Meets
Percent
Developing
Number of
Students
ADPR 4600
ANTH 1001
EDUC 1210
EDUC 3240
ENGL 4810
ENGL 4825
ENGL 4840
HIST 1401
HIST 1501
HIST 4120
INPS 2010
LEOR 3150
MANA 3035
SOCI 3280
SOCI 4400
SOWJ 2150
SPAN 3300
SPAN 3310
THEO 2420
THEO 4020
22%
59%
69%
79%
22%
30%
31%
94%
63%
0%
70%
47%
35%
34%
32%
39%
28%
25%
86%
32%
49%
30%
31%
21%
59%
65%
38%
6%
37%
100%
20%
41%
57%
45%
53%
42%
61%
59%
12%
39%
30%
11%
0%
0%
19%
5%
31%
0%
0%
0%
10%
12%
8%
21%
16%
19%
11%
16%
1%
29%
37
270
26
19
27
20
13
16
16
7
10
17
60
38
38
31
18
32
37
65
Objective 1 Total
49%
38%
13%
834
2
Objective 2: Explain how categories of human diversity influence personal
identities and can create structural and institutional inequity.
Summary by course and overall
Course
Percent
exceeds
Percent Meets
Percent
Developing
Number of
Students
ADPR 4600
ANTH 1001
EDUC 1210
EDUC 3240
ENGL 4810
ENGL 4825
ENGL 4840
HEAL 1025
HIST 1401
HIST 4120
LEOR 3150
MANA 3035
SOCI 3280
SOCI 4400
SOWJ 2150
SPAN 3310
THEO 2420
THEO 4020
22%
51%
62%
84%
33%
35%
38%
28%
94%
0%
47%
21%
45%
84%
38%
44%
85%
9%
49%
37%
38%
16%
44%
60%
38%
51%
6%
100%
41%
74%
39%
13%
41%
47%
12%
50%
30%
12%
0%
0%
22%
5%
23%
21%
0%
0%
12%
5%
16%
3%
21%
9%
3%
41%
37
270
26
19
27
20
13
80
16
7
17
61
38
38
29
32
37
64
Objective 2 Total
46%
40%
14%
868
3
Objective 3: Critically reflect upon one's personal and cultural presuppositions and
how these affect one's values and relationships
Summary by course and overall
Course
Percent
exceeds
Percent
Meets
Percent
Developing
Number of
Students
ADPR 4600
ANTH 1001
EDUC 1210
EDUC 3240
ENGL 4810
ENGL 4825
ENGL 4840
HIST 1401
HIST 4120
INPS 2010
LEOR 3150
MANA 3035
SOCI 3280
SOCI 4400
SOWJ 2150
SPAN 3310
THEO 2420
THEO 4020
22%
41%
27%
89%
15%
45%
38%
94%
0%
60%
47%
35%
26%
84%
90%
41%
76%
69%
33%
51%
69%
11%
44%
45%
31%
6%
100%
30%
41%
57%
53%
16%
10%
44%
20%
25%
44%
8%
4%
0%
41%
10%
31%
0%
0%
10%
12%
8%
21%
0%
0%
16%
4%
6%
36
270
26
19
27
20
13
16
7
10
17
60
38
38
31
32
37
64
Objective 3
Total
49%
40%
11%
798
4
Best practice examples:
HEAL 1025 used multiple measures across multiple sections, randomly selected assignments to
assess, trained doctoral students as raters, computed inter-rater reliabilities, and included
exemplars of essays and discussion posts at each proficiency level.
THEO 2420 used a detailed analytic rubric with 7 exam questions directly related to the diverse
cultures learning outcomes. Student point ratings were converted to proficiency levels for the
assessment.
The English department enlisted faculty members not associated with the assessed courses to
evaluate student work, thereby separating the assessment process from grading.
Conclusions and Recommendations
Most concluded that the courses were successful in meeting diverse cultures learning outcomes.
Course topics vary significantly in this knowledge area, and could be expected to address some
learning outcomes more comprehensively than others. Some measures worked better than
others to assess learning.
Most were able to identify several ways to improve the course (e.g., provide more examples and
opportunities for practice, review service learning placements, provide a written study guide,
design a longer case study, provide opportunities for formative feedback earlier in the course, find
ways to generate more interactive discussion, devote time to academic writing and research,
increase variety of pedagogical approaches, incorporate reflection papers or exercises.) In the
department of Social and Cultural Sciences, faculty planned to meet to discuss curricular strategies
that could be adopted.
Some participants in this process suggested that the diverse cultures learning outcomes be
revised. The language for learning outcome #3 was seen as particularly problematic. Increasing
the diverse cultures requirement to two classes, one focused on global perspectives and one on
national perspectives, was recommended to better address diversity. Future assessments should
strive to attain a more precise match between outcomes to be measured and assessment
instruments, and should strengthen reliability by ensuring that norming sessions are conducted
prior to assessment. Class size and teaching support must be considered when deciding what
types of assessments are feasible. Consider adopting a standardized rubric across courses and
types of assessments.
Use of Assessment Results
On 1/27/16, the CCRC voted to accept the report on the diverse cultures knowledge area
assessment. Members met the following recommendations:
5
1. To encourage instructors or units overseeing assessment to more
consistently match outcomes to instruments that can meaningfully
measure student proficiency.
2. To encourage instructors or units to follow the best practice of
having norming sessions in advance of assessing student work to
improve reliability.
3. To encourage instructors or units to develop in advance of
assessment rubrics for measurement.
Members noted that these best practices were followed in some but not all instances, and that
regularizing these practices could make the results more meaningful.
6
Download