January 2014 - University of Missouri

advertisement
Assessment of
Civic Engagement
Nathan Lindsay and Dan Stroud
University of Missouri-Kansas City
January 17, 2014
Students in my department have an appropriate degree of
civic engagement in their coursework.
lic
ap
p
N
ot
ly
tr
on
g
S
0%
ab
le
ag
...
0%
di
s
is
a
gr
ee
0%
D
re
e
ag
A
0%
...
0%
gr
ee
0%
ei
th
er
6.
N
5.
ag
re
e
4.
ly
3.
tr
on
g
2.
Strongly agree
Agree
Neither agree nor
disagree
Disagree
Strongly disagree
Not applicable
S
1.
Our department has done a good job of documenting the
benefits and learning that occurs through civic engagement.
lic
ap
p
N
ot
ly
tr
on
g
S
0%
ab
le
ag
...
0%
di
s
is
a
gr
ee
0%
D
re
e
ag
A
0%
...
0%
gr
ee
0%
ei
th
er
6.
N
5.
ag
re
e
4.
ly
3.
tr
on
g
2.
Strongly agree
Agree
Neither agree nor
disagree
Disagree
Strongly disagree
Not applicable
S
1.
Quick Fact #1
More than 70 percent of all college students
report participating in some form of
volunteering, community service, or service
learning during their time in college.
(Source: National Task Force on Civic Learning and Democratic Engagement. 2012. A
Crucible Moment: College Learning & Democracy’s Future. Washington, DC: Association
of American Colleges and Universities.)
Quick Fact #2
About one-half of college students report
participating in credit-bearing service
learning activities during their time in
college.
(Source: National Survey of Student Engagement. 2010. NSSE 2010 Grand Frequencies by
Major, First-Year Students and Seniors. Bloomington, IN: Indiana University Center for
Postsecondary Research; Data from the Higher Education Research Institute cited in
O’Neill, Nancy. Forthcoming. Practices that Matter: Educating Students for Personal and
Social Responsibility. Washington, DC: Association of American Colleges and
Universities.)
Quick Fact #3
Emerging evidence suggests that the more
frequently students participate in a continuum of
civic learning practices (e.g. service learning,
meaningful cross-racial interactions on campus
or in classrooms, or real-world problem-based
learning), the more they make gains on a variety
of civic outcomes.
(Sources: Blaich, C. and Wise, K. 2011. “Wabash National Study findings on Personal and Social Responsibility.” Unpublished data provided by
the Wabash National Study of Liberal Arts Education; Bowen, Glenn. 2010. “Service-Learning in the Scholarship of Teaching and Learning:
Effective Practices.” International Journal for the Scholarship of Teaching and Learning. 4(2): 1-15; Eyler, Janet S., Giles, Dwight E., Stenson,
Christine M., Gray, Charlene J. 2001. At a Glance: What We Know about The Effects of Service-Learning on College Students, Faculty,
Institutions and Communities, 1993-2000: Third Edition. Retrieved 10/12/10 from http://www.compact.org/wp
content/uploads/resources/downloads/aag.pdf); Hurtado, Sylvia and DeAngelo, Linda. Forthcoming 2012. “Linking Diversity and Civic-Minded
Practices with Student Outcomes: New Evidence from CIRP National Surveys.” Liberal Education. 98 (2).)
Civic and Community Engagement
–UMKC Gen Ed Outcomes
 Students will be able to identify the problems, challenges,




and opportunities of an urban university.
Students will understand their relationship to both a local
and global community and the social, political, and cultural
issues therein.
Students will develop an appreciation for the meaning and
global impact of urbanization.
Students will have an understanding of the U.S. and
Missouri Constitutions and their impact on issues facing
these various communities.
Students will engage with the UMKC community of
learners.
Examples of High Impact Experiences

Anchor III Courses (Team-taught interdisciplinary courses focused
on civic engagement).

Service Learning (Service learning is a teaching method that
combines community service with academic instruction as it focuses
on critical, reflective thinking and civic responsibility).

Study Abroad (Study abroad consists of educational activities
completed outside of the United States—these activities can include
classroom study, research, internships or externships, and service
learning).

Internships (An internship is an opportunity to integrate career related
experience into an undergraduate education by participating in
planned, supervised work).

Other???
Enhancing High-Impact Practices
What data do you have in your department on the
following high-impact practices?
What recommendations do you have for collecting data
(at the departmental and institutional levels)?

Service Learning

Internships

Study Abroad

Other?
Carnegie Community Engagement
Classification
 Describes collaboration between institutions of higher
education and their larger communities on local,
state, national and global levels.
 Is an elective classification based on voluntary
participation by an institution.
 Evidenced based documentation of institutional
practice to be used in a process of self-assessment
and quality improvement.
 Takes place on a five year cycle.
Liberal Education and
America’s Promise (LEAP)
 First established in 2005, the program champions an
importance placed upon a 21st century liberal education
offered to individuals with the hope of greater economic
creativity and a more relevant and driven democratic
society.
 Responds to demands for more college educated workers
as well as better informed and engaged citizens.
Liberal Education and
America’s Promise (LEAP)
What Program Promotes
 Essential Learning Outcomes
- used
as a guiding vision for college learning
 High-Impact Educational Practices
- aids students in achievement of elevated outcomes
 Authentic Assessments
- applies student learning to outside real world
expectations
 Inclusive Excellence
- everyone should receive engaged and practical
education
Possibilities for Assessment
 Student self-reflection (evaluated by a rubric
that addresses the course’s civic education
learning outcomes)
 Student essay (also evaluated by a rubric)
 Exam on civic engagement principles
 Focus group or survey asking students about
the learning outcomes
 Evaluation from the community partners
AAC&U Civic Engagement
Value Rubric
Definition
 Civic engagement is “working to make a difference in the
civic life of our communities and developing the combination
of knowledge, skills, values, and motivation to make that
difference.”
 “It means promoting the quality of life in a community,
through both political and non-political processes." (Excerpted
from Civic Responsibility and Higher Education, edited by Thomas Ehrlich, published
by Oryx Press, 2000, Preface, page vi.)
 Consists of activities of personal and public concern that are
both individually life enriching and socially beneficial to the
community.
Civic Engagement Value Rubric
General Education Assessment Report —
(due October 1st each year)
Example from Pol-Sci 309: Public Opinion
Expected General Education Outcomes
 Students will analyze, interpret and/or reconstruct human
events, experiences, actions, and interactions.
 Students will examine principles of value and civic duty in
a wide range of settings and will demonstrate an
understanding of personal values and the values of others.
 Students will be able to identify ethical problems using
their understanding of ethical theory and moral reasoning.
General Education Assessment Report
Pol-Sci 309: Public Opinion
How will outcomes be addressed?
 Through exposure to factors such as values, media, socialization, and
those of genetic consequence.
 Through lectures, scholarly research, and discussion, students will
evaluate the existence and prevalence of a deep division in American
Politics.
How will outcomes be assessed?
 Direct Assessment - Written rubrics for formal assignments
(quizzes, exams, lab assignments, and research papers)
 Indirect Assessment
(in-class discussion, small group problem solving, and
feedback from faculty)
Student Learning Outcomes and Assessments
Pol-Sci 309: Public Opinion
Measures, Findings, and Closing the Assessment Loop
Learning
Outcome
Indirect
Assessment
Measures
Direct
Assessment
Measures
Competency
Defined
Achievement
Target
Results
Action Plan
80%
Competency
87%
Competency
Modify exam to
maximize
student’s ability
to convey
knowledge and
understanding
of material and
spend an
additional week
discussing the
evidence and
incorporate
lecture material
80%
Competency
100%
Competency
Continue
current
methods
Rubric Score>80
(B-)
Explain the
formation of
public opinion
including the
role of human
values
Responses to inclass questions
and group
activities
Explain the
formation of
public opinion
including the
role of human
values
Responses to
in-class
questions and
group activities
Midterm Exam
(Essay Question)
Rubric
Score>80 (B-)
Quiz 2
Grading Rubric
Pol-Sci 309: Public Opinion
Midterm Essay
Essay Prompt: Do you believe a culture war exists in this country? Why or why not? In answering this question, be certain to discuss
your definition of a culture war and the arguments and evidence discussed in the readings (the media readings, Fiorina, and Abramowitz
and Sanders).
Poor
Sentences and
paragraphs are difficult
to read and understand
due to poor grammar or
mechanics.
There appears to be no
organization of the
content.
Needs Improvement
Contains numerous
grammar and
mechanical errors
Good
Contains minimal
grammar or mechanical
errors
Excellent
Clear and concise and
contains no grammatical
or mechanical errors
Organization is difficult to
follow, due to inadequate
transitions and/or
rambling format.
Can be easily followed.
A combination of the
following is apparent:
Basic transitions and a
structured format are
used.
Can be easily followed. A
combination of the
following is apparent:
Effective transitions and a
structured format are
used.
Define the Culture War
Does not define the
Culture War
Defines the culture war,
but provides few details
Defines the culture war
with sufficient detail
Explain and appraise
the theoretical
arguments
Does not fully explain or
appraise the arguments
in any meaningful way
Explains the arguments,
but does not appraise
the arguments.
Explains and appraise the
arguments with sufficient
detail
Evaluate the evidence
Does not fully describe
or evaluate the evidence
in any meaningful way
Describes the evidence,
but does not evaluate
the evidence.
Describes and evaluates
the evidence with
sufficient detail
Specify an argument
An attempt to make an
argument is made, but
the argument is unclear.
Attempts to define the
culture war, but does not
do so effectively
Attempts to explain and
appraise the arguments
but does not do so
effectively
Attempts to describe and
evaluate the evidence
but does not do so
effectively
An argument is
presented, but it requires
the reader to reconstruct
it from the essay.
Contains a clear
argument, but provides
few details or
connections to the
evidence.
Specifies a clear
argument (i.e., it is clear
exactly what the author is
trying to communicate).
Mechanics and
Grammar
Organization
Organization and
coherence of ideas
“Great Expectations”
for Civic Engagement
“Some men see things as they are
and say why? I dream things that
never were and say, why not?”
Robert F. Kennedy, Jr.
Quoting George Bernard Shaw
Download