American Studies

advertisement
Appendix 1
American Studies Learning Goals and Assessment Plan
Updated May 2013
Learning Goals / Outcomes for majors – An American
Studies graduate should:
Where we teach it
1. Understand and
a. Recognize significant
interdisciplinary questions
396, 399, comps
b. Isolate questions, assumptions &
methods of scholars working on
American materials in multiple
disciplines
115; 345; mid-level
AmSt courses; 396;
399
345
Comps
c. use appropriate methods from
multiple disciplines as tools to answer
questions
345, 396, comps
Comps
d. analyze & use as evidence a variety of
texts (primary & secondary; literary,
historical, sociological, etc.) and other
objects of study (art, films, maps, social
phenomena, data, etc.)
115; 345; mid-level
AmSt courses; 396;
399
Comps
e. synthesize materials across
disciplines in understanding and solving
problems
115; 345; mid-level
AmSt courses; 396;
399; comps
Comps
practice the
interdisciplinarity
of American Studies,
by being able to:
Assessment
means
2. Conduct research & demonstrate information literacy: find 115, 345, 396
primary & secondary sources and make proper citations in style
399
of American Quarterly (Chicago Style) (and other styles in
appropriate disciplines)
Comps essays
396, comps
3. Understand the historical dimension of the American
experience and/or the history of American Studies
Comps Exam
Survey courses; 345,
399
Appendix 1
4. Understand & think critically about diversity of background
and experience of people in the U.S.
115; 345; most midlevel courses
Comps Exam
5. Write persuasively in multiple disciplinary modes;
formulate and sustain thesis-driven argument in clear
written prose
115; mid-level
courses, 345
396, comps
6. Speak effectively in a formal presentation
115, 345, 396, 399
396, comps
396 and/or 399
Comps
presentations
American Studies Assessment Timetable
Data collection to be done annually:




Rubrics for assessing outcomes on Comps essays, projects & exams, refined 12/11
Rubrics for oral and written work, as appropriate, in 396 & 399 (piloted 2011, done
for 396 & 399 in 2012 and 2013).
Exit interviews –questions refined 12/2011 and put into Survey Monkey format spring
2012.
Student “Requirements Forms” submitted when they declare major (sophomore
spring) might be used for assessment – renamed “Plan of Study” for 2013; explore
ways to enhance usefulness of form in advising and reflection; consider comparing w/
final transcript for Assessment purposes. Discuss at winter break workshop 2012.
Assessment analysis & discussion - to occur at annual meeting in May when assessment
data is available for the year. Then in the annual December break workshop we will have
more extended discussion of what to do with what we’ve learned from assessment.







Writing effectively in multiple disciplines – Dec. 2010 and May/June 2011
Oral presentation – May/June 2012
Interdisciplinary methods & materials– 2014
Information literacy (research & citation) – 2015
Ability to think critically about diversity in U.S. society – 2016
Understanding of American culture across a range of disciplines – 2017
Understanding of historical dimension of American experience – 2018
Appendix 2
(handed out at winter break workshop meeting 2013)
Assessing Information Literacy
2014
Suggested Timing:

Three moments of direct assessment: by survey at the beginning of AMST 345, by
survey before comps, and by faculty evaluation of comps.
What we’re assessing:
 Learning Goal #2 “Conduct research and demonstrate information literacy: find
primary and secondary sources and make proper citations in style of American
Quarterly (and other styles in appropriate disciplines)”
How the survey is organized:





Basic question re: major journal in the field and citation style
Recognizing sources
Evaluating sources
Finding sources
Confidence levels
What the survey doesn’t cover right now (should we? Or leave for faculty assessment?):



Ibid/op cit and other citational strategies
Finding primary sources
Literature review – creating the conversation
Appendix 3
(handed out at winter break workshop meeting 2013)
Assessing Interdisciplinarity
From my spring 2013 assessment report:
“We realized we don’t know how to assess interdisciplinarity, and engaged in a preliminary
conversation about how to do so.”
Central Questions





How do we define interdisciplinarity?
Assess 1 a,b,c,d,e together or separately? How to unpack 1a? Better define 1b?
Where to assess it? Once or twice? (Longitudinal?)
Track as individuals or as cohort?
How do we envision using this assessment data? Is there a way to gather it that
would help us figure out our 115 -> 345 -> 396 -> comps bumpiness?
Definitional question:
Boix Mansilla and Duraisingh suggest that “the essential question to assess
interdisciplinary work is not “How much integration is enough?” but “What is the
cognitive and practical purpose of this work, and is this integration advancing it in
disciplinary grounded and reflective ways?” (230)
Some scholars in this field suggest that this reflective piece (a metadisciplinary
outlook) is more important for students to achieve than a disciplinary grounding in
two specific fields. (Rhoten et al )
Types of assessment (Stowe and Eder 2002):
Assessment by Discovery (open-ended)
Pros: allows us to assess anticipated as well as unexpected learning outcomes
Cons: More potential bias; less ability to standardize across cohorts/students
Assessment by Objectives (rubrics like we’ve been doing with other goals)
Pros: standardized; comparable data sets
Cons: difficult to create measurable outcomes for complex goals
Appendix 3
Assessment of Interdisciplinarity Plan #1
--By Objective
When Twice. End of 345 with mini-comps proposal assignment; Comps proposal at
beginning of senior year.
Rubric:
Interdisciplinary Learning Goal
Poor
Adequate
Superior
Formulates significant interdisciplinary
question
Can place scholars disciplinarily and
methodologically1
Chooses and uses appropriate methods to
answer question
Analyzes and uses as evidence a variety of texts
Synthesizes materials across disciplines
Our learning goals language: “Analyze & explain questions, assumptions & methods of
scholars working on American materials in multiple disciplines.”
1
Appendix 3
Assessment of Interdisciplinarity Plan #2
--By Objective, with a slightly different parsing of the desired outcomes (based on Rhoten
et al)
When Twice. End of 345 with mini-comps proposal assignment; Comps proposal at
beginning of senior year.
Rubric:
Interdisciplinary Learning Goal
PURPOSE – Is the purpose clear and does it
invite/require an interdisciplinary approach?
[how so?]
GROUNDING – Is it informed by more than one
discipline? Are disciplinary insights, methods,
languages, values used in rich and effective
ways?
INTEGRATION – Are these disciplines
integrated and combined at key points, in a
phrase, metaphor, interpretation, or
explanation? Does the integration advance
understanding and analysis?
THOUGHTFULNESS – Is the scholar/student
reflective about the challenges and possibilities
of this interdisciplinary junction? Do they have
a critical awareness of the choices they made in
order to produce an interdisciplinary account?
Poor
Adequate
Superior
Appendix 3
Assessment of Interdisciplinarity Plan #3
--By Discovery
When Twice. Either after interdisciplinary assignment in 396 or in a 200 level course, and
at end of comps?
Open-ended questions2:
(Note: either students or faculty could answer these questions.)
1. What is the purpose of the work? Does that purpose invite/require an
interdisciplinary approach?
2. Which disciplines inform this work? Are disciplinary insights (concepts, methods,
languages, values) used in accurate, rich, and effective ways?
3. How does synthesis occur in the work and how does it advance the project?
4. How does this work reflect the challenges / process / possibilities of doing
interdisciplinary work?
These questions/categories developed from Boix-Mansilla, “Interdisciplinary
Understanding: What Counts as Quality Work?”
2
Appendix 3
Works Cited
Boix-Mansilla, Veronica. “Interdisciplinary Understanding: What Counts as Quality Work?”
http://www.evergreen.edu/washingtoncenter/docs/natlproject/interdisciplinaryunder
standingwhatcounts.pdf
Boix Mansilla, Veronica and Elizabeth Dawes Duraisingh, “Targeted Assessment of Students’
Interdisciplinary Work: An Empirically Grounded Framework Proposed.” The Journal of
Higher Education 78.2 (2007): 215-37.
Rhoten, Diana, Verónica Boix Mansilla, Marc Chun and Julie Thompson Klein.
Interdisciplinary education at liberal arts institutions. Teagle Foundation (2006).White
Paper. http://info.ncsu.edu/strategic-planning/files/2010/10/2006ssrcwhitepaper.pdf.
Stowe, Donald E. and Douglas J. Eder, “Interdisciplinary Program Assessment.” Issues in
Integrative Studies 20 (2002): 77-101.
Download