PROGRAM INFORMATION Program Assessment Report

advertisement
Program Assessment Report
PROGRAM INFORMATION
Date submitted: March 1, 2011
Degree Program(s):
Department:
BA History
History
Department Chair:
Patricia Evridge Hill
Phone:
(408) 924-5755
Report Prepared by:
Patricia Evridge Hill
Phone:
(408) 924-5755
AY 2014-2015
E-mail:
Patricia.Hill@sjsu.edu
Next Self-Study due :
Note: Schedule is posted at: http://www.sjsu.edu/ugs/programplanning/
ARCHIVAL INFORMATION
Location:
DMH 134
Person to Contact:
(Bldg/Room #)
Diana Baker
(Name)
(408) 924-5500
(Phone)
Assessment schedule is posted at http://www.sjsu.edu/ugs/assessment
Please send any changes to the schedule or to student learning outcomes to Jackie Snell
jacqueline.snell@sjsu.edu
2. Using modern bibliographic data storage sites and systems and traditional (print) sources,
students systematically collect and appraise the historical significance and use of evidence of
various kinds of primary sources in western and non-western fields in pre-modern and modern
history: Government documents, Histories/Historical Accounts, Literature and Poetry, Images,
Autobiographies, Diaries, Letters, Newspapers, Maps, Quantitative Data, Oral Interviews.
Note: The history department assesses undergraduate learning through the three courses of its
core/skills sequence (Hist 99, Hist 100W, and Hist 102). These are the only courses that all SJSU history
majors must take. Each course in the sequence is significantly more challenging. As a result, what an
instructor in 100W sees as a student’s shortcomings when the semester begins likely represents real
learning on the part of that student the previous semester in Hist 99 (the 100W instructor rarely knows
where the student “began”). Instructors of these courses meet several times each year to discuss
assignments and ensure that each course in the sequence is appropriately targeted, but with the
exception of a year when three faculty members received Learning Productivity grants our workload has
prohibited systematic assessment of students’ progress on common assignments from the beginning of
the sequence through common assignments at the end of the sequence (our original plan). Recently,
we’ve moved away from common assignments altogether so that instructors can experiment with new
methods, exercises, and techniques. For the last two years—since we began assessing a single SLO
each year—instructors in each section of the core/skills classes prepared an assessment report specific
to that class. The department chair based this report on those analyses. Assessment results for each
course will be addressed separately below.
Initial Evidence of Student Learning:
[Prior to F10]
Hist 99—History Fundamentals (2 sections—Drs. Don and Wilson)
The typical problems that HIST 99 students face in mastering this SLO stem from a lack of familiarity with
primary sources and an inability to gauge and develop appropriate questions to ask of the source or
Page 1 of 5
Program Assessment Report
formulate theses after reading a source. An example: Dr. Don asked her class to pose factual and
analytical questions of the Emancipation Proclamation. A typical analytical question from students was:
What effect did the Emancipation Proclamation have on the South? She then asked what part of the
Emancipation Proclamation can answer this question, and students soon realized that the primary source
cannot answer that question. This is a problem of textual analysis. Instructors in Hist 99 must spend
quite a bit of time developing students’ understanding of the uses of a primary source. This is less a
problem of particular kinds of primary sources than it is an inability to think though the logical uses of
sources as evidence.
Dr. Don’s Hist 99 students completed a Pre-test. Only five out of 22 students were able to pose a thesis
that was specific and germane to the primary sources provided (WWI American propaganda posters
depicting Germans/Germany). Most of the students generated generic theses that could have applied to
almost any propaganda poster not just to those provided for analysis. In addition, only the same five
posed arguments in support of a thesis with direct evidence from the posters. The obvious conclusion
was that a lack of experience with textual/visual analysis led to weak theses and weak theses led to poor
papers.
In Dr. Wilson’s Hist 99 class, a Primary Source Paper was the first major assignment. Students chose
one primary source to evaluate from a published compilation required for the course. Most students
chose excerpts from Gilgamesh, The Book of Songs, the Ten Commandments, or the Egyptian Book of
the Dead. To succeed in this assignment, students needed to write a thesis-driven paper focused solely
on the information in the chosen primary source. Twenty-two students completed this assignment. 1/10 of
the students completed the assignment with insight and solid evidence. 1/5 of the students completed
the assignment competently with some errors. 1/3 of the students generally understood the assignment
but had major problems. The rest of the students did not succeed in evaluating the sources. Seven of
the students decided to rewrite their papers. All of the rewrites were significantly better.
Hist 100W—History Writers’ Workshop (2 sections—Drs. Don and Hilde)
Dr. Don noted that although about 90% of students in Hist 100W have taken Hist 99, her F10 section
included a quarter who were “grandfathered” into the course because they were SJSU history majors
before we introduced Hist 99. “I guess it is not strange that I lost pretty much all of those students before
the semester was over.” Overall, students possessed two main weaknesses related to their use of
primary sources. First, the students needed to do more textual analysis. Secondly, students had to
produce a 20-page paper, so this class challenged their pre-writing or outlining skills.
In a Pre-test, Dr. Don presented primary sources, WWI-era American propaganda posters against the
German enemy and in favor of buying liberty bonds with strong content that portrayed Germans in a
brutal light especially in regard to sexual matters. Also, she gave students some background that
suggested that German society and culture had been held in high regard in American educated society in
the late 19th and early 20th centuries. The writing prompt asked students to keep the background in mind
and write an essay that explained the posters. She asked students to be specific as to the content of the
poster in their arguments.
The Pre-test indicated that the most of the students could write a thesis about WWI-era American
propaganda posters, but none actually wrote a thesis that effectively analyzed the sexual content and
juxtaposed it with information provided about more positive American sentiments toward Germany before
WWI. Strangely, many papers made good arguments that characterized the sexual content of the posters
and attempted to analyze why such negative characterizations might be valuable to propagandists. Yet
none of the students connected this with the need to tear down pre-WWI sentiments in favor of Germans.
Dr. Hilde explained that every semester students seek to use oral interviews, either those already on file
at the SJSU archives (primarily the Chicano oral histories), or interviews they conduct themselves. She
does not allow students to conduct their own interviews unless they have taken public history classes and
are aware of proper procedures. They must also submit a copy of their questions and the transcribed
interview as part of their appendices. Students appear particularly drawn to this type of primary source
yet often fail to ask the kinds of analytical questions of oral history interviews that they would of more
Page 2 of 5
Program Assessment Report
traditional text-based or visual primary sources. In Dr. Hilde’s classes, the most popular primary sources
are diaries, letters, and autobiographies, as these are easiest to locate and to use. She noted that
students entering Hist 100W find the 15-page research paper daunting since it requires focus and
independence. However, they come to realize that because they are in charge of their own topic and
research it can be an incredibly rewarding experience.
Hist 102—Historiography (1 section—Dr. Katsev)
In Historiography, the primary sources that students use are writings by historians and historical thinkers,
ranging from ancient Greeks to post-modernists. Dr. Katsev explained that one of the biggest challenges
for students who have reached this level in the history program is to shift their thinking and appropriately
appraise these works as primary sources, not secondary sources. “They want to ask their usual
questions: What is this historian telling me about the past? Is it true? Instead, they have to ask: What
does this historian’s account reveal about his/her worldview? How might that worldview tell us something
about his/her times? How might this narrative have shaped others’ views of the past?”
Change(s) to Curriculum or Pedagogy:
[F10]
Hist 99
This fall, Dr. Don increased the amount of time she spent on textual analysis and the number of exercises
she used to help students develop their analytical abilities with primary source texts, especially as they
led up to major writing assignments. For the first time, she made a textual analysis paper in which
students analyzed a set of primary sources the first major assignment of the semester. Previously,
students had been able to select a package of 10-12 primary sources in some period of American history
that they used to complete a seven-page paper, the first of two papers. In F10, however, she required
the students to complete a three-page textual analysis paper and spent far more time teaching them
sourcing and contextualization skills before moving on to a more substantive essay. Completing this
small but significant assignment early in the semester greatly improved the focus of the major papers that
followed.
Dr. Wilson devoted two class sessions early in the semester to “reading the text as a historian.” She
asked students to read aloud excerpts from Hammurabi's Law Code then volunteer to tell the class what
certain passage say about 17th century BCE Mesopotamian attitudes towards divorce, property, justice,
water, and many other things. The students, overall, had some difficulty reading beyond the words of the
texts. Still, during the course of two class sessions with coaching, 75% of the students were able to
confidently make a statement about Mesopotamian beliefs and support the statement with evidence from
the primary source.
Hist 100W
Dr. Don met individually with students in this small section of 13 to review outlines and sources chosen
for the students’ second research papers. Eleven of those students responded to the increased individual
attention and made great progress—“I felt those 11 papers were some of the best I have had in my years
in my department.” Still, individual sessions added hours to an already overwhelming workload leading
Dr. Don to conclude, “I am not sure the interventions were ones that I would want to sustain in the future.”
Dr. Hilde strongly recommended that students base their research papers on materials in the SJSU
Special Collections and meet with that unit’s director, Danelle Moon, who introduced them to the
collections available at SJSU. Dr. Hilde allowed students to go beyond local and SJSU history if they
demonstrated that they had a viable topic and a plan for locating sources. F10 paper topics included the
changing mores of San Jose State students as seen through text, images, and poetry in the student
publication from the 1920’s, the Spartan Spanker, and the public reaction to Custer’s Last Stand indicated
by newspaper coverage in the North and South and in diaries, and autobiographies. These were both
highly successful paper projects—one based on primary sources in the University’s Special Collections
and the other based on the student’s exploration of an area in which Dr. Hilde has a great deal of
expertise.
Page 3 of 5
Program Assessment Report
Hist 102
During F10, Dr. Katsev decided that a key step in helping the students appraise the works of past
historians as primary sources was “to work with them from day one on how they read the sources.” This
involved focusing on how they think about the sources. “In the past, I had assigned material, and then
when we came to class, asked them questions about the text. Now, I’ve switched to introducing them to
the questions first.” At the very first class meeting, before students did any reading, Dr. Katsev gave
them a set of reading questions that they would return to throughout the semester. And, so that they
understood the kind of thinking these questions required, together in that first class, she guided students
through the application of the questions to a few paintings from the Renaissance (visual primary sources).
Dr. Katsev emphasized that this was just an exercise in using the questions, so students wouldn’t feel
intimidated by the art. “For example, I show side-by-side a painting by Vermeer and Raphael. All of the
students can readily make comparisons of what the two artists think is worth recording, why, and how.
As they look at a macabre image of life and death by Hans Baldung, they find they can discuss his
understanding of the relationship between past, present and future.” For their first homework assignment,
students applied these same questions to texts by Ancient Greek and Roman historians. At the second
class meeting, students’ picked up with these same questions, and together did close readings of the
assigned texts.
Evidence of Student Learning after Change:
[F10]
Hist 99
On Dr. Don’s Post-test, a little over half of the 22 students were able to pose a thesis that was specific to
the primary source evidence. Too many students still formed obvious general theses, though more of the
unsuccessful students at least noted that the propaganda posters made characterizations of Germans
that were designed to motivate Americans to purchase liberty bonds, which was slightly better than the
Pre-test. Again, the quality of the papers and citation of evidence followed closely the quality of the
thesis. The obvious conclusion was that increasing textual analysis instruction helped students’ overall
understanding of historical analysis and the writing process. In response, Dr. Don has increased the
amount of instructional time on textual analysis even more during S11 and has tied sourcing and
contextualization to the section of the course on historical questions and theses.
Below are samples of Pre/Post-test theses of 1) a student who made only slight progress, 2) a student
who made significant progress, and 3) a student who did well at the beginning of the class but made slight
progress honing his thinking in the class.
Only slight progress—
Pre: “They used several posters to show how Germans were a deadly, destructive force and they would
kill anyone in their path.”
Post: “The propagandists in the US appealed to Americans’ urge to buy liberty bonds to support the war
effort by making the Germans seem like villains, while the US was the hero.”
Significant progress—
Pre: “The US used several propaganda techniques to move American opinion against Germany in WWI.”
Post: “The portrayal of Germans in US propaganda was one of savagery, violence, and authoritarianism,
and the portrayals were used to persuade Americans to support the war effort by buying liberty bonds.”
Strong student who improved—
Pre: “By using fear, loss of traditions, and ancient prejudices and characterizations of Germans as brutes
or barbarians, the US made its appeal to its citizens to help the war effort to defeat the enemy and buy
liberty bonds.”
Post: “To make the image of evil Germans, the US government chose to portray them as barbarians that
challenged the traditional American values of decency toward women and respect for the innocents in
war, thus motivating Americans to buy liberty bonds and support the war effort.”
Page 4 of 5
Program Assessment Report
A Primary/Secondary Source Paper is the last major assignment due in Dr. Wilson’s class. To succeed
in this assignment, the students needed to write a thesis-driven paper based on primary sources they
chose from the textbook and secondary sources they accessed on their own. Eighteen students
completed this assignment. 1/2 of the students were able to use evidence and some insight to evaluate
their sources. 1/4 of the students focused on the secondary sources and not the primary sources. 1/4 of
the students did not succeed in evaluating the sources. This paper could not be rewritten since it was
due on finals day.
Stats from this class:
Final grades:
Began with 24 students
A or A- = 2
B or B- = 4
C or C- = 3
D or D- = 4
F = 9 (5 of these stopped attending class during the semester)
I=1
W=1
Hist 100W
On Dr. Don’s Post-test, the twelve remaining students did a good job of organizing the essay and writing
theses that analyzed the characterization of Germans and the emphasis on sexual matters. However,
again, none made connections to educated Americans’ pre-WWI admiration of Germans and German
culture, revealing a lack of sophistication when combining an analysis of primary sources and historical
context. Over 70% of the students used blueprinting of the thesis. All of the essays were much more
focused on the question and also guided by the students’ theses. Overall there was a good improvement
in both textual analysis and organization of thinking.
Based on the final essays Dr. Hilde concluded, “Students are often motivated to go beyond the obvious
sources because they choose topics they truly find interesting.” For instance, a relatively weak student
ended up doing some of the most involved research. He cares deeply about baseball, and learned of a
WWII baseball team when reading a popular book. This led him to a secret WWII prison camp housing
German sailors seized from a captured u-boat. He corresponded with archives in Louisiana to find more
primary sources to document his essay. Dr. Hilde added that once students make it past the second
paper, they almost always complete the final paper. They must do research based on both primary and
secondary sources, but students enjoy having their own individual projects and they pursue the research
with great attention, often finding far more information than expected. Samples of the final essays are
available for review.
Hist 102
Dr. Katsev assessed students’ abilities to analyze the writings of historians as primary sources through a
section of the mid-term exam, in which they were required to analyze passages from historians Livy (59
B.C.E.-17 C.E), Agrippa (1486-1535), Condorcet (1743-1794), and Michelet (1798-1874). Samples of A,
B, and C responses are available. By changing students’ perceptions at the very beginning of the course
and reinforcing the view that historians of the past create primary sources both through discussion and in
writing, “almost all of the students early on in the class showed a sophistication of analysis of primary
sources that I had not seen before.”
Page 5 of 5
Download