Queensborough Community College/CUNY Department of Social Sciences, Julia Rothenberg

advertisement
Queensborough Community College/CUNY
Department of Social Sciences, Julia Rothenberg
Assessment Report for 2014 Assessment Institute
Course Assessed: SOCY 101 PNET, WI
Course Description: In this Writing Intensive, Partially Online class, students become familiar
with key concepts that sociologists use to study the social world. Students learn to use these
concepts to understand the challenges and problems facing their own society and their own role
in social reproduction and social change. Students learn to identify and analyze dynamics of
human society with special emphasis on application of scientific methods of observation and
analysis of social groups, intergroup relations, social change, social stratification, and social
institutions.
General Education Objectives (GEO) Assessed Learning Objectives and Outcomes:
QCC General Educational Objectives
Students will use analytical reasoning to identify issues or problems and evaluate evidence in
order to make informed decisions.
Students will integrate knowledge and skills in their program of study.
Pathways Common Core Student Learning Outcomes (SLO) Assessed:
PATHWAYS LEARNING OUTCOMES II .D. INDIVIDUAL AND SOCIETY
Students will learn to evaluate evidence and arguments critically and analytically.
Students will learn to produce well-reasoned written or oral arguments using evidence to support
conclusions.
Individual Course Objectives to be Assessed
 students are also expected to develop writing skills and critical thinking skills appropriate
for study at the college level.
This Student Learning Outcome has been subdivided into specific, observable for faculty to
evaluate student work

Students will demonstrate a critical use course material by evaluating and synthesizing
this material to support their thesis and analysis
SS310 Introduction to Sociology

The ideas are arranged logically to support the thesis, flow smoothly and are clearly
linked to each other.

Students will demonstrate proper use of grammar, syntax, and spelling; logical
compositional structure (intro body conclusion); and proper use of citations and
bibliographic reference
Participants:
No. Sections Assessed: 3
No. Students Assessed: 43
Course Assessment Rational: Toward the end of the Spring, 2014 members of the Sociology
faculty conducted an assessment of 8 sections of SOCY101, with a total of 302 students based on
a range of Gen Ed, Pathways and Course Objectives for SOCY 101, which resulted in a detailed
report compiled by myself and my colleague, Ryan Moore. Our assessment was based on a
reading assignment followed by a series of multiple-choice questions. This task called on
students to utilize and identify key concepts and skills from SOCY 101 including: the
sociological imagination, norms and values, social class, qualitative sociological methods and the
relationship between social structure and individual outcomes. In brief summary, our students
evidenced either mastery or strong development in all of the four categories.
SOCY 101 PNET Writing Intensive courses include the same Gen Ed, Pathways and Individual
Course Objectives as the SOCY 101courses that we assessed. However, students are expected to
demonstrate their mastery of these objectives largely through writing tasks. They are not
“graded” for their writing skills per se, but the inability to communicate effectively through
writing will likely negatively impact their grade.
For this Assessment Seminar, I piloted an additional assessment task, which, together with our
earlier assessment, will flesh out our understanding of the needs and position of SOCY 101
students who choose to take SOCY 101 PNET Writing Intensive classes. Since writing is a
particular challenge for our students, as evidenced by the high percent of students who require
remediation and ESL support at QCC, and there are no writing requirements that students must
meet in order to register for this class, it is important to assess the writing skills of these students
in order to get a better understanding of the likelihood that they will be able to perform at least
the basic writing tasks that we assign successfully in this and other introductory PNET WI
courses.
Course Assessment Tools and Methods: Students were given a written assignment to be
completed on the Discussion Board feature of Blackboard (appendix item 1) relatively early in
the semester. This assignment required that they compose three cogent paragraphs based on a
film and a series of questions. These questions asked them to correctly use key concepts from the
textbook and lectures. While they were graded primarily on “content” for the purposes of the
course, I also assigned each response a number and assessed each response on the basis of a
SS310 Introduction to Sociology
standard rubric and scoring form (appendix item 2) developed to assess basic writing skills in
any subject. This score had no impact on the students’ grade for the class, but the fact that they
were being graded on this assignment (using separate criteria) ensured that the students would
take the task seriously and give it their best effort.
Results and Discussion
43 students completed the assignment.
The table below represents all 43 scores in each of the three categories:
exemplary
content
9
organization
5
Grammar/sentence 6
structure
acceptable
29
27
25
unacceptable
5
11
12
total
43
43
43
In addition to the base scores in each category, I performed an in-depth analysis of a random
sample of 10 assignments. Further insight can be gained regarding the writing samples provided
by these 10 students in the table below:
Student 1
Student 2
Student 3
Student 4
Student 5
Student 6
This student’s writing was relatively strong in terms of organizing content and
structuring the argument necessary for the assignment. Most grammar and
punctuation issues were acceptable, with a few misplaced modifiers and other
minor grammatical issues which detracted from overall quality.
Student 2 had very poor grammar and this detracted significantly from his/her
ability to develop a cogent argument. Run on sentences with multiple
grammatical errors such as “Also my sister have to wait six months after
working for Walmart before she could even get a Walmart discount. I waited
but I like how I revive my items quickly and how they are able to have a
variety of products at lower costs but watching the video makes me more
aware and of how they help and don't help our economy and I don't like how
they take advantage of other countries laws to benefit its own corporations”
made for difficult reading.
Student 3, while able to pull together decent content did not use appropriate
punctuation such as quotes and periods. These errors may well have been due
to negligence as opposed to lack of familiarity with grammatical rules.
This assignment was rife with sentence fragments, but with an excellent grasp
of the argument.
In this case, the student was able to write a basic three paragraph essay in
relatively good form, but the concepts did not reflect the assignment. The
student appeared not to have read the question carefully.
Student 6 did an excellent job on the assignment with a clear, well written
short analysis of the problem. An example includes: “This has had a negative
SS310 Introduction to Sociology
Student 7
Student 8
Student 9
Student 10
impact on the American worker. Many manufacturing jobs have been lost
because these jobs have been outsourced overseas where production costs are
cheaper. These production costs are cheaper because you are paying the
worker overseas less money than you would pay an American. You do not
have to give these employees benefits like health insurance and a retirement
plan. The American worker is basically too expensive to pay.”
The student clearly identified the major issues in the film, but a few
grammatical and spelling errors detracted from the assignment. For example,
this student used the work meat when indicating a meeting between people.
This essay was written in casual form, with almost no evidence of mastery of
college level writing. It was rife with sentences of this quality: “This effects
me because if i want to save on money which everybody wants to do, we
would want to shop at a place where we can get the most for the least amount
of money.”
This student seemed to have some liited grasp of the material, but very poor
grammar and organization, jumping from topic to topic as evidenced by “[t]he
impact of this model on American workers is that, Walmart is very organized,
there's different sections, very easy to keep things organized. Prices are very
organized also. Walmart has the greatest productivity. Americans prospects
were changed by having a class of what they have to do. The workers pay
attention on what the customers wants to buy. The focus is what matters to
Walmart, it's also the prices. For workers in other places, the buisness isn't as
great as the other corporation. The power of Walmart changed many
manafactures. The fate of workers in different parts of the world is linked
through the Walmart model because Walmart have the largest customers, and
helped other companies have growth in their economy. Walmart was the most
admired company in 1994. They do the things that help admire others. This
buisness model impact the way we consume because it helps us to find what
is cheaper and the retailing is good. I shop by just looking at the price and I
know other places are cheaper so I check other places also. I buy and have a
lot of stuff such as candy, desk organizers, and copy paper. I buy my items at
staples or rite aid. I am willing to pay about $50. Walmart is good for
America because it can help us understand how sales work and how buisness
should be done or can be done. Walmart can also help us focus on our
customers more than being on our phones and not knowing how the price
argument would work.”
This student gave an average performance, displaying basic written
communication skills with distracting errors such as run-on sentence: “Many
Americans don't have a job anymore because they used to work at a factory
which is no longer available to them anymore because China’s factories are
much cheaper for Walmart as a business.”
These conclusions suggest that many students have mastered basic writing skills before taking
this class. Over 15% of the scores available on the rubric (see table 1) were in the exemplary
SS310 Introduction to Sociology
column, and over 60% were acceptable. However, as closer analysis confirmed, there is a great
disparity between the strongest and weakest students that likely cannot be remedied in the
context of a one semester writing intensive course, even with outside supports such as the
Writing Center or ESL tutoring.
Implications and Suggestions for Further Study
While earlier results show that students are able to master basic content for SOCY 101 in the
course of a semester, this pilot suggest that for at least some of students, struggles with written
expression are likely to hamper their progress in this and other disciplines. Social Sciences and
other departments might want to consider implementing requirements, such as having passed
remedial reading and writing or equivalent courses before allowing students to take Introductory
level Writing Intensive classes. The department might also want to consider encouraging faculty
to work more closely with centers of academic support at QCC, like the Writing Center, in order
to encourage or indeed require students in WI courses to utilize these tutoring services. The main
issue identified in this pilot is disparity between the strongest and weakest writers. Given the
issues faced by the weakest writers among our students, it is unlikely that all the writing issues
along with the area content could be addressed within the semester by the SOCY 101 instructor
alone.
This pilot study also suggests that more research is needed in order to accurately identify
students’ writing struggles. Moving forward, we might consider administering a “before and
after” writing assessment, and using a much larger sample size, in order to determine what level
of writing improvement can be achieved during the course of a semester. We might also want to
probe more deeply into the previous writing experiences and struggles of our students, perhaps
using focus groups or surveys.
Appendix:
Item 1, Blackboard Assignment:
http://www.pbs.org/wgbh/pages/frontline/shows/walmart/
Click on the link above to watch the film "Is Walmart Good for America?"
This discussion board post should answer the following questions. Don't forget to check for
grammar and spelling before you submit.
Use complete sentences and back up your statements with reasoned arguments. Use chapter 14 to
guide your discussion.
This post is due before class Friday, October 17 and is worth 4 points.
The film addresses the Walmart business model. This model has replaced the old fashioned,
manufacturing driven business model characterized by MG, Ford, US Steel and other companies.
SS310 Introduction to Sociology
This model is characteristic of a new phase of capitalism and has had a profound impact on the
way we work and the way we consume.
Describe the Walmart model -how does this corporation do business? Use terms from chapter 14
such as globalization, outsourcing, flexible production, international division of labor,
transnational production, unions and so forth.
What is the impact of this model on the American worker? How has it changed working
conditions and prospects for Americans? What is the impact on workers in other parts of the
world? Describe how the fate of workers in different parts of the world is linked through the
Walmart model. Specifically, if possible, discuss how the Walmart model will or has impacted
your own work experience.
How does this business model impact the way we (or you, specifically) consume? How do you
shop? How much stuff do you have? What do you buy? Where do you buy it? How much are
you willing to pay?
Overall, is Walmart good for America? Support your response with arguments.
Item 2, Rubric
Student Number ____________
1. Written Communication
Criteria
Exemplary (A)
Content
Organization
Sentence
structure and
Even, balanced
information
clearly and
effectively
supports a central
purpose or thesis.
Reader gains
insights.
The ideas are
arranged logically
to support the
thesis, flow
smoothly and are
clearly linked to
each other.
Sentences are
well phrased and
SS310 Introduction to Sociology
Acceptable (C)
Unacceptable
(F)
Information provides some
support for the thesis and
displays evidence of a
basic understanding of a
central purpose or thesis.
Reader gains some insight,
but not fully.
Paper does
not clearly
identify a
purpose or
thesis and is
vague leaving
the reader
confused.
The writing
lacks any
semblance of
logical
organization.
The ideas are arranged
logically to support the
thesis, but some of the
ideas fail to make sense
based on the structure of
the writing.
Sentences are adequately
phrased and flow well with
Sentences are
awkward and
Your
Grade (A,
C, F or
NA)
grammar
flow smoothly
using correct and
error-free
grammar.
SS310 Introduction to Sociology
few grammatical errors.
ill phrased
with
grammatical
errors that
impede the
flow.
Download