QCC / CUNY Department of Social Sciences Individual Course Assessment Report

advertisement
QCC / CUNY
Department of Social Sciences
Individual Course Assessment Report
for Labor and Management
(ECON 150)
Date Submitted: April 14, 2014
By Prof. J. Gilleaudeau
ECON 150 – Labor and Management
ECON 150 Labor and Management studies the labor force and the market for labor; theory of wage
determination; employment and unemployment, including structural unemployment; trade unions and
collective bargaining; the role of management and unions; emphasis on practical problems of labormanagement relations, labor legislation, and public policy.
Assessing ECON 150 was unique since it is part of the Next Step Program at QCC and as such is a course
with only one section, taught by one teacher, to one specific cohort of students. This particular cohort
consisted of 20 Verizon employees.
Student Learning Outcomes Addressed
The assessment exercise focused on the following outcomes from the flexible core of our recent
Pathways’ course submission:
-Gather, interpret, and assess information from a variety of sources and points of view.
More specifically: Students worked in groups to find supporting evidence that either affirmed or refuted a
proposal for debate. They used traditional as well as more modern media as research sources.
-Evaluate evidence and arguments critically or analytically.
More specifically: Students constructed and defended their assigned debate perspective, while rebutting
their opponents’ arguments with clarity and logic. They identified weaknesses in the arguments of their
counterparts, and were able to highlight these for their audience.
-Produce well-reasoned written or oral arguments using evidence to support conclusions.
More specifically: Students constructed and defended their assigned debate perspective, providing sources
and citations that bolstered their perspective and strengthened their arguments.
Evidence Used to Determine Student Achievement of Outcomes
Near the beginning of the semester, teams consisting of five students were chosen. During the semester,
each team collaborated to find data and arguments to support their position in a scheduled debate.
On occasion, class time was set aside to allow some direct interaction among group members, and for the
instructor to provide guidance or structure wherever it was needed; however, most of the preliminary
work for the debates was performed independently within student groups.
On April 11 2014, two debates were held on the following propositions:
Debate 1:
Resolved: Walmart is Good for America.
Debate 2 :
Resolved: The Telecommunications Industry is Over-Regulated.
The structure for the debates was shared with students early in the collaborative process, and was
reinforced by an oral presentation by the instructor. Proper form was emphasized, as it is essential to a
logical presentation of evidence and optimal learning outcomes. (See Appendix 2 for debate format)
On the day of the debate, a rubric (see below) that had been shared in advance with students provided the
basis for evaluating groups, as well as members within groups. The rubric covered competencies such as:
use of factual evidence, logical argumentation, cogency and coherency with regard to affirmative and
rebuttal positions. Students received evaluations ranging from superior to poor in each area, as well as a
summary grade. At debate’s end, groups were assigned points based on their general excellence, or lack
thereof, as evaluated in the rubric.
After grades were assigned, an extensive discussion relating to the debated subject commenced. The best
arguments were reiterated, citing individuals who contributed well to their team.
Below, you can view the rubric, as well as the calculated frequencies within each cell.
ECON 150: Labor and Management: Debate Rubric: 4/11/2014: 20 students
Superior – 4
Factual
Information
Comprehension
Used many facts to
support all
arguments.
60%
Demonstrated a
thorough
understanding of the
information.
Demonstrated accurate
understanding of most
information.
All arguments were
logical and
convincing.
20%
Delivery
Communicated
clearly and
confidently,
maintaining eyecontact and engaging
the audience.
55%
Rebuttal
Addressed all
opponent arguments
with counterevidence.
28%
Total Score
Used some facts to
support most
arguments.
15%
40%
Persuasiveness
Proficient - 3
32%
35%
Most arguments were
logical and convincing.
50%
Communicated clearly
and confidently most of
the time, often
maintaining eye-contact
and engaging the
audience.
35%
Addressed most
opponent arguments
with counter-evidence.
Satisfactory - 2
Used some facts to
support some
arguments.
20%
Demonstrated an
understanding of some
information.
25%
Some arguments were
logical and convincing.
30%
Only communicated
confidently and clearly
on occasion, not fully
engaging audience.
Poor - 1
Score
Used few facts to support
any arguments.
5%
2.85
Often demonstrated a
fundamental
misunderstanding of the
information.
0%
3.15
Few, if any, arguments
were logical and
convincing.
0%
2.9
Seldom communicated
confidently and clearly, with
little or no engagement of
audience.
3.45
10%
Addressed some
opponent arguments
with counter-evidence.
0%
Addressed few, if any,
opponent arguments with
counter-evidence.
33%
33%
6%
43%
24%
2%
2.55
2.93
ECON 150: Labor and Management:
* Weighted averages differ slightly as a result of a revised debate format as noted in the appendices.
Comparison of 2013 & 2014 results: 2013 Results in Red
Superior – 4
Factual
Information
Comprehension
Used many facts to
support all
arguments.
60% (54%)
Demonstrated a
thorough
understanding of the
information.
Demonstrated accurate
understanding of most
information.
All arguments were
logical and
convincing.
20% (17%)
Delivery
Rebuttal
Used some facts to
support most
arguments.
15% (29%)
40% (17%)
Persuasiveness
Proficient - 3
35% (50%)
Most arguments were
logical and convincing.
50% (50%)
Communicated
clearly and
confidently,
maintaining eyecontact and engaging
the audience.
Communicated clearly
and confidently most of
the time, often
maintaining eye-contact
and engaging the
audience.
55% (25%)
35% (42%)
Addressed all
opponent arguments
with counterevidence.
28% (28%)
Addressed most
opponent arguments
with counter-evidence.
Satisfactory - 2
Used some facts to
support some
arguments.
20% (8%)
Demonstrated an
understanding of some
information.
25% (29%)
Some arguments were
logical and convincing.
30% (29%)
Only communicated
confidently and clearly
on occasion, not fully
engaging audience.
10% (29%)
Addressed some
opponent arguments
with counter-evidence.
Poor - 1
Score
Used few facts to support
any arguments.
5% (8%)
2.85
(3.04)
Often demonstrated a
fundamental
misunderstanding of the
information.
0% (4%)
3.15
(2.79)
Few, if any, arguments
were logical and
convincing.
0% (4%)
2.9
(2.79)
Seldom communicated
confidently and clearly,
with little or no
engagement of audience.
0% (4%)
Addressed few, if any,
opponent arguments with
counter-evidence.
33% (33%)
33% (27%)
6% (13%)
43% (47%)
24% (24%)
2% (6%)
3.45
(2.88)
2.55
(2.73)
Total Score
32% (23%)
2.93
(2.86)
Caveats
Before making any assertions regarding the data collected, I believe it is important to state several
caveats.
One, the samples for each year are not terribly large, 24 individuals in one case, only 20 individuals in the
other. And though all subjects are drawn from a pool of Verizon employees, presumably based on similar
criteria, the criteria are not explicitly known to this instructor and so considerable variability could exist
between the two samples chosen and evaluated.
Second, anecdotally, I can attest to sensing almost immediately a different group dynamic within each
group. So, even if their intellectual abilities were generally of the same order, the degree of good-natured
camaraderie and collaboration seemed to differ sharply between groups. Such differences may be
reflected in the divergent results above.
Third, as my action plan was implemented but had several “moving parts”, it may be difficult to discern
the individual contributions that each element may have contributed to the new results.
Having stated these qualifications, let us proceed to the evaluation of evidence.
Evaluation of Evidence:
In general, the results reported above are good, with even fewer students logging poor performances in
any of the categories being measured. But there is little difference between the general performance of the
2013 cohort and the more recent 2014 cohort.
Of course, parsing more closely, one sees that the more recent group seems to have had a disproportional
number of students achieving at the highest level, i.e. superior, in areas of comprehension and delivery.
This may be attributable to the “One on One for One” exercises we used in class, which could have made
them more confident with constructive exchanges of diverse views. It could have been aided by a couple
of short, labor debates we viewed in-class, their styles mimicking those of the expert debaters they
observed. And certainly, a clearer debate format could have proven less distracting, possibly even serving
as a useful template for the arguments each team planned to mount.
I don’t doubt the efficacy of these techniques. At the very least, they seemed to increase class
engagement. However, the inherent strength of this group was their openness and much of what is
measured here could be due to that quality alone.
Additionally, I was less pleased that a slightly smaller proportion, though still a high proportion of nearly
80% of students, scored at least proficient in factual evidence. The 2014 cohort, though often confident in
delivery, persuasive and cognizant of crucial issues, often played “fast and loose” when it came to citing
the source of their arguments. I recall making the necessity for such citation clear on several occasions,
but it seems to have had little effect.
More disappointing than anything else, the 2014 cohort seems to have taken a step back in the area of
rebuttal, which from having witnessed and scored the debate I believe rested simply upon students
making their points, while neither possessing the mastery of material nor the aplomb to listen to other
views closely in a critical way.
It is something I tirelessly emphasized whenever multi-faceted discussions took place in class sessions,
but the lifelong habit of adopting a position and defending it without question is a hard one to break.
So, what is to be done?
Action Plan:
Though the outcomes of the debates were reasonably well-achieved, there is significant room for
improvement. To that end, I plan to take the following actions next spring when Labor and Management
(ECON 150) is once again offered.
First, I will retain the streamlined debate format. (compare Appendix 2 to Appendix 1)
The simpler format, with improved clarity, met with significantly less confusion that the previous format.
Second, I will retain the technique of occasionally viewing a short, expert-based debate wherever it is
possible, partly to enhance the depth of understanding of particular sub-topics in labor and management,
but also with an eye toward modeling proper debate etiquette. The 2014 cohort seemed more polished
than the 2013 cohort, and I believe these viewings may have helped.
Third, I plan to retain “One on One for One”, which involves students being chosen on a weekly basis to
confront each other in one-on-one debates for one minute intervals.
But additionally, I will require students to make another pass at each other, based upon points that were
made in the first quick exchange. I will emphasize that the second pass should be one designed to rebut
previously made points. With enough practice, perhaps this will enhance flexibility in argumentation, as
well as their tendency to listen and respond actively to the points that surface. It is hoped that this will
reduce the unfortunate tendency for students to talk “past” each other, and will increase critical
engagement between and among students.
Fourth, on almost a regular basis, I will assign a “proposition” to be defended or rebutted with citation as
a homework exercise.
For example, the statement: “The minimum wage does more harm than good.” may serve as a
proposition, and at the onset of the following class, I will require students to agree or disagree with the
statement, but only students who cite evidence for their arguments will receive credit. I hope this will get
the next cohort in the habit of fortifying their arguments with evidence, as opposed to making arguments,
no matter how logical, that may be unfounded empirically.
Lastly, I will again perform a brief lesson in persuasive speaking. I will share tips and best practices from
my years as a teacher, as well as other techniques that I have seen to be used effectively by others.
Preparation, clarity, poise, energy and openness will be stressed. I will end the lesson by setting aside time
for students to make brief, free-form speeches employing techniques discussed. Constructive criticism and
encouragement will be offered.
The 2014 cohort did particularly well in the area of delivery, and though I’ve stated it may have already
been a strength they possessed, this exercise was well-received and could have only enhanced their
performance on debate day. It seemed well-worth the class time devoted to it.
Though it is impossible to gauge the effectiveness of these measures prior to their actual deployment, I am
confident they will help me to more consciously aim for the achievement of the learning outcomes set out
above. And one would hope that this should also increase the likelihood that my students leave my class
as better thinkers, speakers and collaborators than when they arrived.
Appendix: 1: Debate Format: ECON 150 VER1: 2013
Debate: 4/18/2013
Debate: 4/25/2013
Resolved: Walmart is Good for America.
Resolved: The Telecommunications Industry is Over-regulated.
Affirmative Team: Defends the resolution.
Affirmative Team: Defends the resolution.
Negative Team: Challenges the resolution.
Negative Team: Challenges the resolution.
Action
Affirmative Construction 1
Negative Cross Examination 1
Negative Construction 1
Affirmative Cross Exam. 1
Description
A good introduction that attracts the audience’s attention
and interest…Clearly state the resolution…Clearly state
each of your contentions… support with
evidence…Conclude effectively
You ask questions – have a strategy or at the very least a
direction to your questioning
A good introduction that attracts the audience’s attention
and interest…Clearly state the Negative’s position on the
topic….Clearly state the Negative’s
Observations…Support with evidence…question the
Affirmative’s evidence…Conclude effectively
You ask questions – have a strategy or at the very least a
direction to your questioning
Time
3 minutes
3 minutes
3 minutes
3 minutes
Affirmative Construction 2
Similar to first Affirmative Construction, but also
respond to Negative arguments/attacks
3 minutes
Negative Cross Examination 2
You ask questions – have a strategy or at the very least a
direction to your questioning
3 minutes
Negative Construction 2
Similar to first Negative Construction, but also respond to
Affirmative arguments/attacks
3 minutes
Affirmative Cross Exam. 2
You ask questions – have a strategy or at the very least a
direction to your questioning
3 minutes
Negative Summary
Rebuild the Negative case…Summarize how the
Negative position is superior… convince the audience the
Affirmative has failed to prove their assertions
4 minutes
Affirmative Summary
Respond to the Negative arguments…rebuild the
Affirmative case and contentions – extend arguments and
give additional support for them
4 minutes
Appendix: 2: Revised Debate Format: ECON 150 VER1: 2014
Debate: 4/11/2014
Debate: 4/11/2014
Resolved: Walmart is Good for America.
Resolved: The Telecommunications Industry is Over-regulated.
Affirmative Team: Defends the resolution.
Affirmative Team: Defends the resolution.
Negative Team: Challenges the resolution.
Negative Team: Challenges the resolution.
Affirmative
Negative
Affirmative Construction 1: 3 minutes
Negative Construction 1: 3 minutes
Make a good introduction that attracts the
audience’s attention. Clearly state the resolution.
Clearly state each of your contentions. Support
each contention with evidence and conclude
effectively.
Make a good introduction that attracts the
audience’s attention. Clearly state your opposition
to the resolution. Clearly state each of your
contentions. Support each contention with evidence
and conclude effectively.
Affirmative Construction 2: 3 minutes
Negative Construction 2: 3 minutes
Similar to Construction 1, but you may now
incorporate rebuttals to any previous statements by
the opposition.
Similar to Construction 1, but you may now
incorporate rebuttals to any previous statements by
the opposition.
Affirmative Construction 3: 3 minutes
Negative Construction 3: 3 minutes
Similar to Construction 2.
Similar to Construction 2.
Affirmative Construction 4: 3 minutes
Negative Construction 4: 3 minutes
Similar to Construction 2.
Similar to Construction 2.
Affirmative Shared Summary: 4 minutes
(two students share the summary duties)
Negative Shared Summary: 4 minutes
(two st (two students share the summary duties)
Respond to the Negative argument. Rebuild the
Affirmative case. Extend arguments and give
additional support for them. Conclude strongly
with a clear statement of a well-supported, major
contention.
Rebuild the Negative case. Conclude strongly using
evidence to prove to your audience that your
Affirmative Opponents have failed to prove their
assertions.
Download