QCC COURSE ASSESSMENT FORM QCC C A

advertisement
QCC COURSE ASSESSMENT FORM (SHORT)
QCC COURSE ASSESSMENT FORM
Fall 2004, Rev. 6/15/07
Date May 31, 2012
Department: Foreign Languages and Literatures
Course:
LS402
Curriculum or Curricula: LA
PART I. STUDENT LEARNING OBJECTIVES
For Part I, attach the summary report (Tables 1-4) from the QCC Course Objectives Form.
TABLE 1. EDUCATIONAL CONTEXT
LS402 This is a journey into contemporary Latin American and Caribbean cultures through the reading and
discussion of politics, customs, art, music and cinema. This course is taught in English as a WI (Writing
Intensive). Two writing intensive courses are required for (AA) degree in Liberal Arts and Sciences, Fine Arts,
and Business Transfer.
TABLE 2. CURRICULAR OBJECTIVES
Note: Include in this table curriculum-specific objectives that meet Educational Goals 1 and 2:
Curricular objectives addressed by this course:
N/A
TABLE 3. GENERAL EDUCATION OBJECTIVES
Gen Ed
objective’s ID
number from
list (1-10)
General educational objectives addressed by this course: Select from preceding list.
(1) Communicate effectively through reading, writing, listening and speaking
(2) Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed
decisions.
(3) Use information management and technology skills effectively for academic research and lifelong learning
(4) Integrate knowledge and skills in their program of study
(5) Apply aesthetic and intellectual criteria in the evaluation or creation of works in the humanities or the arts.
TABLE 4: COURSE OBJECTIVES AND STUDENT LEARNING OUTCOMES
Course objectives
Learning outcomes
1(13)
=> Read, interpret, and discuss texts and
information from a variety of sources and
points of view related to Latin American
And Caribbean cultures
=> Gather and evaluate evidence and
arguments critically and include it in a
research paper about an artist or author
(1)Recognize important cultural trends and writers as well as artists in SpanishAmerican, Caribbean and Brazilian Literature, and popular culture.
(2)Apply research low and high-stake writing to increase knowledge, and analytical skills
through the composition of an essay on writers and artists or cultural events. The latter
may include a review of a film, play, show or exhibit related to Latin American culture.
=>Produce well-reasoned written or oral
arguments using evidence to support
conclusions. .
2(13)
PART II. ASSIGNMENT DESIGN: ALIGNING OUTCOMES, ACTIVITIES, AND
ASSESSMENT TOOLS
For the assessment project, you will be designing one course assignment, which will address at least one general
educational objective, one curricular objective (if applicable), and one or more of the course objectives. Please
identify these in the following table:
TABLE 5: OBJECTIVES ADDRESSED IN ASSESSMENT ASSIGNMENT
Course Objective(s) selected for assessment: (select from Table 4)
Apply research, low and high-stake writing to increase knowledge, and analytical skills through the composition of a research papers
on a writer and/and artist related to Latin American and Caribbean cultures
Curricular Objective(s) selected for assessment: (select from Table 2)
N/A
General Education Objective(s) addressed in this assessment: (select from Table 3)
(1) Communicate effectively through reading, writing, listening and speaking.
(2) Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decisions.
(3) Use information management and technology skills effectively for academic research and lifelong learning
In the first row of Table 6 that follows, describe the assignment that has been selected/designed for this project.
In writing the description, keep in mind the course objective(s), curricular objective(s) and the general education
objective(s) identified above,
The assignment should be conceived as an instructional unit to be completed in one class session (such as a lab) or
over several class sessions. Since any one assignment is actually a complex activity, it is likely to require that
students demonstrate several types of knowledge and/or thinking processes.
Also in Table 6, please
a) identify the three to four most important student learning outcomes (1-4) you expect from this assignment
b) describe the types of activities (a – d) students will be involved with for the assignment, and
c) list the type(s) of assessment tool(s) (A-D) you plan to use to evaluate each of the student outcomes.
(Classroom assessment tools may include paper and pencil tests, performance assessments, oral questions,
portfolios, and other options.)
Note: Copies of the actual assignments (written as they will be presented to the students) should be gathered
in an Assessment Portfolio for this course.
3(13)
TABLE 6: ASSIGNMENT, OUTCOMES, ACTIVITIES, AND ASSESSMENT TOOLS
Briefly describe the assignment that will be assessed:
It is this first high stake writing assignment which will be 25% of the final grade. The students are expected write a 4 to 5-page-essay
about an author, artist, performer, etc. related to Latin American and Caribbean cultures. (See attachment 1 for details on the
Assignment ). The assignment is scaffolded and low stake writing assignments in the discussion board (in Blackboard) will prepare
them for the first draft which will be revised by the instructor and returned to the student for improvement and submission for final
grading. It will then be presented for Peer Review. (See Appendix I for detailed description of the assignment)
Desired student learning outcomes
for the assignment
(Students will…)
List in parentheses the Curricular
Objective(s) and/or General
Education Objective(s) (1-10)
associated with these desired learning
outcomes for the assignment.
Gen-Ed objective
(1) Communicate effectively through
reading, writing, listening and speaking.
(2) Use analytical reasoning to identify issues
or problems and evaluate evidence in order
to make informed decisions.
(3) Use information management and
technology skills effectively for academic
research and lifelong learning
Curricular objectives
Briefly describe the range of
activities student will engage in
for this assignment.
(1) Attend a library session where they
will be guided to reliable resources:
databases, journals, books, etc.
(2) Research and gather information
about the chosen topic.
(3) Write an outline with bibliography
(4) Write a draft with proper citation in
MLA style
(5) Revise the draft following the
instructor’s suggestions
6) Post final version for Peer Review
N/A
What assessment tools will be
used to measure how well
students have met each learning
outcome? (Note: a single
assessment tool may be used to
measure multiple learning
outcomes; some learning
outcomes may be measured using
multiple assessment tools.)
Rubric (See Appendix II)
(1) Introducing the idea: Problem
statement (15 points)
(2) Body: Flow of the report (20 Points)
(3) Coverage of content (20 points)
(4) Clarity of writing and technique
Writing is crisp, clear, and succinct. (20
points)
(5) Conclusion: synthesis of ideas (15
points)
(6) Citations/References: Proper MLA
format (10 points)
PART III. ASSESSMENT STANDARDS (RUBRICS)
Before the assignment is given, prepare a description of the standards by which students’ performance will be
measured. This could be a checklist, a descriptive holistic scale, or another form. The rubric (or a version of it) may
be given to the students with the assignment so they will know what the instructor’s expectations are for this
assignment.
Please note that while individual student performance is being measured, the assessment project is collecting
performance data ONLY for the student groups as a whole.
TABLE 7: ASSESSMENT STANDARDS (RUBRICS)
Brief description of assignment: (Copy from Table 6 above)
It is the first high stake writing assignment which will be 25% of the final grade. The students write a 4 to 5-page-essay about an
author, artist, performer, etc. related to Latin American and Caribbean cultures. (See attachment 1 for details on the Assignment )
The assignment is scolded and low stake writing assignments in the discussion board (in Blackboard) will prepare them for the first
draft which will be revised by the instructor and returned to the student for improvement and submission for final grading. It will
then be presented for Peer Review. (See Appendix I for detailed description of the assignment)
Desired student learning
outcomes from the
assignment: (Copy from
Column 1, Table 6 above;
Assessment measures for
each learning outcome:
(Copy from Column 3,Table 6
above)
Standards for student performance:
The essays will be assessed using the rubric
(Attachment II)
Students will be asked to research
(1) Introducing the idea: Problem statement
4(13)
include Curricular and /or
General Education Objectives
addressed)
Gen-Ed objectives
(1) Communicate effectively
through reading, writing, listening
and speaking.
(2) Use analytical reasoning to
identify issues or problems and
evaluate evidence in order to make
informed decisions.
(3) Use information management
and technology skills effectively for
academic research and lifelong
learning
Curricular objectives
N/A
and gather information about the
chosen topic, i.e. a person related to
Latin American & Caribbean
cultures.
(1) write a paragraph and post it in
the Discussion Board in Blackboard
stating why the person was chosen
and what the students intends to
find out about the topic. (BB) and
(2) Write an outline with
bibliography and post it in the
Discussion Board in Blackboard
(3) Write a draft with proper
citation in MLA style and submit in
Safe Assign in Blackboard
(4) After grading, revise draft
following the instructor’s
suggestions
(5) Submit final version for grading
and post essay in Blackboard (DB)
for Peer Evaluation
(6) Peer evaluation will be posted
with respective essay.
5(13)
The topic is accurately introduced, and proper
groundwork is laid as to the specific direction of the
report.
(2) Body:Flow of the report (15 points)
The report progresses from general ideas to specific
conclusions. Transitions tie sections together, as well
as adjacent paragraphs
(3) Coverage of content (20 points)
The appropriate content in consideration is covered in
depth without being redundant.
(4) Clarity of writing and technique (20 points)
Writing is crisp, clear, and succinct. The writer
incorporates the active voice when appropriate.
Pronouns, modifiers, parallel construction are
properly used
(5) Conclusion: synthesis of ideas (20 points)
The author reached succinct and precise conclusions
based on the sources consulted and evidence stated in
the report. Conclusions are insightful and show
learning.
(6) Citations/References: Proper MLA format (10
points)
All needed citations were included in the report.
References matched the citations. Sources are cited
when specific statements are made
PART IV. ASSESSMENT RESULTS
TABLE 8: SUMMARY OF ASSESSMENT RESULTS
Use the following table to report the student results on the assessment. If you prefer, you may report outcomes
using the rubric(s), or other graphical representation. Include a comparison of the outcomes you expected (from
Table 7, Column 3) with the actual results. NOTE: A number of the pilot assessments did not include expected
success rates so there is no comparison of expected and actual outcomes in some of the examples below. However,
projecting outcomes is an important part of the assessment process; comparison between expected and actual
outcomes helps set benchmarks for student performance.
TABLE 8: SUMMARY OF ASSESSMENT RESULTS
Desired student learning outcomes:
(Copy from, Column 1,Table 6 above;
include Curricular and/or General
Education Objectives addressed)
Student achievement: Describe the group achievement of each
desired outcome and the knowledge and cognitive processes
demonstrated.
Gen-Ed objectives
See table 9
(1) Communicate effectively through reading,
writing, listening and speaking.
(2) Use analytical reasoning to identify issues
or problems and evaluate evidence in order
to make informed decisions.
(3) Use information management and
technology skills effectively for academic
research and lifelong learning
Curricular objectives
N/A
6(13)
TABLE 9. EVALUATION AND RESULTING ACTION PLAN
In the table below, or in a separate attachment, interpret and evaluate the assessment results, and describe the
actions to be taken as a result of the assessment. In the evaluation of achievement, take into account student
success in demonstrating the types of knowledge and the cognitive processes identified in the Course
Objectives.
A. Analysis and interpretation of assessment results:
What does this show about what and how the students learned?
16 students completed the essay, and their performance was rated according to six parameters
described in the rubric: 1) Introducing the idea: Problem statement (15 points); 2) Body: Flow of
the report (20 Points); 3) Coverage of content (20 points); 4) Clarity of writing and technique:
Writing is crisp, clear, and succinct (20 points); 5) Conclusion: synthesis of ideas (15 points); 6)
Citations/References: Proper MLA format (10 points). Student performance was scored using
the scoring rubric (see Appendix II).
The average of total points achieved by the 16 students tested was 86 for the draft and 90 for the
final version. Thus the average improvement from draft to final version was 4% while the
individual improvement ranged from 0 to 7.5%.
Chart 1
Grade average and percentage of students improvement from draft to final version
Students Essay ‐ Draft Essay ‐ Final % improv. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 80
85
90
90
85
85
85
85
88
88
90
90
83
88
88
75
80
85
90
90
88
88
88
90
93
93
95
96
90
95
95
85
0
0
0
0
2.5
2.5
2.5
4.2
4.4
4.4
4.5
5.4
5.8
6.2
6.2
7.5
Aver. 86
90
4
The total points a student could achieve adding up all six parameters, was 100.
This score was calculated as 20% of the final grade that consisted of other assignments such as
7(13)
1) Weekly reading, viewing, searching and discussing topics on the Discussion Board (20%); 2)
Two research papers (4-6 pgs.): FWA#1 and FWA#2 (20% each); 3) One peer review (400-600
words) of papers on various topics (replace final exam)* (10%); 4) Reflection paper *(replace
final exam with peer review) (10%); 6) Group Blog on a pre-determined cultural topic (5%); 7)
Moderation (including summary of weeks’ highlights) (5%).
Chart 2
Draft average and percent of points achieved in the categories of the rubric.
Introduction
Body
Content
Wrtg.Tech.
Conclusion
Citations
Draft average
13
17
16
18
13
8
Draft aver.%
87
86
82
91
87
81
Missing Pts.
Missing Pts.%
2
3
4
2
2
2
13
14
18
9
13
19
The average students’ performance in the essay draft essay ranged from 81% to 87%. However,
the individual performance ranged from 75% to 90%. This draft was a result of two previous
steps: a paragraph in the Discussion Board and an outline with a bibliography.
Students performance in the final version of the essay and its equivalence to course grades:
a. 96 points equivalent to “A” grade was achieved by one student
(6%)
b. 90 to 95 points equivalent to “A-“ grade was achieved by 9 students (56%)
c. 88 points equivalent to “B+” was achieved by 3 students
(19%)
d. 85 points equivalent to a “B” was achieved by two students
(13%)
e. 80 points equivalent to a “B-“ was achieved by one students
(6%).
Chart 2
Final essay average and percent of points achieved in the categories of the rubric.
8(13)
Introduction
Final average
Draft average %
Missing Pts.
Missing Pts.%
14
92
1
8
Body
Content
18
88
2
12
Wrtg.Tech.
19
95
1
5
Conclusion
19
93
1
7
Citations
14
91
1
9
9
86
1
14
Thus the overall performance of the students was from “very good” to “excellent.” However, all
areas specified in the rubric can be improved. The results broken down into the categories of the
rubric, show that improvement is needed in the citation area (14%) followed by the body (12%)
of the essay, then by the conclusion (9%); then by the introduction (9%); then by the writing
techniques (7%) and finally the content area (5%).
B. Evaluation of the assessment process:
What do the results suggest about how well the assignment and the assessment process worked both to
help students learn and to show what they have learned?
B1) Evaluation of students’ results
The results of the broken down version into categories stated in the rubric, shows us the areas
that can be improved. Students’ performance ranges from good to excellent. This is above a C
expectation, which is normally considered satisfactory.
B2) Evaluation of the assessment tools
The results obtained seem to indicate that the assessment tools used and the assessment process
undertaken have been successful in accurately determining our students’ writing and critical
thinking skills. Not only has it shown that all students met the expectation, but it has also
provided them with the appropriate tool that would facilitate their learning process. The students,
in fact, will use the same tool to write a peer review. Therefore, being exposed to this tool before
using it for the Peer Review is very helpful for them to work with it effectively.
C. Resulting action plan:
Based on A and B, what changes, if any, do you anticipate making?
Further actions
The overall average achieved by students on the high stake writing assignment shows more than
9(13)
satisfactory results, with 100 per cent of the students meeting the course expectations. However,
student performance may be further improved, especially in terms of the format of the essay
regarding citations, development of ideas, and reflection on the conclusion. The Assessment
Committee, in consultation with the faculty of the department, will discuss these results and
make recommendations concerning curriculum and classroom practices for the 2012-2013
academic year.
Conclusions and Action Plan
Twenty two students were originally registered in the class. Out of these 16 completed the
course with a “C” grade or better. The comparison of the results of the assignment assessed
with the final grade shows a discrepancy in the sense that the students performed better in the
assignment than they did in the overall work for the course. The essay#1 results could have
been even better if 4 students (25%) had revised the draft to achieve a better grade. This would
have increased the amount of students in the “B+” grade area. The average of total points
achieved by the 16 students who finished essay#1 ranged from 80 (B) to 90 (A-). According to
the scale, this percentile exceeds the expectation of a “C” grade. Therefore, other assignments
need to be closer monitored and assessment tools need to be developed to be used in those other
assignments to assess how improvement can be introduced. The comparison between the two is
a follows:
Grade
“A”
“A-“
“B+”
“B“
“B-“
“C+”
“C”
Essay #1
6% in essay#1
56% in essay#1
19% in essay#1
13%
6%
none
none
Final grade
none
38%
6%
24%
13%
13%
6%
Table 1: Final grade distribution
As seen in the chart below, the distributions of the final grades was: six students received an “A“
grade; one received a “B+” grade, 4 received a ”B”; 3 received a “B-“ and 3 received a “C+” and
one received a “C” grade.
Final Grade distribution 40
30
20
10
0
A‐
B+
B
B‐
C+
A-
B+
B
B-
C+
C
6
38%
1
6.3%
4
25%
2
13%
2
13%
1
6.3%
10(13)
C
The action plan for the future is to continue using the rubric for assessment of the high stake
writing assignments and to develop new assessment tools for the other assignments in LS402. In
order to have an overall improvement of students’ performance, currently ranging from 0 to
7.5%, the students must understand where they need improvement. To achieve this, and to use
the rubric more efficiently, the instructor needs to return the draft with the rubric and the grading
in each category. Additionally, a scoring scale has to be developed or it has to be decided by the
assessment committee if the same scoring scale can be used for both language and culture
courses.
11(13)
APPENDIX I
Detailed instructions for FWA#1
Summary:
In this first high stake writing assignment (FWA#1, Formal Writing Assignment) which will be 20% of the final
grade you will be expected to write a 4 to 5-page-essay (font Arial 10) about the life and work of an author, artist,
performer, etc. related to Latin American and Caribbean cultures. The assignment is started as a low stake writing
assignments in the discussion board (in Blackboard), which will prepare you for the first draft. The draft will be
revised by the instructor and returned to you for improvement and submission for final grading. You will then
present it for Peer Review (10% of final grade). There are three reflections phases built into the writing process,
which will be consolidated at the end of the semester into a Final Reflection Paper (10% of final grade).
Heading:
Course: LS402 - Latin American and Caribbean Cultures
FWA#1: People & Country
Title: (title of your essay)
Submitted: by (your name) Date submitted:
Sequence:
Step one: Select one person related to Latin American and Caribbean cultures. (See list of suggestions in
WRITING in Blackboard)
1. Write a short text (one paragraph) giving some information about the person, the country s/he comes from and
explain what you knew about her/him, what you want to find out, and the reason why you decided to write about
that person.
2. Post your text in the Discussion Board (DB) in the Forum “FWA#1: People/Country.” Due by Week#2.
3. Read the postings of your classmates and reply in writing (reply).
4. Read the comments your classmates wrote on you postings and reply.
5. After you read the comments of your peers in the DB, complete the first part of Reflection integrating your
paragraph in 1. above and what you learned from comments of peers (see Reflection #1: What? Why? in DB
and eP template: last tab) and post them in DB > Forum “Reflection1”Due by Week#3
Step two: Follow this link for guidance on Pre-Draft Outline. Write an outline with bibliography for your FWA#1.
List all the sources using MLA Works Cited format. Post in DB > Forum “FWA#1: People/Country.” Due by
Week#4.
Step three: Write a draft of 4-5 pages for FWA#1. Make sure to visit CUNY WriteSite » Writing Projects »
Stages of Writing.
You may use the CUNY Write Site to draft your paper or you may prepare it in a word processing program. Submit
it to tutoring if necessary. Include the following in your draft:
1) Introductory paragraph with a clear thesis statement.
2) Explanation why you are interested in the person, where you first heard about her/him, etc.
3) Mini biography of the person and major accomplishments.
4) Information about the person’s country.
5) Description emphasizing what made this person so famous and what obstacles s/he had to overcome to achieve
his goals/dreams.
6) Conclusion: what you learned during the research you conducted: about the person and about Latin American
and Caribbean cultures.
Step four: Review the proofreading tips before submitting your draft, complete and print the revision
checklist (see Rubric), and submit it with the FWA#1 draft in BB > Assignments >SafeAssignment. Due by
Week#5.
Step five: The Professor will give you feedback/comments on the draft and return it for revision. Due by
Week#6.
Step six: Revise the paper and submit the final version. (4 to 6-page essay, double spaced, Arial, pitch 12)
bibliography and footnotes in MLA style. Due by Week#7.
Step seven: Be prepared to present this paper to the class for Peer Review.* Final FWA#1 to be posted by
Week#8 in BB > DB Forum “FWA#1: People/Country;”
Peer Review: after reading your peers FWA#1, choose one and write a formal review. Submit in BB >
Assignments >SafeAssignment on Due by Week#9 .
Note: See detailed instructions for the Peer Review, Reflection paper and for the 2nd. Formal Writing
Assignment (FWA#2) in the WRITING in Blackboard (20% of final trade).
12(13)
APPENDIX II
TOTAL
Body:
Flow of the
report
Coverage of
content
Clarity of writing
and technique
Conclusion:
synthesis of ideas
Citations/Referen
ces:
Proper MLA
format
14-15 points
The topic is
accurately
introduced,
and proper
groundwork is
laid as to the
specific
direction of
the report.
19-20 points
The report
progresses
from general
ideas to
specific
conclusions.
Transitions tie
sections
together, as
well as
adjacent
paragraphs.
16-18 points
There is a
good flow
between
sections, all
paragraphs
follow in a
logical order.
19-20 points
The
appropriate
content in
consideration is
covered in
depth without
being
redundant.
19-20 points
Writing is crisp,
clear, and
succinct. The
writer incorporates
the active voice
when appropriate.
Pronouns,
modifiers, parallel
construction are
properly used.
14-15 points
The author reached
succinct and
precise conclusions
based on the
sources consulted
and evidence
stated in the report.
Conclusions are
insightful and show
learning.
9-10 points
All needed
citations were
included in the
report. References
matched the
citations. Sources
are cited when
specific statements
are made.
100
to
90
16-18 points
All major
sections of the
pertinent
content are
included, and
are covered
well, or as
expected.
16-18 points
Writing is clear, but
sometimes too
wordy, or vague.
Paragraph or
sentence structure
is rarely repetitive.
8-9 points
Citations within the
body of the report
and a reference list
were provided.
Some formatting
problems exist, or
a few components
were missing
89
To
75
13-16 points
Writing is clear, but
too wordy.
Meaning is
sometimes
obscured.
Paragraph or
sentence structure
is too repetitive.
9-13 points
The author
provides
concluding remarks
that indicate an
analysis and
synthesis of ideas.
Conclusions are
not always
supported in the
body of the report.
7-9 points
The author
provides
concluding remarks
that indicate some
analysis and
synthesis of ideas.
Conclusions are
not supported in
the body of the
report.
0-7 points
There is no
indication the
author tried to
synthesize the
information or
reach a conclusion
based on the body
of the report.
6-7 points
Most citations
within the body of
the report and a
reference list were
provided.
Formatting
problems exist,
and components
were missing.
74
to
61
Very Good
Introducing
the idea:
Problem
statement
10-13 points
Topic is
introduced,
and
groundwork is
laid as to the
general
direction of
the report.
Good
Excellent
Criteria
&
Rubric for assessment of a Formal Writing Assignment
9-10 points
Readers are
aware of the
overall
problem,
challenge, or
topic that is to
be examined.
13-16 points
There is a
basic flow
between
sections, but
not all
paragraphs
follow in a
logical order.
13-16 points
All major
sections of the
pertinent
content are
included, but
not covered in
as much depth,
or as explicitly,
as expected.
0-1 points
Neither
implicit nor
explicit
reference is
made to the
topic that is to
be examined.
0-13 points
The report
appears to
have no
direction, with
disjointed
subtopics.
0-13 points
Major sections
of pertinent
content have
been omitted
The writing
does not relate
to the topic.
Poor
60
0-13 points
0-5 points
to
Writing is
Citations included
0
convoluted, and it
in the report were
is hard to discern
not referenced.
what the writer is
Sources included
trying to express.
in the text were not
Misspelled words,
cited.
incorrect grammar,
and improper
punctuation are
used.
*adapted (2-12-09) from a version shared with a colleague from BMCC, who teaches this class at the BA online. It was modified on
9-28-10 to include the “very good” level. (L.B.Ellis)
13(13)
Download