Assessment Report, LG112PNET Elementary German II, Fall 2015 2. Date submitted:

advertisement
Assessment Report, LG112PNET Elementary German II, Fall 2015
1. Department submitting report:
Foreign Languages & Literature
2. Date submitted:
December 23, 2015
3. Date of assessment (i.e. fall 2015):
Fall 2015
4. Course(s) assessed:
LG112PNET Elementary German II
5. General education outcome(s) assessed:
X 1. Communicate effectively through reading, writing, listening and speaking
2.
Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decisions
3.
Reason quantitatively and mathematically as required in their fields of interest and in everyday life
4.
Use information management and technology skills effectively for academic research and lifelong learning
5.
Integrate knowledge and skills in their program of study
6.
Differentiate and make informed decisions about issues based on multiple value systems
7.
Work collaboratively in diverse groups directed at accomplishing learning objectives
8.
Use historical or social sciences perspectives to examine formation of ideas, human behavior, social institutions, or social processes
9.
Employ concepts and methods of the natural and physical sciences to make informed judgments
10. Apply aesthetic and intellectual criteria in the evaluation or creation of works in the humanities or the arts
6. Curriculum outcome(s) assessed (if applicable):
N/A
7. Course assessment method: evidence/measurable data:
a. Describe artifacts reviewed:
Writing samples of students in the final exam.
b. Number of artifacts:
3
c. Number of course sections:
One (13 students were assessed)
8. Rubric:
LG 112 Writing Task Analytic Rubric
Exceeds expectations
Meets expectations
Almost meets
expectations
Does not meet
expectations
Task
Completion
Superior completion of the
task. Students fully address
the information requested,
and provide additional
details
20-25 points
Completion of task.
Students fully address
the information provided,
but do not provide
additional details
14-19 points
Partial completion of
task. Students
complete no more than
60% of the information
requested
9-13 points
Minimal completion of
task. Students
complete less than
40% of the information
requested.
0-12 points
Level of
Discourse
Sentences are fully
developed and interconnected cohesive
devices, i.e.coordinating
conjunctions such as and,
but, etc are used
20-25 points
Sentences are fully
developed. Cohesive
devices, are sporadically
used
Sentences are
somewhat complete.
Rare use of cohesive
devices
Sentences are mostly
incomplete. No use of
cohesive devices
14-19 points
9-13 points
0-12 points
Rich use of vocabulary
Adequate and accurate
use of vocabulary
20-25 points
14-19 points
Somewhat inadequate
and/or inaccurate use
of vocabulary
9-13 points
Inadequate and/or
inaccurate use of
vocabulary
0-12 points
Perfect control of the
syntactic structures
required.
Adequate control of the
syntactic structures
Some grammatical
imperfections (≤ 5)
Emerging control of
the syntactic structures
Several grammatical
imperfections (≤12)
20-25 points
14-19 points
9-13 points
Minimal control of the
syntactic structures
learned. Numerous
grammatical
imperfections (>12)
0-12 points
Vocabulary
Grammar
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 1 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
12. Results:
The question I asked in the assessment plan for LG112 was: “Does the amount of material presented and
the amount of exposure to the language affect students’ performance?” With the help of the data
collected this question should be answered. As shown in the table below, the overall writing grades in the
final were higher than in the midterm, with the exception of two students out of 13 who completed the
writing assignment. The average of the midterm was 78 as opposed to the final which was 92. This is an
increase of 14 points in the average (See the averages in the chart below highlighted in red right below
the title). Individually the performance of 6 of the students has not met the expectation of 78% in the
midterm. However, in the writing activity in the final exam all students met the expectation ranging above
79%. The categories of the writing assignment were “Task Completion,” “Level of Discourse,”
“Vocabulary,” and “Grammar.”
Midterm Writing
Final Writing
T.com
L.dis
Vocab.
Gram.
100%
16%
T.com
L.dis
Vocab.
Gram.
Total
16%
25
25
25
25
Total
Total
25
25
25
20
Total
Total
19
20
19
19
78
13
25
24
23
21
92
15
20
16
15
15
66
11
25
25
22
19
91
15
16
14
18
18
66
11
25
22
22
19
88
14
22
19
22
19
82
13
25
25
25
22
97
16
14
15
15
16
60
10
25
19
19
19
82
13
24
24
24
22
94
15
25
25
25
22
97
16
15
20
15
20
70
11
25
25
22
22
94
15
14
15
15
16
60
10
25
25
25
22
97
16
24
25
25
24
98
16
25
25
25
22
97
16
20
25
20
22
87
14
19
19
19
22
79
13
21
24
21
20
86
14
25
25
22
22
94
15
25
20
20
20
85
14
25
25
22
22
94
15
19
24
23
22
88
14
25
25
25
22
97
16
18
20
19
18
75
12
25
25
25
19
94
15
The chart below represents a comparison between the total grades above in a graphic form.
110
100
90
80
70
60
50
40
30
20
10
0
LG112, F-15, Writing: MidTerm VS Final
91
1
97
88
2
97
94
97
97
82
3
4
94
94
97
94
79
5
6
7
Mid-Term
QCC Committee on Curriculum Guide, Revised 10/26/15
8
Final
9
10
11
12
13
Page 2 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
Midterm Writing
T.com
L.dis
Vocab.
Final Writing
Gram.
100%
16%
T.com
L.dis
Vocab.
Gram.
Total
16%
25
25
25
25
Total
Total
25
25
25
25
Total
Total
19
20
19
19
78
13
25
24
23
21
92
15
76%
80%
76%
76%
78%
92%
84%
92%
100%
96%
The category in which the students’ performance was lower in the midterm were in “task completion,”
“vocabulary” and “grammar.” The category the students’ performance was lower in the final exam was in
“grammar.” The best performance in both exams was in “level of discourse” and in the final in “task
completion.” This means that grammar is the category which needs more improvement which is followed
by vocabulary with the poorest results.
The table below compares the midterm grades with the final exam grades and the course final grades.
The latter is composed of 10% of dictations, 20% of quizzes, 30% of the midterm, 5% of the oral exam,
20% of the final exam, and 15% of participation and online work. The average of the midterm was 78 and
the average of the final 83. This is an increase of 5 points in the average of the class. The average of the
class in the midterm is one point below the expectation, which ranges from 79% to 89%. But in the final
exam the average of 83 shows that the expectation was met. However, looking at the students’ individual
performance it shows that 6 students did not meet the expectations in the midterm, but in the final only
three students did not reach the 79% of the expectations. One of these three students did not reach the
61% passing grade in the final exam. Even though overall there was an improvement of the class
average, not all students performed better in the final exam. Of the four students who performed better in
the midterm than in the final, three did not meet the expectation in the final: two almost met the
expectations with 72 and 75 and one did not reach 61%, which is the passing grade.
Midterm grades, compared to final exam grades and course final grade.
Midterm (5 cat.+Total)
Final Exam (5 cat.+Total)
List.
Com.
30%
List.
Com.
Voc.
Gram.
Read.
Writ.
Voc.
Gram.
Read.
Writ.
20%
Final
16
16
36
16
16
Total
16
16
36
16
16
Final
Grade
16
12
25
14
13
78
14
15
28
11
15
83
89
12
11
34
11
11
79
14
15
30
12
15
86
89
16
15
28
16
11
86
13
15
26
11
14
79
85
16
8
9
13
13
59
13
13
18
12
16
72
80
16
11
5
8
10
50
13
15
22
12
13
75
84
16
15
36
16
15
98
16
15
34
11
16
91
92
16
11
35
12
11
85
15
16
31
11
15
89
94
15
18
30
11
16
89
90
Av.
16
7
28
15
10
76
16
16
35
16
16
99
14
12
33
14
16
88
97
16
14
21
12
14
77
10
11
19
5
12
57
73
16
10
6
16
14
62
16
16
26
11
15
83
86
16
10
22
10
14
72
15
13
28
10
15
81
91
16
14
35
15
14
94
16
15
36
15
15
99
97
16
10
29
16
12
83
15
15
35
10
16
91
95
As stated above, the course final grade shown in the last column of the table above is the sum of other
elements, of which the final exam is only 20%. This explains the difference in the average obtained at the
end of the semester. With the exception of one student, who did very well in the final exam (99), the final
grades of the students were higher than the grades in the final exam.
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 3 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
The chart below represents the midterm grades compared to the grades in the final exam with the grades
of the course in a graphic form.
LG112, F-15: Mid-Term VS Final Exam
110
100
92
89
90
85
94
97
97
90
86
84
80
80
95
91
73
70
60
50
40
30
20
10
0
1
2
3
4
5
MidTerm
6
7
Final Exam
8
9
10
Final Grade
Mid-Term (5 cat.+Total)
11
12
13
Final Exam (5 cat.+Total)
List.
Com.
Voc.
Gram.
Read.
Writ.
1
2
3
4
5
30%
List.
Com.
Voc.
Gram
.
Read.
Writ.
1
2
3
4
5
20%
Final
16
16
36
16
16
Total
16
16
36
16
16
Final
Grade
16
12
25
14
13
78
14
15
28
11
15
83
89
100%
75%
69%
88%
81%
88%
94%
78%
69%
94%
Av.
The chart below represents the numbers above in a graphic form.
38
36
34
32
30
28
26
24
22
20
18
16
14
12
10
8
6
4
2
0
LG112, F-15, Midterm (categories) VS Final
28
14
15
15
11
1
2
Max.Points
3
Aver.Midterm
QCC Committee on Curriculum Guide, Revised 10/26/15
4
Aver.Final
5
Page 4 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
Comparing the averages of the categories in the midterm with the same categories in the final exam it is
clear that the average performance in the “listening comprehension” and “reading” categories were higher
in the midterm, while “vocabulary,” “grammar,” and “writing” categories were higher in the final exam.
The worst performance in the midterm was in grammar (69%), while the worst performance in the final
was in reading (69%). The best performance in the midterm was in the listening comprehension (100%)
and in the final the best performance was in both vocabulary and writing (94%).
13 Status – degree to which students have met the general education outcome and/or curricular
outcome (use a scale):
The students general education outcome presented in the assessment plan was:
Communicate effectively through reading, writing, listening and s peaking.
The speaking part was performed individually in an oral exam worth 5% of the final grade. The
listening assessment was done in the first part of the exam, i.e. 1) Listening Comprehension, which
is 16% of the final exam. Students must reach 9.8%, but ideally 12.7%. The average was14, and
the lowest received by a student was 10, which is just above the 9.8% needed. 2) The grammar
part provides the basis necessary to the students to be able to perform well in the 4 skills of
reading, writing, listening, and speaking. In grammar, worth 36% of the final exam, the students
must reach 22%, but ideally 28.5%. The average was 28 and the lowest 18. As stated above the
grammar is the part that needs the biggest improvement. 3) In the vocabulary part, worth 16% of
the final exam grade, students must reach 9.8%, but ideally 12.7%. Like grammar, this part also
provides the students with the foundation to perform well in reading, writing, listening, and
speaking. The average achieved by the students in the final was 15 and the lowest 11, which is
slightly below the minimum needed on 9.8. 4) Reading, worth 16% of the final exam, in which
students must reach 9.8%, but ideally 12.7%. The average achieved was 11, which is below the
ideal, and the lowest was 5 also well below the minimum needed. Reading is the part that needs
to be worked more intensely. 5) Writing, worth 16% of the final exam, in which students must reach
9.8%, but ideally 12.7%. The average achieved was 15, well above the ideal, and the lowest was
12 also above the minimum needed.
14. Conclusion and Action Plan: what did you learn from the assessment and how will you use
these findings?
The question in the assessment plan was: Does the amount of material presented and the amount of
exposure to the language affect students’ performance?” The simple answer is yes. The data shows that
the students’ performance in grammar and reading were the lowest overall. Therefore, in order to
have students “Communicate effectively through reading, writing, listening and speaking ” it will be
important that in the future more reading assignments will be given to the students during the
semester, as well as more assessment of reading comprehension has to be offered in quizzes. The
grammar deficit will improve also if more reading is introduced, provided the comprehension of the
texts also focus on grammar as well as on content. Similarly to the preparatio n of the oral exam
for which we provide students with situations and possible questions, which they will use to play a
role within a context, we should provide reading texts on a regular basis. In addition to offering
more reading texts it is also important to put more emphasis on the mastering of vocabulary which
will help students understand the texts better.
15. List attachments, if any.
Description
a. Assessment Plan (with rubric)
b. Students’ writing samples (4)
QCC Committee on Curriculum Guide, Revised 10/26/15
File Name
Same document
Same document
Page 5 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
*
*
QCC Committee on Curriculum Guide, Revised 10/26/15
*
Page 6 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
Appendix #1
Assessment plan for LG112PNET, Fall 2015 by L. B. Ellis
(1) The total number of students to be assessed 15
(2) Student learning outcomes and the General Education Outcomes that are related to
those student learning outcomes
General Education Outcome
1. Communicate effectively through reading, writing, listening and speaking.
Students Learning Objectives
Describe in oral and written form about their own and others’ daily activities.
Describe in oral and written form rudimentary past events.
Narrate and/or provide information about themselves and others.
Accomplish basic communicative tasks (shopping, ask for directions, select adds for
apartment, etc.) by relying on guided input.
(3) A description of the assignment(s) that students will complete
Question:
Does the amount of material presented and the amount of exposure to the
language affect student performance?
Students will complete a Midterm exam, which will be prepared in the same format as the
final exam, and will be divided in 5 main categories. It will cover 3 lessons, i.e. Lesson#7, 8
and 9. Detailed emphasis will be given to the written part. (see rubric below). The five
categories and their respective percentage are:
1) Listening Comprehension (16%)
2) Grammar (36%)
3) Vocabulary (16%)
4) Reading (16%)
5) Writing (16%)
The result of the Midterm-exam will be analyzed to assess which of the 5 categories is the
weakest and needs more emphasis to improve the students’ performance in the final exam.
The weakest categories will be worked on between the Midterm and the Final exam. The
“Writing Part” of the Midterm exam will be graded according to the rubric provided and will
be compared with the written part of the final exam also graded by the same rubric. The
final exam will be in the same format as the Midterm, but it will cover 6 lessons, instead of
3 (Midterm), i.e. Lesson#7, 8, 9, 10, 11, 12.
(4) An explanation of how you will know that students have completed the assignment(s) to
your satisfaction
The instructor will know if the students have completed the assignment(s) if their performance
reaches at least 61% of the whole assignment. This means that the students will pass. However,
since a “C” grade or better is necessary to proceed to the next level of language learning, the
performance almost meets expectations when they complete between 61% and 78%. Therefore,
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 7 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
in foreign languages the expectations is higher, i.e. 79% to 89% is the range in which the
students’ performances meets expectations. Above 90% means the performance exceeds
expectations.
By comparing the outcomes of the two exams that are designed in the same format, the
instructor will assess in which of the two exams the students performed better overall and
within the categories. The instructor needs to verify if the s tudents reached at least 61% in
each category, i.e. 1) Listening Comprehension (16%: students must reach 9.8%, but
ideally 12.7%); 2) Grammar (36%: students must reach 22%, but ideally 28.5%); 3)
Vocabulary (16%: students must reach 9.8%, but ideally 12.7% ); 4) Reading (16%:
students must reach 9.8%, but ideally 12.7%); 5) Writing (16%: students must reach 9.8%,
but ideally 12.7%).
Detailed attention will be given to the “Writing” part, for which a rubric will be used to
assess which of the categories needs improvement: Task Completion,
Level of Discourse, vocabulary, and grammar.
The “Writing assignment” for the Midterm has two c hoices.
Choose a) of b):
a) Vorstellung: So bin ich (Introduction)
Write 10 sentences (+- 80 words) about yourself, include your family, where you live,
your favorite activities in your free time, and/or describe your favorite person.
b) Mein Sommer 2015 (My summer 2015)
Write 10 sentences (+- 80 words) about what you did last summer (using the verb in
a past tense, preferable in the present perfect)
The final exam will have also two options in the “Writing” part, but the topic will be different.
(5) A listing of the timeline for the assessment
The Midterm will be given on Week#9, i.e. October 27 and 28, 2015.
The final exam will be given on Week 15, i.e. December 13-14, 2015.
(6) Tools used in the assessment: see rubric below and the M idterm exam in the attachment.
LG 112 Writing Task Analytic Rubric (See rubric on page 10 above)
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 8 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
Appendix 2 - Writing Samples
Sample#1
Sample#2
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 9 of 10
Assessment Report, LG112PNET Elementary German II, Fall 2015
Appendix 2 - Writing Samples
Sample#3
QCC Committee on Curriculum Guide, Revised 10/26/15
Page 10 of 10
Download