Assessment of writing ability for LF 112 For the LA Faculty Cohort Anne-Marie Bourbon Spring 2011 During the spring 2011 semester, twelve students attending one course of LF112, beginning French II were assessed. They were tested for: completion of the task, comprehensibility of their writing, level of discourse, correctness of vocabulary, grammar accuracy, and mechanics as per the rubric attached. (Appendix 1) A. First assignment: Students were asked to write one essay in French as per the writing assignment attached. (Appendix 2) Results The data of 12 students who completed the written assessment in French was gathered. The results are as follows: Table 1: SCORING SHEET‐ LF 112 General Performance in Each Category Task completion 4 Maximum score Average # of Students Comprehensibility Level of Discourse Vocabulary Grammar Mechanics Total 4 4 4 4 4 24 3.42 3.00 2.67 2.25 1.83 1.83 15.00 12 12 12 12 12 12 12 The total points a student could achieve (adding up all six categories) was 24. The scale agreed upon beforehand by the Assessment Committee defined the following ranges: 16 points= student performance does not meet expectations; 7-12 points= student performance almost meets expectations; 13-18 points= student performance meets expectations; 19-24= student performance exceeds expectations. Table 2: Range # 0f Students Percentage OVERALL. Student performance ‐ 12 students Does not meet Almost meets expectations expectations 1‐6 7‐12 Meets expectations 13‐18 Exceeds expectations 19‐24 0 3 8 1 0% 25% 67% 8% Data indicate that 1 student was writing at a higher level than the one required by the course, 8 of them were writing at the required level, 3 of them almost met the required level and none of them did not meet expectations. 2 Table 3 Number of students’ performance in each category: B. Levels Task Completion Comprehensibility 4 6 4 3 5 4 2 1 4 1 0 0 Total 12 12 Level of Discourse Vocabulary Grammar Mechanics 1 0 0 0 6 5 1 1 5 5 8 8 0 2 3 3 12 12 12 12 Second assignment: About one month later students were asked to write one essay in French as per the writing assignment attached. (Appendix 3). The same rubric as for the first assignment was used. Results The data of 12 students was gathered. The results are as follows: Table 1: SCORING SHEET‐ LF112 = General Performance in Each Category Task completion 4 Maximum score Average # of Students Comprehensibility Level of Discourse Vocabulary Grammar Mechanics Total 4 4 4 4 4 24 2.83 2.75 2.46 2.58 2.08 2.21 14.92 12 12 12 12 12 12 12 The total points a student could achieve (adding up all six categories) was 24 as described above: 1-6 points= student performance does not meet expectations; 7-12 points= student performance almost meets expectations; 13-18 points= student performance meets expectations; 19-24= student performance exceeds expectations. Table 2: Range # 0f Students Percentage OVERALL. Student performance ‐ 31 students Does not meet Almost meets expectations expectations 7‐12 1‐6 Meets expectations 13‐18 Exceeds expectations 19‐24 0 4 5 3 0% 33% 42% 25% Data indicate that 3 students were writing at a higher level than the one required by the course, 5 of them were writing at the required level, 4 of them almost met the required level and none of them did not meet expectations. 3 Table 3 Number of students’ performance in each category: Levels Task Completion Comprehensibility Level of Discourse Vocabulary Grammar Mechanics 4 3 2 1 Total 4 3 2 3 1 2 3 4 5 3 2 2 5 4 3 5 7 7 0 1 2 1 2 1 12 12 12 12 12 12 Data shows that more instruction does not determine an overall improvement in performance. In fact results show a very slight lowering of results between the first and second assignment: Average performance for all categories: First assignment: 15.00 % Second assignment: 14.92 % Students’ achievement: First assignment: 1 student (8 %) exceeded expectations, 8 students (67%) met expectations, 3 students (25%) almost met expectations, none did not meet expectations Second assignment: 3 students (25 %) exceeded expectations, 5 students (42%) met expectations, 4 students (33%) almost met expectations, none did not meet expectations 12 students (39%) exceeded expectations. 9 students (29%) met expectations This might be due to the fact that the four elements of language acquisition (reading, writing, speaking and understanding) become more complex as the term proceeds. Also the second assignment was more demanding than the first, asking students to show their knowledge in using three different tenses (present, past and future). 4 APPENDIX 1 Level 2 Writing Tasks - Holistic Rubric Exceeds expectations Meets expectations Task completion Superior completion of the task, content appropriate, ideas welldeveloped and well organized 4 points Completion of the task, content appropriate, ideas adequately developed Level of Discourse Vocabulary Grammar Mechanics Comprehensibility Text readily comprehensible, requiring no interpretation on the part of the reader Variety of complete sentences and of cohesive devices Rich use of vocabulary Control of basic language structures 4 points 4 points Few or no errors in spelling, use of punctuation and/or capitalization 4 points Text comprehensible, requiring minimal interpretation on the part of the reader Emerging variety of complete sentences, some cohesive devices 4 points 4 points Adequate and accurate use of vocabulary for this level Partial completion of the task, content mostly appropriate, ideas are undeveloped 3 points Text mostly comprehensible, requiring interpretation on the part of the reader 2 points 3 points Use of complete sentences, some repetitive, few cohesive devices 2 points Does not meet expectations Minimal completion of the task, and/or content frequently inappropriate 0-1 point Text barely comprehensible 0-1 point Mostly accurate spelling, use of punctuation and/or capitalization 3 points 3 points 3 points Almost meets expectations Emerging control of basic language structures 2 points Predominant use of complete yet repetitive sentences, no or almost no cohesive devices 0-1 point 3 points Somewhat inadequate and/or inaccurate use of vocabulary and too basic for this level 2 points Emerging use of basic language structures Inadequate and/or inaccurate use of vocabulary Inadequate and/or inaccurate use of basic language structures 0-1 point 0-1 point Somewhat inaccurate spelling, use punctuation and/or capitalization 2 points 2 points Inaccurate spelling, use punctuation and/or capitalization 0-1 point 5 Appendix 2 FIRST WRITING ASSIGNMENT FOR ASSESSMENT LF112 FALL 2010 Writing assignment: Directions: Pick one topic at random and write a short passage in French of at least 60 words. Be sure to satisfy the purpose of the task as described by the rubric given to you. The structures or expressions used should be connected logically, and should demonstrate a wide range of vocabulary, originality and knowledge of the language. [24 points] 1. Your activities: Describe what you did last weekend. Use the passé composé Got up late Did some house chores Went shopping Played some sports Exercised Ate at the restaurant or at home Went to the cinema/theater/a party with friends 2. Shopping: Use present tense. Describe what you need to buy, and why Clothing, gifts for the holidays, food What stores you go to What items do you purchase; for whom How much do you pay for your purchases How do you pay How do you get home 3. Holidays: you are planning your next vacation; Use the futur proche and explain:. When will you be on vacation Where you plan to go How will you travel there If you will be alone or with friends or family Are you going to travel abroad if so where What will you do What will you visit Whom will you visit Do you plan to bring back souvenirs for your friends/family When you will return 6 Appendix 3 SECOND WRITING ASSIGNMENT FOR ASSESSMENT OF LF112 Directions: write three short passages in French of at least 25 words each on the following topics. Be sure to satisfy the purpose of the task as described by the rubric given to you. The structures or expressions used should be connected logically, and should demonstrate a wide range of vocabulary, originality and knowledge of the language . Give as much details as possible in complete French sentences and avoid repetitions. You must write at least a minimum of 75 words for the whole assignment. 1. Ordering a meal in a French restaurant: write a dialog with the waiter who will offer you what he has; choose your menu. Use the present. The waiter offer you some appetizer Then an entree Some vegetable Beverages Desserts Then you ask for the check You pay and leave 2. Your activities last week-end: use the passé composé 2. Got up late Did some house chores Went shopping Played some sports Exercised Ate at the restaurant or at home Went to the cinema/theater/a party with friends Holidays: you are planning your next vacation; Use the futur proche and explain. When will you be on vacation Where you plan to go How will you travel there If you will be alone or with friends or family Are you going to travel abroad if so where What will you do What will you visit Whom will you visit Do you plan to bring back souvenirs for your friends/family When you will return