Using Standards Based Descriptors on Student Assessments Kimberly D. Lackey Spanish III-IV Eureka High School Do students react to the results of an assessment differently if they are given a descriptor (below basic, basic, proficient, advanced) instead of a letter grade? • Letter grades are starting to seem outdated • 90% • Need for students in advanced classes to have something to strive towards Context • • • • Classes / Students PLC / Teachers WL Department / Administrators District Grading Scale / Infinite Campus Research • A Repair Kit for Grading: 15 Fixes for Broken Grades by Ken O’Connor • http://www.oconnorgrading.com/index.php - Ask the Grade Doctor • How to Grade for Learning K-12 by Ken O’Connor • Rockwood Spanish Curriculum • Performance Assessment for Language Students rubrics (PALs) from Fairfax County, VA Possible Titles for Performance Standard Levels Advanced Advanced Above Standard Exceptional Consistently Proficient Proficient At Standard Proficient Usually Partial Minimal Approaching Approaching Progressing Below Well Below Beginning How to Grade for Learning, Ken O’Connor, 2002, page 72 Sometimes Seldom EHS WL Department Titles for Performance Standard Levels • Same as MAP test • Each gives a description of the student’s performance / ability related to the standard Advanced Proficient Basic Below Basic Link to Percentages Traditional School Approach Standards-Based Approach 90-100% Outstanding / Excellent 95-100% 80-89% Above Average / 85-94% Good Proficient 70-79% Average / Satisfactory Basic 60-69% Below Average / 74% or below Poor Below Basic 59% or below Failing / Unacceptable Far Below Basic? 75-84% Advanced A year-long process 1) Quizzes (September) 2) Performance Assessments (late September) 3) Listening and Reading Assessments scoring guide (November) 4) Grammar Assessment scoring guide (January) 5) Vocabulary Assessment scoring guide (March) 1) Using the terms (in addition to percentages, instead of letter grades) on quizzes. Buy in from PLCs, discussed with department. 2) Reformatting Scoring Guides for performance assessments Español IV, Capítulo 7 (En el restaurante) GCA: Hablar, Simulated Conversation Interpersonal Speaking Language Control Vocab. Fluency Comprehensibility Task completion 5 50 6 7 53.3 57.7 Below Basic Does not complete the task. Responds inappropriately to most parts/prompts of the conversation. 8 60 9 63.3 10 11 12 67.7 70 73.3 Basic Partially addresses and/or completes the task. Responds inappropriately to some parts/prompts of the conversation. Speech halting and uneven with long pauses or incomplete thoughts. Speech choppy and/or slow with frequent pauses; few or no incomplete thoughts. 13 76.6 14 80 15 16 17 83.3 86.7 90 Proficient Appropriately addresses and completes the task. Responds appropriately and fully to all or almost all parts/prompts of the conversation. 19 20 96.7 100 Advanced Fully addresses and completes the task. Responds fully and appropriately to all or almost all parts/prompts of the conversation. Adds details and elaborates on ideas. 1 2 3 4 Message barely comprehensible, Message mostly comprehensible, Message comprehensible, Message readily comprehensible, requiring frequent interpretation; requiring interpretation; requiring minimal interpretation; requiring no interpretation; pronunciation may frequently pronunciation may occasionally pronunciation does not interfere pronunciation enhances interfere with communication. 1 interfere with communication. 2 with communication. 3 communication. 4 Somewhat fluent speech with some hesitation but speaker manages to continue and complete 1 2 thoughts. 3 Inadequate and/or inaccurate use Somewhat inadequate and/or Adequate and accurate use of of vocabulary. inaccurate use of vocabulary; too vocabulary for level IV. basic for level IV. 1 2 3 Emerging use of basic language Emerging control of basic language Control of basic language structures. (Used correctly about structures. (Used correctly about ¾ structures. (Used correctly most of ½ of the time) of the time). the time, not all of the time). 1 2 3 18 93.3 Fluent and natural speech with few pauses or false starts. 4 Rich use of vocabulary and appropriate use of idiomatic expressions. 4 Excellent control of basic structures withpossible use of advanced language structures. 4 Comentario: _____________________________________________________________________________________________________________________ ________________________________________________________________________________________________________________________________ ________________________________________________________________________________________________________________________________ Español IV, Capítulo 7 (En el restaurante) GCA: Hablar, Simulated Conversation Interpersonal Speaking Language Control Vocab. Fluency Comprehensibility Task completion 5 50 6 7 53.3 57.7 Below Basic Does not complete the task. Responds inappropriately to most parts/prompts of the conversation. 8 60 9 63.3 10 11 12 67.7 70 73.3 Basic Partially addresses and/or completes the task. Responds inappropriately to some parts/prompts of the conversation. Speech halting and uneven with long pauses or incomplete thoughts. Speech choppy and/or slow with frequent pauses; few or no incomplete thoughts. 13 76.6 14 80 15 16 17 83.3 86.7 90 Proficient Appropriately addresses and completes the task. Responds appropriately and fully to all or almost all parts/prompts of the conversation. 19 20 96.7 100 Advanced Fully addresses and completes the task. Responds fully and appropriately to all or almost all parts/prompts of the conversation. Adds details and elaborates on ideas. 1 2 3 4 Message barely comprehensible, Message mostly comprehensible, Message comprehensible, Message readily comprehensible, requiring frequent interpretation; requiring interpretation; requiring minimal interpretation; requiring no interpretation; pronunciation may frequently pronunciation may occasionally pronunciation does not interfere pronunciation enhances interfere with communication. 1 interfere with communication. 2 with communication. 3 communication. 4 Somewhat fluent speech with some hesitation but speaker manages to continue and complete 1 2 thoughts. 3 Inadequate and/or inaccurate use Somewhat inadequate and/or Adequate and accurate use of of vocabulary. inaccurate use of vocabulary; too vocabulary for level IV. basic for level IV. 1 2 3 Emerging use of basic language Emerging control of basic language Control of basic language structures. (Used correctly about structures. (Used correctly about ¾ structures. (Used correctly most of ½ of the time) of the time). the time, not all of the time). 1 2 3 18 93.3 Fluent and natural speech with few pauses or false starts. 4 Rich use of vocabulary and appropriate use of idiomatic expressions. 4 Excellent control of basic structures withpossible use of advanced language structures. 4 Comentario: _____________________________________________________________________________________________________________________ ________________________________________________________________________________________________________________________________ ________________________________________________________________________________________________________________________________ 3) Expanding the scoring guide format for use with listening and reading assessments Hora ______ Nombre ______________________________________________________________ #_______ Español IV, Capítulo 8 La convivencia y la aculturación GCA: Leer Main Idea Analysis / Meaning Supporting Details summary from context 50% 3 54.6% 59.1% 4 5 Below Basic Unable to accurately identify details from the reading selections. (6 or fewer correct) 1 63.6% 6 68.2% 7 Basic 72.7% 8 Accurately identifies minor details from portions of the reading selections. (7-8 correct) 2 77.3% 9 81.8% 86.4% 10 11 Proficient Accurately identifies minor details from the majority of the reading selections. (9-10 correct) 3 90.1% 12 95.5% 100% 13 14 Advanced Accurately identifies minor details from the all or almost all of reading selections. (11-12 correct) 4 Identifies accurate meaning for one or fewer words based on context of selection. Identifies accurate meaning for some words (2-3) based on context of selection. 1 Attempts to define terms Defines terms presented in presented in article, but errors article with some errors in in comprehension impede comprehension. communication. 1 Unable to demonstrate accurate interpretation of the main ideas of the reading selection. 0 Identifies accurate meaning for most words (4-5) based on context of selection. 2 3 Defines terms presented in article with few errors in comprehension. 2 Identifies accurate meaning for all words based on context of selection. 4 Accurately defines terms presented in article with detail, precision, and clarity. 3 4 Demonstrates accurate interpretation of main idea of the reading selection. 2 4) Expanding the scoring guide format to grammar assessments Español 3—Capítulo 3-2 Gramática—los mandatos formales y plurales 5 50 Choice of Affirmative vs. Negative Command (Vocabulary) Choice of Register (Ud. or Uds. Command) Formation of Commands (Verb forms) Use of pronouns Accent marks 6 53.6 7 57.2 8 60.7 9 64.3 10 67.9 11 71.4 12 75 Below Basic Basic Significant errors in comprehension of vocabulary when choosing to make commands affirmative or negative. (5 or more errors) 1 Significant errors in understanding of whom to address with Ud. vs.Uds. (5 or more errors) 1 Significant errors in command forms. (5 or more errors) 1 Significant errors in correct choice and placement of reflexive pronouns with affirmative and negative commands. (3 or more errors) 1 4 or more errors in inclusion of and/or placement of accent marks. 1 Some errors in comprehension of vocabulary when choosing to make commands affirmative or negative. (3-4 errors) 13 78.6 14 82.2 15 85.7 16 89.3 17 92.9 Proficient 2 3 Usually demonstrates understanding of whom to address with Ud. vs.Uds. (1-2 errors) 2 3 Some errors in command forms. (3-4 errors) Most commands forms are grammatically correct. (1-2 errors) 2 Some errors in correct choice and placement of reflexive and direct object pronouns with commands. (2 errors) Usually demonstrates correct choice and placement of reflexive pronouns with affirmative and negative commands. (1 error) 2 2-3 errors in inclusion of and/or placement of accent marks. 2 19 100 Advanced Usually demonstrates comprehension of vocabulary when choosing to make commands affirmative or negative. (1-2 errors) Some errors in understanding of whom to address with Ud. vs.Uds. (3-4 errors) 18 96.4 3 Demonstrates advanced comprehension of vocabulary when choosing to make commands affirmative or negative. (0 errors) 4 Demonstrates advanced understanding of whom to address with Ud. vs.Uds. (0 errors) 4 Commands are grammatically correct. (0 errors) 4 Demonstrates correct choice and placement of reflexive pronouns with affirmative and negative commands. (0 errors) 3 Uses accent marks only when necessary and places them correctly on commands. (0-1 errors) 4 3 5) Expanding scoring guide format to vocabulary quizzes Percentageď Raw Scoreď Unit Vocabulary – Spelling (including diacritical marks) Unit Vocabulary Application – Meaning & Grammar (conjugations, agreement, word order) Overall Language Use – Grammar & Vocabulary Overall Communication – Content Overall Communication – Comprehensibility 50 52 54 46 48 60 62 64 66 68 70 72 74 76 78 80 82 84 86 88 90 92 94 96 98 100 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 Below Basic 1 targeted word spelled correctly Basic 3 targeted words spelled correctly Proficient 4 targeted words spelled correctly Advanced 2 targeted words 5 or more targeted words spelled correctly spelled correctly, including all or almost all diacritical 2 4 6 8 marks 10 1 targeted word applied 2 targeted words 3 targeted words 4 targeted words applied 5 or more targeted words correctly in context with applied correctly in applied correctly in correctly in context with applied correctly in context correct grammatical structures context with correct context with correct correct grammatical with correct grammatical grammatical grammatical structures structures 2 structures structures 6 8 10 4 Significant errors in basic Errors in basic grammatical Few errors in grammatical No or only minor errors in grammatical structures and/or structures and/or vocabulary, structures and/or vocabulary grammatical structures vocabulary, (including spelling) (including spelling) somewhat (including spelling) do not and/or vocabulary inhibit communication. 1 inhibit communication. 2 inhibit communication. 3 (including spelling). 4 Inadequate, inaccurate, and/or Some information in responses Appropriate response to Substantial response to irrelevant response. may be incorrect or irrelevant. prompt that provides correct prompt that provides Limited response and relevant correct and relevant information with 1 2 3 elaboration. 4 Large portions of responses are very Responses are understood with Responses are understood with Responses are easily difficult to understand and must be some interpretation by the reader. minimal interpretation by the understood. Reader does interpreted by the reader. reader. not have to “interpret” 1 2 3 meaning. 4 6) Sharing our work • • • • Spanish I, II, and AP PLCs French, German, Latin, ASL PLCs EHS SBGR Book Study Group WL Departments at Lafayette, Rockwood Summit, and Marquette • Foreign Language Association of Missouri Fall Conference, 2011 • Central States Conference on the Teaching of Foreign Languages, March 2012 Data Collection Sources 1. Student surveys (through Survey Monkey) 2. Teacher surveys 3. Comparison of student grades from Chapter 3-3 reading GCA from 2010 and 2011 (points vs scoring guide) Student surveys (through Survey Monkey) • 178 Students • Spanish III and Spanish IV • Students from 3 different teachers, 2 different PLCs • All have had level II or III with traditional grading and level III or IV with Standards Based Grading Student Comments • • • • • • Pro-Standards Based Pro-Traditional Grading / Percentages Pro-Hybrid of SBG and Letter Grades Indifference Huh? Changes that should be made Teacher surveys • 3 Teachers • 2 PLCs • Each teacher has had extensive experience in using traditional letter grades and percentages and has followed the same pattern of using SBG descriptors and scoring guides during this school year 1. What do you perceive as the impact of using the terms Advanced / Proficient / Basic / Below Basic on student assessments? • Students are more motivated to get above just 90%, students understand at what level (basic, below basic) they should be retaking - as opposed to just retaking to get a higher percentage. • Students are given a better understanding of their strengths and weaknesses - what they know well and what they still need to learn. • Students have clearer understanding of their grades and learning. Comparison of student grades from Chapter 3-3 reading GCA from 2010 and 2011 (points vs scoring guide) • Same task • 2010 – 2 points main idea, 1 point each supporting detail, 1 point each vocab in context (16 points) • 2011 – Based on scoring guide, standards based (10 points raw score) Main Idea Realidades 3: GCA – Leer Capítulo 3-3 FORMA A 50% 56.3% 62.5% 68.8% 2 3 4 5 Below Basic Basic Unable to demonstrate accurate interpretation of the main ideas of the reading selection. 0 75% 6 81.3% 87.5% 93.8% 100% 7 8 9 10 Proficient Advanced Demonstrates accurate interpretation of main idea of the reading selection. Supporting Details 2 Unable to accurately identify details from the reading selections. (5 or fewer correct) 1 Accurately identifies minor details from portions of the reading selections. (67 correct) 2 Accurately identifies minor details from the majority of the reading selections. (8 correct) 3 Accurately identifies minor details from the all or almost all of reading selections. (910 correct) Meaning from context 4 Identifies accurate meaning for one or fewer words based on context of selection. 1 Identifies accurate meaning for some words (2-3) based on context of selection. Identifies accurate meaning for most words (4-5) based on context of selection. 2 Identifies accurate meaning for all words based on context of selection. 3 4 Traditional vs Standards Based Grading 2010 Reading GCA • 86.9% Average • 24/48 (50%) Advanced • 17/48 (35%) Proficient • 5/48 (10%) Basic • 2/48 (4%) Below Basic • 24/48 (50%) A • 12/48 (25%) B • 5/48 (10%) C • 5/48 (10%) D • 2/48 (4%) F 2011 Reading GCA • 94.3%Average • 30/42 (90.5%) Advanced • 12/42 (29%) Proficient • 0 Basic • 0 Below Basic • 30/42 (90.5%) A • 12/42 (29%) B • 0C • 0D • 0F Possible Conclusions • The Standards Based scale is more generous; students can make one mistake and still get a 100%, 3 mistakes is -12% instead of -18%. • The feedback on previous reading assessments from the SB scoring guide helped students to improve on their areas of weakness over the year. • This year’s students are more academically gifted. Amount of points deducted 2010 Traditional Grading • -1 = 94% • -2 = 88% • -3 = 81% • -4 = 75% • -5 = 69% • -6 = 63% • -7 = 56% • -8 = 50% • -9 = 44% 2011 Standards Based Rubric • -1 = 94-100% • -2 = 88-94% • -3 = 91-94% • -4 = 75-88% • -5 = 75%-81.3% • -6 = 75% • -7 = 69% • -8 = 63% • -9 = 56% Conclusions • I learned that… – You can make Standards Based Grading Work, even if it’s not totally compatible with Infinite Campus – Students have strong ties to traditional grading practices – I can be much more precise in my feedback about student performance by using standards rather than numbers / letters What’s next? • Consider adding a “Far Below Basic” level • Continue to monitor and adjust scoring guides • Educate parents at Open House and Parent/Teacher Conferences, consider how to get grade communications into parents’ hands New Questions • Are other departments attempting something similar? What descriptors are they using? • Do other teachers / administrators agree with the mathematics used? 50% lowest grade? 83.3% = Proficient? • How will our role at the high school change as students graded by standards in elementary school get older? • What issues do teachers outside of my PLC have with the descriptors / the new scoring guides? • In the end, are students achieving at a higher level than before? Have they broken out of the 90%?