CREATING MEANINGFUL RUBRICS TO SCORE AUTHENTIC ASSESSMENTS Travis Richardson, Dustin Farmer, and Laura Bowers WORKSHOP OBJECTIVES: Participants will be able to define authentic assessments. Participants will be able to recognize different types of assessments. Participants will be able to develop rubrics to help them assess authentic tasks. TRADITIONAL ASSESSMENTS VS. AUTHENTIC ASSESSMENTS Traditional Assessments Authentic Assessments Relies on forced-choice, written measures Promotes integration of various written and performance measures Encourages memorization of correct answers Encourages divergent thinking in generating possible answers Measures acquisition of past knowledge Enhances development of meaningful skills Promotes “what” knowledge Promotes “how” knowledge Provides a onetime snapshot of student understanding Provides an examination of learning over time Emphasizes competition Emphasizes cooperation Curriculum directs assessment Assessment directs curriculum Emphasis on developing a body of knowledge Emphasis on ensuring proficiency at realworld tasks Priority on summative outcomes or product Priority on learning sequence or process AUTHENTIC ASSESSMENTS: Reflect real-world activities Are more valid when constructed well Provide comprehensive and robust “moving picture” of students’ learning experiences Can improve student learning Can also increase interest and improve attitudes Require students to construct meaning Involve students in own learning EXAMPLES OF AUTHENTIC ASSESSMENTS Write a newscast. Design a museum exhibit. Write and direct a play. Write an advertisement. Create a budget. Construct a timeline. Create a travel or tourist brochure. Create an eBook. Write and perform a rap. THE GRADUATION PROJECT Four Components: Paper, Product, Portfolio, Presentation Each component will be scored using a rubric Successful Completion: Exemplary, Satisfactory Has Not Completed: Developing/Emerging, Resubmission Necessary, Not Submitted For more information: http://www.dpi.state.nc.us/graduationproject/resources/rubrics/ Source: NCDPI Website SCORING AUTHENTIC ASSESSMENTS Source: Mertler, 2001 USING RUBRICS TO SCORE Clearly defined learning targets must be established before you begin creating rubric. Give students the rubric before they begin work on their assignment. Throughout project, allow students to use the rubric to self- and peer-assess. Once students become comfortable using rubrics, allow them to help in creating. Do not try to convert scores into percentages to get a grade. HOLISTIC RUBRIC Source: NC Writing Assessment ANALYTIC RUBRIC Source: Tierney and Simon, 2004 RELAIBILITY AND VALIDITY: Reliability and Validity could be called into question due to factors such as: Clarity of descriptors Use of descriptors without indicators Design flaws Inconsistent wording Negative/Positive Consistency Use of ready-made rubrics from the internet Source: Tierney and Simon, 2004 STEPS IN DESIGNING A RUBRIC 1) 2) 3) 4) Examine the learning objectives to be addressed by the task. Identify specific observable attributes that you want to see your students demonstrate in their product, process, or performance. Brainstorm characteristics that describe each attribute. Write thorough narrative descriptions for excellent work and poor work for each individual attribute. STEPS IN DESIGNING A RUBRIC 5) 6) 7) Complete the rubric by describing other levels on the continuum that ranges from excellent to poor work for each attribute. Collect samples of student work that exemplify each level. Revise the rubric as necessary. Source: Mertler, 2001 GOODRICH’S STEPS FOR RUBRICS 1. Look at models 2. List the criteria 3. Articulate gradations 4. Practice on models 5. Use self-assessment and peer assessment 6. Revise 7. Use teacher assessment Source: Jackson, 2002 CHOCOLATE CHIP COOKIE RUBRIC THE RUBRIC STRATEGY FOR KIDS R ead the rubric and the material to be graded. U se the rubric to give an initial score. B ring a buddy to help you rate again. R eview the material together. I dentify and award the scores together. C heck the scores again. Source: Jackson, 2002 NEED MORE TRAINING? Go to NC WiseOwl Click on eBistro Click on Menu Items Click on Entrees Scroll Down to Authentic Assessments RUBRIC RESOURCES RubiStar: http://rubistar.4teachers.org/index.php Teachnology: http://www.teach-nology.com/web_tools/rubrics/ Scholastic: http://teacher.scholastic.com/tools/rubric.htm Make Worksheets: http://makeworksheets.com/samples/rubrics/index.html Kathy Schrock’s Guide for Educators: http://school.discoveryeducation.com/schrockguide/assess.html Landmark Project: http://landmark-project.com/rubric_builder/index.php REFERENCES Andrade, Heidi Goodrich (2005). Teaching with Rubrics: The Good, the Bad, and the Ugly. College Teaching, 53(1): 27-30. Andrade, Heidi Goodrich (2000). Using Rubrics to Promote Thinking and Learning. Educational Leadership,57(5): 13-18. Avery, Patricia G. (1999). Authentic Assessment and Instruction. Social Education: 368-373. Jackson, Cynthia W. and Martha J. Larkin (2002). Rubric: Teaching Students to Use Grading Rubrics. TEACHING Exceptional Children, 35(1): 40-45. Kohn, Alfie (2006). The Trouble with Rubrics. English Journal, 95(4): 1215. Marzano, R. J. (2000). Transforming Classroom Grading. Alexandria, VA: Association for Supervision and Curriculum Development. REFERENCES McAlister, Brian (2000). The authenticity of authentic assessment: What the Research Says… Or Doesn't Say. In R. Custer (Ed.). Using Authentic Assessment in Vocational Education. Columbus, OH: ERIC Clearinghouse on Adult, Career, and Vocational Education. Mertler, Craig A. (2001). Designing scoring rubrics for your classroom. Practical Assessment, Research & Evaluation, 7(25). Popham, W. James (1997). What’s Wrong – And What’s Right – With Rubrics. Educational Leadership 55(2); 72-75. Schafer, William D. (2001). Effects of Teacher Knowldege of Rubrics on Student Achievement in Four Content Areas. Applied Measurement in Education, 14(2): 151-170. Tierney, Robin & Marielle Simon (2004). What’s Still Wrong with Rubrics: Focusing on the Consistency of Performance Criteria Across Scale Levels. Practical Assessment, Research & Evaluation, 9(2): 1-11. QUESTIONS? COMMENTS? Contact Information: Travis Richardson – Blue Ridge Elementary travis.richardson@ashe.k12.nc.us Dustin Farmer – Ashe County Middle dustin.farmer@ashe.k12.nc.us Laura Bowers – Westwood Elementary laura.bowers@ashe.k12.nc.us