Classroom Assessment for Student Learning 2 Used with skill, assessment can • • • • Motivate the unmotivated Restore students’ desire to learn Encourage students to keep learning Create—not simply measure— increased achievement --Stiggins, Arter, Chappuis, & Chappuis, 2004 Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 3 What assessment practices motivate students to improve their learning? 4 Who Uses Assessment Information, and How? Beginning with the person whose birthday is closest to today and moving clockwise, assign the following roles: – Student – Parent – Teacher – Principal – Athletic coach – Guidance counselor Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 5 Write your role in the blank on the handout. Answer #1 individually (3 – 5 minutes), then beginning with the “student,” share your list with others at your table. When all roles have shared, notice what conclusions you are drawing about classroom assessment. Note and discuss your responses to question #2. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 6 Some Conclusions • Data must be sound because major decisions that affect students’ wellbeing are made on its basis. • Assessment data is used for many purposes beyond grading. • Students are crucial decisionmakers, whose information needs must be met. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 7 Think of a time you were assessed and it was a negative experience. What made it negative? 8 Now think of a time you were assessed and it was a positive experience. What made it positive? 9 Emily’s Story: Assessment for Learning • Read Emily’s story and the two papers she wrote. • Then read Emily’s interview with Rick Stiggins after the school board meeting. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 10 What did Emily’s teacher do that helped Emily succeed? 11 Krissy’s Experience • Read the story of Krissy’s assessment experience. • What did this teacher do that made it difficult for Krissy to achieve the learning goals? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 12 What are the essential differences between Emily’s and Krissy’s experiences? How did ASSESSMENT AFFECT MOTIVATION in these two students’ experiences? 13 New Mission, New Beliefs Keynote Presentation Featuring Rick Stiggins 14 What assessment beliefs in our system are most in need of change? If those beliefs changed, what changes in practice would follow? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 15 What actions can you take to improve your assessment environment? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 16 Inside the BLACK BOX Raising Standards Through Classroom Assessment A Review of Research on the Effects of Formative Assessment by Paul Black and Dylan Wiliam Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 17 FORMATIVE ASSESSMENT: All those activities undertaken by teachers and by their students [that] provide information to be used as FEEDBACK to modify the teaching and learning activities in which they are engaged. --Black & Wiliam, 1998 Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 18 Research consistently shows that regular, highquality FORMATIVE ASSESSMENT increases student achievement. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 19 Activity Directions • Read through the excerpt from “Inside the Black Box.” • Note the 3–5 most important points to you. (5 minutes) • Share with a group of 2 or 3 others at your table. (5 minutes) Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 20 According to the Black & Wiliam article: Which formative assessment practices are ESSENTIAL to improved student achievement? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 21 Black & Wiliam Review of Research: 1. Does better FORMATIVE assessment = higher learning? 2. Does formative assessment need improving? 3. What improvement is needed? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 22 Black & Wiliam Research on Effects of Formative Assessment: .4 to .7 Gain .7 Standard Deviation Score Gain = 25 Percentile Points on ITBS (middle of score range) 70 SAT Score Points 4 ACT Score Points Largest Gain for Low Achievers Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 23 Recommended Practices • Increased descriptive feedback, reduced evaluative feedback • Increased student selfassessment • Increased opportunities for students to communicate their evolving learning during the teaching Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 24 The ultimate user of assessment information is the student. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 25 CLASSROOM ASSESSMENT GUIDING PRINCIPLES • Gather accurate information about student achievement • Use assessment process and results to promote maximum student learning Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 26 Classroom Assessment for Student Learning: Doing It Right—Using It Well ACCURACY PURPOSE EFFECTIVE USE EFFECTIVE COMMUNICATION DESIGN STUDENT INVOLVEMENT TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 28 ACCURACY EFFECTIVE USE PURPOSE Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 29 Key 1: Clear Assessment Purpose Always begin by asking • What decisions? • Who’s making them? • What information will be helpful to them? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 30 What’s the PURPOSE for assessment? 31 Two Purposes for Assessment SUMMATIVE • Assessments OF Learning – How much have students learned as of a particular point in time? FORMATIVE • Assessments FOR Learning – How can we use assessment information to help students learn more? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 32 Balanced Assessment Formative Formal and informal processes teachers and students use to gather evidence to directly improve the learning of students assessed Assessment for learning Use assessments to help students assess and adjust their own learning Assessment for learning Use classroom assessments to inform teacher’s decisions Summative Provides evidence achievement to certify student competence or program effectiveness Formative uses of summative data Use of summative evidence to inform what comes next for individuals or groups of students 33 Key 1: Clear Assessment Purpose Always begin by asking • What decisions? • Who’s making them? • What information will be helpful to them? Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 34 ACCURACY EFFECTIVE USE PURPOSE TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 35 Key 2: Clear Learning Targets • Know what kinds of targets are represented in curriculum – – – – Knowledge Reasoning Performance skill Products • Master the targets ourselves • Know which targets each assessment measures • Make learning targets clear to students, too. Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 36 Clarifying Learning Targets • Begin with state standards • Order in learning progressions, if needed • Deconstruct into clear learning targets leading to each standard • Communicate the learning targets in advance in language students can understand Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 37 Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 38 ACCURACY EFFECTIVE USE PURPOSE DESIGN TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 39 Key 3: Sound Assessment Design • Select a proper method • Select or create quality items, tasks, and rubrics • Sample appropriately • Prevent bias • Design assessments so students can self-assess and set goals based on the results Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 40 Possible Assessment Methods Selected Response Multiple Choice True/False Matching Fill in Extended Written Response Performance Assessment Personal Communication Questions Conferences Interviews Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 41 ACCURACY PURPOSE EFFECTIVE USE EFFECTIVE COMMUNICATION DESIGN TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 42 Key 4: Effective Communication • Provide students with timely, accurate descriptive feedback • Involve students in tracking and communicating about their learning • Use grading practices that accurately communicate about student learning • Interpret and use standardized test results correctly Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 43 My definition of feedback: Characteristics of effective feedback: Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 44 Effective Feedback… • Directs attention to the intended learning, pointing out strengths and offering specific information to guide improvement • Occurs during the learning process • Addresses partial understanding • Does not do the thinking for the student • Limits correctives to the amount of advice the student can act on Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 45 ACCURACY PURPOSE EFFECTIVE USE EFFECTIVE COMMUNICATION DESIGN STUDENT INVOLVEMENT TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 46 Key 5: Student Involvement • Students are identified as important users of assessment information • Students understand the learning targets and standards of quality • Students have opportunities to receive and give feedback • Assessments are designed so that students can use the results to self-assess and set goals for further action • Students keep track of and share their achievement Assessment FOR Learning! Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 47 Why Assessment for Learning Works When students are required to think about their own learning, articulate what they understand, and what they still need to learn, achievement improves. --Black and Wiliam, 1998 48 Assessment for Learning Strategies Where am I going? 1. Provide a clear statement of the learning target 2. Use examples and models Where am I now? 3. Offer regular descriptive feedback 4. Teach students to self-assess and set goals How can I close the gap? 5. Design focused lessons 6. Teach students focused revision 7. Engage students in self-reflection; let them keep track of and share their learning Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 49 Understanding the Importance of the Keys to Quality • Which key(s) to quality did the negative experiences violate • Which key(s) to quality did your positive experience reinforce? • See if you can categorize the experiences according to the keys to quality. 50 ACCURACY PURPOSE EFFECTIVE USE EFFECTIVE COMMUNICATION DESIGN STUDENT INVOLVEMENT TARGET Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 51 Requirement for Success? Quality Assessment! • All assessments arise from highquality content standards • All assessments produce accurate evidence • All users use assessment to benefit student learning Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 52 Expected Benefits and Proven Results • Assessment connected to learning • Better instruction focused on standards • Profound achievement gains for all students, with the largest gains for lowest achievers • More self-managed learning by students Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 53 The ETS/ATI professional development program for teachers and school leaders emphasizes the need for balanced systems, quality assessments at all levels and the effective use of results: assessment for learning. Jan Chappuis Steve Chappuis Rick Stiggins Judy Arter Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 54 Professional Development in Collaborative Learning Teams Using ATI Materials • • • • • • Job embedded Flexible On-site Economical Teacher-directed Formatted for self-study using the Learning Team Facilitator Handbook College Credit Now Available Learning teams using Classroom Assessment for Student Learning can earn 4 college credit hours from Chapman University College. Visit the ETS ATI website for details: www.ets.org/ati Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). 8474 56