What Administrators Need to Know: Smarter Balanced Assessment Grades K-5 Penny Plavala, School Improvement Specialist Multnomah ESD Session Goals • Review the Smarter Balanced Assessment Components • Identify Key Points to Share with Teachers • Review the SBA Practice Test Instructional design: direct instruction; work independently; with a partner; and in small groups Please choose a partner. What Will Be Tested? Claim 1 Reading Claim 2 Writing Claim 3 Speaking & Listening Claim 4 Research • Students can read closely and analytically to comprehend a range of increasingly complex literary and informational texts. Place text here • Students can produce effective and well-grounded writing for a range of purposes and audiences. • Students can employ effective speaking and listening skills for a range of purposes and audiences. • Students can engage in research/inquiry to investigate topics, and to analyze, integrate, and present information. Common Core Timeline YOU ARE HERE 2014 -2015 2013 – 2014 2012-2013 2011-2012 Next Generation Assessments 2010-2011 Students in grades 2-7 and 10 this year will test next year Annual test for grades 3-8 and 11 Developing the Common Core Assessment What is the Smarter Balance Assessment Consortium? • SBAC is a group of 25 states that have been working collaboratively to develop next-generation assessments that are aligned to the CCSS and that accurately measure student progress toward college and career readiness. www.smarterbalanced.org • The other consortium: PARCC ~ Partnership for the Assessment of Readiness for College and Careers Six ODE staff members are on SBAC Work Groups SBAC Member States SMARTER: Summative Multi-State Assessment Resources for Teachers and Educational Researchers Smarter Balanced Assessment System Components Common Core State Standards specify K-12 expectations for college and career readiness Summative assessments Benchmarked to college and career readiness Teachers and schools have information and tools they need to improve teaching and learning Interim assessments Flexible, open, used for actionable feedback Teacher resources for formative assessment practices to improve instruction All students leave high school college and career ready The SBAC Assessment System English Language Arts and Mathematics, Grades 3 – 8 and High School Grade 11 will test the last 6 weeks of the year Last 12 weeks of year* DIGITAL CLEARINGHOUSE of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; an interactive reporting system; scorer training modules; and teacher collaboration tools. INTERIM ASSESSMENT Computer Adaptive Assessment and Performance Tasks INTERIM ASSESSMENT Computer Adaptive Assessment and Performance Tasks Scope, sequence, number, and timing of interim assessments locally determined Optional Interim assessment system — no stakes PERFORMANCE TASKS • Reading • Writing • Math COMPUTER ADAPTIVE ASSESSMENT Summative assessment for accountability * Time windows may be adjusted based on results from the research agenda and final implementation decisions. Components of the Summative Assessment PERFORMANCE TASKS + COMPUTER ADAPTIVE ASSESSMENT • Measure the ability to integrate knowledge and skills, as required in CCSS • A computer adaptive assessment given during final 12 weeks of the school year* • Computer-delivered, during final 12 weeks of the school year* • Multiple item types, scored by teachers: 45-60 items per test • Scored by teachers. Results within 2 weeks • Scores from the performance assessment and the computer adaptive assessment will be combined for annual accountability scores. * Time windows may be adjusted based on results from the research agenda and final implementation decisions. What is Computer Adaptive Testing? Computer Adaptive Testing Faster Results • Turnaround in weeks compared to months Shorter Test Length • Fewer questions compared to fixed form tests Increased Precision • Provides accurate measurements of student growth over time Tailored to Student Ability • Item difficulty based on student performance Greater Security • Larger item banks mean that not all students receive the same questions SBAC Assessment • headphones • external keyboard • some way to move the curser Assessment Item Types Selected Response (SR) Variety of multiple choice and true/false Technology Enhanced (TE) Technology embedded into items Constructed Response (CR) Short or long answer using textual evidence Performance Tasks (PT) Use higher level thinking skills; integrate reading, writing and speaking Smarter Item Types • Multiple Choice • Assess a broad range of content. • Scoring is objective, fast, and generates immediate results. • Difficult to understand a student’s reasoning process and to assess higher-order thinking skills. Components of Selected Response Items Lizards are fascinating creatures. There are over 3,000 known species, including monitors, skinks, geckos, chameleons, and iguanas, and they vary greatly in appearance. The largest lizard, the Komodo dragon, can grow over ten feet long, and the smallest, the Jaragua lizard, can fit on a dime. Skinks usually have smooth scales like snakes, iguanas have mohawk-like crests running down their backs, and the moloch is covered with spikes from head to tail. Lizards vary in color from shades of gray and brown to bright red or green, spotted or striped. Most have four legs but some are legless and easily confused with snakes (Hint: if it has external eardrums and eyelids it’s a lizard). Geckos can walk up walls. Chameleons not only change color but also have prehensile tails, similar to those of monkeys, that wrap around branches and their eyes can move in different directions. STIMULUS What is the best way to revise the highlighted sentence to match the What is the best way to revise the highlighted sentence to match the language and style of the language paragraph? and style of the paragraph? STEM (Reading Passage) A. Geckos are able to adhere to flush surfaces because setae on their footpads facilitate van der A. Geckos are able to adhere to flush surfaces because setae on their footpads facilitate van der Waals forces between the setae structures and the surface. Waals forces between the setae structures and the surface. B. Geckos are awesome because they have sticky toes that allow them to climb windows like B. Geckos are awesome because they have sticky toes that allow them to climb windows like Spiderman. Spiderman. C. Geckos have the remarkable ability to walk up walls thanks to tiny hair-like structures on their C. Geckos have the remarkable ability to walk up walls thanks to tiny hair-like structures on their toes that cling to smooth surfaces. toes that cling to smooth surfaces. D. Geckos scurry up walls like tiny dancers gliding effortlessly across a stage, their movements as D. Geckos scurry up walls like tiny dancers gliding effortlessly across a stage, their movements as natural as a well-rehearsed ballet. OPTIONS Selected Response Read the sentence from the text. Then answer the question. “Only three strokes?” Little Liang’s face got as red as a cherry. What does the phrase face got as red as a cherry suggest about Liang? A. He is upset by his writing mistake. B. He worries about returning to school. C. He is happy about what he has learned. D. He hopes that his teacher will show him another trick. 3rd grade Selected Response Multiple Response Select three details from the presentation that tell what all three polar bears have in common. A) They are orphaned. B) They were born in the wild. C) They play in dirt. D) They live at the San Diego Zoo. E) They have a book written about them. F) They sleep with a toy. G) They enjoy morning naps. 4th grade Smarter Item Types • Multiple Choice • Assess a broad range of content. • Scoring is objective, fast, and generates immediate results. • Difficult to understand a student’s reasoning process and to assess higher-order thinking skills. • Require the student to generate a response as opposed to selecting a response. • Include both short and extended responses. • Allow students to demonstrate their use of complex thinking skills consistent with the expectations for college and career readiness. Components of a Constructed Response Item The Shepherd’s Boy and the Wolf STIMULUS A Shepherd's Boy was tending his flock near a village, and thought it would be great fun to trick the villagers by pretending that a Wolf was attacking the sheep: so he shouted out, "Wolf! Wolf!" and when the people came running up he laughed at them because they believed him. He did this more than once, and every time the villagers found they had been tricked, for there was no Wolf at all. At last a Wolf really did come, and the Boy cried, "Wolf! Wolf!" as loud as he could: but the people were so used to hearing him call that they took no notice of his cries for help. And so no one came to help the boy, and the Wolf attacked the sheep. (Reading Passage) In a few sentences, sentences, explain explain what whatlesson lessonthe thereader readercan canlearn learnfrom fromthe theshepherd’s boy. Use details the story to the support response. shepherd’s boy. from Use details from storyyour to support your response. STEM SPACE FOR ANSWER Constructed Response Read the sentence and the directions that follow. The hermit crabs in the ocean have learned to adapt to the changing housing situation. Using details from the text, define the word adapt and explain how the crabs have adapted. Type your answer in the space provided. 5th grade Constructed Response Explain why the author is interested in dragonflies. Use details from the passage to support your explanation. Type your answer in the space provided. 3rd grade Constructed Response Coyote’s plan to get the honey fails. Support this statement with two details from the passage. Type your answer in the space provided. 4th grade Scoring a Constructed Response Item 2-point Use Evidence Rubric 2 The response gives sufficient evidence of the ability to cite evidence to support arguments and/or ideas. 1 The response gives limited evidence of the ability to cite evidence to support arguments and/or ideas. 0 The response gets no credit if it provides no evidence of the ability to cite evidence to support arguments and/or ideas. Smarter Item Types • Multiple Choice • Assess a broad range of content. • Scoring is objective, fast, and generates immediate results. • Difficult to understand a student’s reasoning process and to assess higher-order thinking skills. • Require the student to generate a response as opposed to selecting a response. • Include both short and extended responses. • Allow students to demonstrate their use of complex thinking skills consistent with the expectations for college and career readiness. • Students manipulate information (example: drag and drop) • May have digital media for stimulus: video, animation, sound. Technology Enabled Video Animation Sound Technology Enhanced Specialized interaction May have digital media for stimulus Same requirements as selected and constructed response items Students manipulate information Drag & Drop, click to highlight Technology Enhanced A student is writing a story for class. She needs to correct the punctuation mistakes in her paragraph. Read this paragraph from her story and the directions that follow. We were eating supper last night when we heard a huge crash from outside. What had happened. For about ten seconds, we all sat there wondering, and looking at each other. My dad stood up, and we followed him into the yard to see what had caused the loud noise. A giant branch had fallen off the oak tree next to the house. If it had dropped just three feet to the left, it would have crashed right through the roof! Click to highlight two sentences that do not have correct punctuation. 4th grade Technology-Enhanced Sample Item The narrator states, “The bears are easy to tell apart once you get to know them.” Then, she describes their actions. Complete the chart below by placing the words that describe the bears’ personalities under Description. Then, place the actions that show their personalities under Action. Descriptions calm friendly lively helpful Description Actions rolls in the dirt takes a nap in the leaves finds toys to share with others likes it when visitors wear hats Action Kaluk Takik Shanuk 4th grade Technology Enabled SBAC Practice Test • First launched in May 2013 • All grades that are assessed • Answers and rubrics released August 2013 • Mock computer adaptive portion: - Reading passages - SR, CR, and TE questions Let’s look closely at sample items from the Practice Test. Smarter Item Types • Multiple Choice • Assess a broad range of content. • Scoring is objective, fast, and generates immediate results. • Difficult to understand a student’s reasoning process and to assess higher-order thinking skills. • Require the student to generate a response as opposed to selecting a response. • Include both short and extended responses. • Allow students to demonstrate their use of complex thinking skills consistent with the expectations for college and career readiness. • Students manipulate information (example: drag and drop) • May have digital media for stimulus: video, animation, sound. • Measure multiple claims • Require students to demonstrate ability to think and reason, and produce fully developed products. • Provide evidence of college and career readiness. Performance Tasks •Extended projects demonstrate real world writing and analytical skills •May include online research, group discussions, and presentations •Require 1-2 class periods to complete •Included in both interim and summative assessments •Applicable in all grades being assessed •Evaluated by teachers using consistent scoring rubrics • Not looking to assess surface knowledge or literal comprehension • Performance tasks attempt to tap a deeper understanding on the part of the student • Students write about what they have just read and viewed Components of a Performance Task Information Processing Stimulus: Reading Passage Product/Performance Readings Research questions Essay, report, story Video clips Audio clips Comprehension questions Graphs, charts, other visuals Simulated Internet search Responses to embedded constructed response questions. etc. Research topic/issue/ problem etc. etc. Emphasis on stimuli related to science, history, and social studies. Can use up to four different stimuli for grades 3-5. Let’s explore the components of a 3rd grade performance task on Dental Health. 3rd Grade Performance Task • Session 1 Ultimately tasked with writing an informative essay telling how to maintain good dental health, students will be introduced to the topic through watching a short video and reading two articles, taking notes on these sources. They will then respond to three constructed-response questions addressing the research skills of analyzing and evaluating information. 3rd Grade Performance Task • Session 2 Finally, students will work individually to compose a full-length informative essay telling how to maintain good dental health, referring to details from the video or the texts. Students may also refer to their notes or back to the video or passages as needed. Pre-writing, drafting and revising will be involved. 3rd Grade Performance Task • Student Directions Write an informative essay explaining what a person should do to have good dental health. Include details from the video and articles to support your ideas. Sample Performance Task Read: - Article - Article Watch: - Video clip Answer: - Constructed Response questions Write: - Informative essay • We must prepare students for a very different type of performance assessment that may include: -Taking notes while watching a video -Taking notes when reading an article, short story, etc. -Answering Constructed Response questions (use evidence) -Participating in small group discussions -Students writing about what they read -Analyzing, synthesizing, evaluating, and integrating information read in order to write a complete essay Teaching Key Literacy Skills • Teachers must create a plan for integrating these Common Core skills into instruction. • Teachers should collaborate with other teachers to create lessons around key skills across the content areas. • Teachers might visit other classrooms to see skill instruction. What are your first ideas on how to assure that these key literacy skills are being taught in classrooms? Smarter Balanced Assessment • Pilot Test • Spring 2013 • Field Test • Spring 2014 • Practice Test • 37 questions per grade level • Training Test • 7 questions per grade level www.smarterbalanced.org Additional Information • Revised SBAC Writing Rubrics (3 traits) released in August 2013. • The rubrics have not been field tested. • These are not final drafts. Expect revisions. • Anchor papers are expected in fall 2014. Estimated testing times for Smarter Balanced Summative Assessments Test Type English Language Arts/Literacy Grades Computer Adaptive Performance Task Only Total In-Class Activity Total 3-5 1:30 2:00 3:30 :30 4:00 6-8 1:30 2:00 3:30 :30 4:00 11 2:00 2:00 4:00 :30 4:30 Times are estimates of test length for 75% of students. Accommodations and modifications will be finalized after the Field Test in the spring of 2014. SBAC Timeline Technology readiness tool available Teams of teachers evaluate formative assessment practices and curriculum resources Writing and Review of Pilot Items/Tasks (including Cognitive Labs and Small-Scale Trials) Content and Item Specifications Development Writing and Review Items/Tasks for Field Testing (throughout the school year) Field testing of summative assessment, training school- and district-level staff in formative tools Pilot Testing of Summative and Interim Items/Tasks Conducted Full implementation of assessment system Formative tools available to teachers ODE Staff on SBAC Work Groups • • • • • • Kathleen Vanderwall: Doug Kosty: Rachel Aazzerah: Holly Carter: Mark Freed: Steve Slater: Item Development Sustainability Test Administration Accessibility & Accommodations Reporting Scoring and Psychometrics Common Core Solutions • • • • • • SBAC Practice Test Sample Performance Tasks Frequently Asked Questions CCSS Documents Professional Development Tools And more! www.bit.ly/CommonCoreSolutions