Smarter Balanced Writing Performance Task Stacey Murrell, Ed. D. Interim Assessments Coordinator Office of Assessment and Research Smarter Balanced ELA Claims ELA: Targets by Grade Level for each Claim A writing performance task: • Requires students to demonstrate the ability to think and reason, and produce fully developed products. • Measures complex “assessment targets.” • Provides evidence of college and career readiness. Performance task structure • Consists of 3 components- – Stimulus presentation- source documents and prompt directions – Information processing- student interaction with stimulus materials- should advance the students’ understanding of the stimulus content or assignment- constructed response items and multiple-choice, note taking – Scorable product or performance- essays Who Completes Writing Performance Task? • 2014-2015 – WV students in grades 3-11 3 Sections of Performance Task • First: Teacher-led standardized, classroom activity • Then: Part 1: – Reading sources and answering constructed response items and multiple-choice items – Taking notes on scratch paper • Part 2: Typing in an essay in a textbox on the computer Classroom Activity Purpose • Introduces students to context of performance task, to prevent disadvantage • Gives understanding of setting or situation, potential unfamiliar concepts (cultural, etc.), gives key terms/vocab • Gets students interested in exploring topic more • Designed for 30 minutes, complete in one session of time • Non-secure and displayable materials (pictures, tables, etc.), can use SmartBoard, etc. • Script used by teacher to make standardized • http://sbac.portal.airast.org/wp-content/uploads/2014/03/Classroom-Activityand-Performance-Task-Administration-Guidelines.pdf Performance Task Part 1 • Made up of: – – – – Setting the Scenario Reading the Sources Answering Items Taking Notes • Teacher-student interaction will be standardized (i.e., carefully scripted or described in the task directions for fairness and security) • Group work- none in ELA writing performance task Part 1: Scenario • Set up a scenario for context, purpose, and audience of the performance task • This is not the source materials • Scenario is short: 3-5 sentences at Grades 34; 5-7 sentences at Grades 5-8 and 11 • Does not tell the specific writing prompt, just tells what the context, purpose, and audience will be (writing an informational article about being an astronaut for your teacher) Part 1: Sources • Vocabulary- definitions of specialized terms that help students • Sources should lexile below grade level when reading is not being assessed • Sources will be able to be read and re-read • No Internet access- will use screenshots of Internet pages • http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2012/05/TaskItemSpecifications /EnglishLanguageArtsLiteracy/ELAStimulusSpecifi cations.pdf Part 1: Number of Sources • Source Documents – Number of documents dependent on grade level Grade Span Number of Sources Grade 3 2 source documents Grades 4-5 3 source documents Grades 6-8 3-4 source documents Grade 11 4-5 source documents Part 1: Length of Sources • Because students must read and integrate multiple sources within a given amount of time, the sources as a whole should not exceed the maximum word counts below. Grade Span Maximum Words Grade 3 1000 words Grades 4-5 1400 words Grades 6-8 2400 words Grade 11 3400 words Part 1: Items asking Questions about Sources • All Grades 3-11 will read the sources and answer items before moving to the essay writing. • Number of items is the same regardless of essay type and grade level: – 2 constructed response items (hand scored) – 1 other item type, i.e. multiple choice, hot text(automatically scored) How do students answer constructed response items? • Accuracy of answer is what matters • Remember a person will score these using criteria specific to the item Sample Constructed Response Item and Its Rubric • The sources discuss <topic>. Explain what you have learned about <topic>. Use one detail from each source to support your explanation. For each detail, include the source title or number. Score points Scoring Criteria 2 of 2 The response: - Explains something learned and identifies one detail from Source 1 and one detail from Source 2 - Gives the source title for each or uses Source 1 or Source 2 as labels. 1 of 2 The response: - Explains something learned and identifies one detail from Source 1 or one detail from Source 2 - Does not reference both source titles or Source 1and Source 2 as labels 0 of 2 The response either misinterprets the explanation and details from the sources and provides no citation Part 1: Taking Notes • Students can take notes about the sources which will be used to write the essay. • They can: – Use scrap paper and pencils – Use Global Notes which is online note taking on the computer Part 2: Writing the Essay • Tools for all students: – English dictionary may be available – Highlighter available – Global Notes is online note taking page – Spellcheck available, does not offer correct spelling – From Smarter Balanced Assessment Consortium: Usability, Accessibility, and Accommodations Guidelines, http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2014/03/SmarterBalanced_Guidelines_091113.pdf What does student writing look like? • No student samples or exemplars exist at this time. • Look at the language in sample Smarter Balanced Task for Grade 3 informational article directions: – “For Part 2, you are being asked to write an informational article that is several paragraphs long. Type your response in the box below. The box will get bigger as you type.” Part 2: Essay Scoring • 10 point analytic rubric – 4 points for organization/purpose – 4 points for evidence/elaboration – 2 points for conventions • 5 different rubrics based on essay type and grade level- no longer one rubric like WV Writing Rubrics from WESTEST 2 Online Writing Smarter Balanced Writing Rubrics (used on performance tasks essays) Type of Essay Grades Narrative 3-8 Opinion 3-5 Argumentative 6-8 and 11 Informative 3-5 Explanatory 6-8 and 11 Analytic Trait Language • Organization/Purpose (4 points) – 4-clear and effective organization, 3- evident organization, 2-inconsistent organization, 1-little or no organization, NS- insufficient • Evidence/Elaboration (4 points) – 4-thorough elaboration, 3-adequate elaboration, 2uneven, cursory elaboration, 1- minimal elaboration, NS- insufficient • Conventions (2 points) – 2-adequate command, 1- partial command, 0- little or no command, NS- insufficient Smarter Balanced Rubrics • Find them here at the bottom of page: • http://sbac.portal.airast.org/practicetest/resources/ Timing and Sequence • Performance task has two sessions. SBAC recommends two days. – Classroom Activity (completed prior to sessions) – Day 1/Part 1: Reading sources, notes, and constructed response items and answers – Day 2/Part 2: Writing essay • Students unable to return to Part 1, once they begin Part 2 (i.e., change a constructed response answer) • Untimed sessions for Part 1 and Part 2. • SBAC estimated times for Classroom Activity (30 mins), Performance Task Part 1 and Part 2 (1:30-2 hours) Practice Opportunities for Students Smarter Balanced Practice • One ELA performance task per grade level • Grades 3-8 and 11 • Here is how they are titled: Grade 3 ELA Performance Task/Braille Performance Task [PDF] • PDFs located here: http://sbac.portal.airast.org/practicetest/resources/ Office of Assessment Practice • WV teachers wrote the performance tasks using Smarter Balanced item specifications in 2012. • Grades 3-11 available, 9 and 10 grades also • At least 3 practice tasks for each grade level • Some are grade bands, such as grades 6-7 • Find them here: http://tinyurl.com/wvnxginterims • We did not create Class Activity because we made them prior to Class Activity being designed ELA Smarter Balanced Practice and Training Tests Welcome Smarter BalancedPractice Tests Practice Tests are about content/standards. • Experience a full grade-level assessment and see what students will see on summative test • Includes a variety of question types and difficulty • Approximately 30 items each in ELA and math • Also has an ELA and math performance task • Includes embedded universal tools, designated supports, and accommodations for IEP/504 students Smarter BalancedTraining Tests Training Tests are about question types and navigating the site. • Opportunity to learn software and navigational tools • Available as grade bands: – Grades 3-5 – Grades 6-8 – Grades 9-11 • 14-15 items, including these new technology enhanced questions: matching tables, table fill-in, evidenced based selected response • No performance tasks • Includes embedded universal tools, designated supports and accommodations for IEP/504 How to Access Tests • Quick Access (any users): Any Internet-connected computer using a current Web browser including: – – – – Mozilla Firefox Google Chrome Microsoft Internet Explorer 10 Apple Safari • Advanced Access: Secure Browser can be usedlikely TIS would support this installation on the computers. Practice and Training Tests User Guides • Main Resources and Documentation Page: http://sbac.portal.airast.org/practicetest/resources/ – Practice and Training Test User Guide (PDF): http://sbac.portal.airast.org/wpcontent/uploads/2013/07/PracticeAndTrainingTes t_UserGuide_021414.pdf • Provides in-depth guidance on the practice and training tests • Step-by-step directions for using both tests User Guide: Test Layout Basic Rules: • Unable to skip test items- Must mark for review and return to it later. • Answer all test items on page before going to next page. May need to scroll vertically to see all items. • Marked for review items can be located using Questions drop-down list at top of page. Test Tools: All Tests • • • • • • • Highlight passages and questions Zoom in and out Mark for review Make notes in notepad View tutorials about item type Strikethrough (cross out answer choices) Access test instructions and Help screen Test Tools: All • Expand passage tool – Left pane has reading passage – Right pane has test questions on passage – Click on icon in upper right corner of left pane to expand passage – Click on same icon to collapse passage Audio Tools/Headphones for Practice and Training Tests Used in Tests Accessed Via Universal Tools All students: Students listen to recorded speeches or texts using headphones. They then answer questions on the audio passage. Practice and Training Tests website, using Chrome, Mozilla Designated Supports: Students who have been given supports such as ELL, IEP, 504, and SAT plans. Students have the directions and test questions read to them by an embedded text-tospeech program. Requires the Secure Browser be downloaded to the student’s computer Accommodations: Students who are identified by an IEP or 504 plan as needing the accommodation. Students have the directions, test questions, and (optional) ELA reading passages read to them by an embedded text-tospeech program. Requires the Secure Browser be downloaded to the student’s computer. • ELA Training Test has reading passage capability, ELA Practice Test DOES NOT. Secure Browser Note: Practice and Training Tests • Text-to-Speech is only available in a secure browser. Here are the Supported Secure Browsers for Text-to-Speech: – – – – – – – Windows Secure Browser 6.0 and 6.3 Mac Secure Browser 5.5 and 5.6 Mac Secure Browser 6.0 and 6.3 Linux Secure Browser 6.0 and 6.3 AIRSecureTest mobile secure browser for iOS AIRSecureTest mobile secure browser for Android AIRSecureTest mobile secure browser for Google Chromebooks Instructions for downloading the secure browsers are available on the Smarter Balanced portal (https://sbac.portal.airast.org/browsers/default.html) and in the Technical Specifications Manual for Online Testing. Practice Test Answer Keys • • • • • • • • Grade 3 ELA/Braille [PDF] Grade 4 ELA/Braille [PDF] Grade 5 ELA/Braille [PDF] Grade 6 ELA/Braille [PDF] Grade 7 ELA/Braille [PDF] Grade 8 ELA/Braille [PDF] Grade 11 ELA/Braille [PDF] http://sbac.portal.airast.org/practicetest/resources/#manuals Smarter Balanced: 2013 Pilot Test Extra Practice • These are PDFs which could be used as additional practice for students (such as SmartBoard, group work, etc.). • Grade 3 ELA/Braille [PDF] • Grade 4 ELA/Braille [PDF] • Grade 5 ELA/Braille [PDF] • Grade 6 ELA/Braille [PDF] • Grade 7 ELA/Braille [PDF] • Grade 8 ELA/Braille [PDF] • Grade 11 ELA/Braille [PDF] • http://sbac.portal.airast.org/practicetest/resources/#manuals Office of Assessment: ELA Cluster Assessments • Claim 1 Literary Texts- available now grades 3-11 • Claim 1 Informational Texts- under construction, available mid-Dec. grades 3-11 • Claim 2 Writing Performance Tasks- available now grades 3-11 • Claim 3 Speaking and Listening- under construction, available mid-Dec. grades 3-11 • Claim 4 Research- under construction, available late Nov. grades 3-11 • Answer Key provided for each cluster Question and Answers Part 2: Survey Questions and Answers • Q: How to use tools • A: The tools available in the practice and training tests are explained in detail here: http://sbac.portal.airast.org/wpcontent/uploads/2013/07/PracticeAndTrainin gTest_UserGuide_021414.pdf • Q: How will tests be scored? • A: Smarter Balanced will soon be releasing the proficiency score ranges for the tests. I will be discussing scoring/score points possible on ELA test questions in detail during Nov. 12 training. • Smarter Balanced ELA item specifications provide exact scoring points for each item type and task. • Q: Are there samples of student writing available as exemplars for writing performance tasks? • A: At this time, student exemplars have not been released to the public. I will share the websites with county test coordinators once the exemplars are shared. • There are exemplar answers shown for the constructed response items that students answer before they write their essays. • Q: For writing performance tasks, will the sources be fictional, non-fictional, or both? • A: Based on Smarter Balanced practice performance tasks online, there were no fictional texts used as sources. • The SB sample Grade 6 performance task asks students to write a narrative. This is the ONLY sample of a narrative writing performance tasks at any grade level. • Q: How can we prepare our special education students so they are not overwhelmed? • A: Download the secure browser to their computers and let them practice using the tools, supports, and accommodations within the practice and training tests. • Additionally, the interim program replacing Acuity will allow students the same experience in both the interim program and the summative test. • Q: Will Smarter Balanced be tailored to WV NxG or Common Core standards? • A: The practice and training tests are aligned to Common Core. There is a crosswalk document from the Office of Secondary Learning. The main difference is the numbering system format; however, WV did edit some of the language and concepts. • http://wveis.k12.wv.us/Teach21/public/ng_cso/E LA_N.pdf • Q: When will ELA teachers get more specific trainings? • A: Once the interim assessments program (like Acuity) has been provided, then we will begin offering RESA and county trainings. • Q: How similar is the writing performance task to WV Writes? • A: Two points I want to share. First, the student writing in WV Writes will have prepared us for the writing. Our students can draft well-written essays. The challenge is that they now read sources and must use the information within the sources to support their own writing. • Second, the essays written in the interim assessment program will NOT be instantly scored by a computer. The essays will have to be hand scored by teachers. The essays for the summative performance task will be hand scored by the assessment vendor. • Q: Where can I find classroom activities to use as models for creating my own in the classroom? • A: • Grade 3: Out of This World [PDF] • Grade 4: Animal World [PDF] • Grade 5: Working Together [PDF] • Grade 6: Technology of the Future [PDF] • Grade 7: Sleep [PDF] • Grade 8: The Money We Use [PDF] • Grade 11: Financial Responsibility [PDF] • http://sbac.portal.airast.org/practicetest/resources/#manuals • Q: Will grades 9 and 10 have an ELA test? • A: Yes, we are planning on testing grades 9 and 10 in ELA. Smarter Balanced has items for both these grade levels. They do NOT offer practice tests; however, WVDE has practice clusters for grades 9 and 10 and will be providing additional practice clusters. • Q: Will the reading and writing tests be scored together or separately? • A: Each student receives an overall ELA/literacy score and four claim (Reading, Writing, Speaking and Listening, and Research) scores or subscores reported at the individual level. • http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2014/05/ELA_Preliminary_-Blueprint-2014_04-30Final.pdf Questions? • • • • • • • • • • • • http://www.smarterbalanced.org/smarter-balanced-assessments/ Click here to view item specifications English Language Arts/Literacy Item Specification ELA CAT Item Specs Grades 3-5 (ZIP) (Update 2/4/14) ELA CAT Item Specs Grades 6-8 (ZIP) (Update 2/4/14) ELA CAT Item Specs Grades 9-11 (ZIP) (Updated 2/4/14) ELA PT Item Specs Opinion Grades 3-5 (ZIP) (5/20/14) ELA PT Item Specs Narrative Grades 3-5 (ZIP) (5/20/14) ELA PT Item Specs Informative Grades 3-5 (ZIP) (5/20/14) ELA PT Item Specs Narrative Grades 6-8 (ZIP) (10/27/14) ELA PT Item Specs Explanatory Grades 6-8,11 (ZIP) (5/20/14) ELA PT Item Specs Argumentative Grades 6-8,11 (ZIP) (5/20/14)