Mathematics: Smarter Balanced Item Types and Interim Assessments Terri Sappington Coordinator, Office of Assessment and Accountability West Virginia Department of Education Questions from Last Week 1. Are 9th, 10th, and 11th grade students taking the same test? No 2. Will achievement levels be set for each grade? Yes 3. How will performance task be structured? Two parts (Classroom Activity and computer-based Performance Task) 4. Scheduling assessments? Math will be three different sessions. CTCs will get information on scheduling at the next CTC meeting. 5. What baseline data will be used to measure growth? Rob Surface and Jason Perdue 6. Please provide specific terminology and resources to use to familiarize students? What skills do students need to be familiar with on the computer to perform well? Item specifications specify the terminology required. Students should take the “Training Test” on the SBAC website to become familiar with the tools. 7. How will Smarter Balance work in kindergarten? Please provide more information on how to prepare students. Contact: Teresa Hammond, Office of Early Education, or John Ford, Office of Secondary Learning 8. How can this test pass as fair to all students when it is computer adapted? It should more accurately reflect their abilities. What about grades 3-5 students who have an IEP that says the can use calculators? In elementary school, students are working to become mathematically fluent; use of calculators would defeat that purpose. 9. Will the testing schedules be the same across the nation? Testing windows are set for the last 80% of the instructional year. 10. Item types? Today’s webinar 11. How to access practice tests? SBAC quick links document 12. Calculator use? 3-5 no calculators, 6-11 embedded calculators for items allowing calculator use. 13. Please provide more sample questions to practice with students. Today’s webinar will show you different item types. Last week’s webinar discussed Item Specifications, the item specs contain examples of specific items used for various clusters. Smarter Balanced and Evidence-Centered Design Items and Performance Tasks Smarter Balanced Item and Task Specifications Smarter Balanced Content Specifications Common Core State Standards Six Item Types • • • • • • Selected Response Constructed Response Extended Response Performance Tasks Technology-Enabled Technology-Enhanced Selected Response Benefits and Limitations of Selected Response Items • Benefits – Answered quickly • Limitations – Assess a broad range of content in one test – Limited ability to reveal a student’s reasoning process – Inexpensive and objectively scored – Difficult to assess higherorder thinking skills – Results collected quickly Selected Response Single Response – Multiple Choice Selected Response Multiple Correct Options Which of the following statements is a property of a rectangle? Select all that apply. ☐ Contains three sides ☐ Contains four sides ☐ Contains eight sides ☐ Contains two sets of parallel lines ☐ Contains at least one interior angle that is acute ☐ Contains at least one interior angle that is obtuse ☐ All interior angles are right angles ☐ All sides have the same length ☐ All sides are of different length Constructed Response Purpose of Constructed Response Items • Constructed Response items – Address assessment targets and claims that are of greater complexity – Require more analytical thinking and reasoning Administration of Constructed Response Items • Administered during the computer-adaptive component • Scored using artificial intelligence • Most constructed response items take between 1 and 5 minutes to complete • Some more complex items may take up to 10 minutes to complete Components of a Constructed Response Item A teacher asked her students to use estimation to decide if the sum of the problem below is closer to 4,000 or 5,000. 496 + 1,404 + 2,605 + 489 = One student replied that she thinks the sum is closer to 4,000. She used the estimation shown below to support her reasoning. Is the student’s reasoning correct? In the space below, use numbers and words to explain why or why not. If the student’s reasoning is not correct, explain how she should have estimated. Components of a Constructed Response Item Sample Top-Score Response: The student’s reasoning is incorrect. She was rounding to the thousands place. She had 2 numbers that were less than 500, and she decided to round these numbers to 0. This is like saying these numbers were not in the problem at all. She needs to account for these two numbers. Together, they have a sum that is very close to 1,000. I think adding 1,000 + 1,000 + 3,000 is a better strategy. This means the sum is closer to 5,000 than to 4,000. Scoring Rubric: Responses to this item will receive 0–2 points, based on the following: 2 points: Student has thorough understanding of how to estimate and how improper estimation can lead to flawed reasoning. Student states that the student in the scenario used reasoning that is incorrect and provides reasoning that shows a better estimation strategy. 1 point: Student has partial understanding of how to estimate and how improper estimation can lead to flawed reasoning. Student states that the student in the scenario used reasoning that is incorrect, but alternate estimation strategy is also flawed. 0 points: Student has little or no understanding of how to estimate and how improper estimation can lead to flawed reasoning. Student states that the student in the scenario used reasoning that is correct. TOP-SCORE SCORING RUBRIC Qualities of a Rubric • Focus on the essence of the primary claim and sometimes secondary claim • Address the requirements of the specific assessment targets • Distinguish between different levels of understanding and/or performance • Contain relevant information, details, and numbers that support different levels of competency related to the item or task Essential Requirements of Selected Response and Constructed Response Items • Aligned to claims and assessment targets • Mathematical accuracy • Clarity, readability, and accessibility • Free from bias issues • More complex constructed response items may include scaffolding • Selected response items must have appropriate distractors General Guidelines for Developing Selected Response and Constructed Response Items • Each item should be written to assess a primary claim • Secondary content claims are also possible General Guidelines for Developing Selected Response and Constructed Response Items • May include mathematical concepts detailed in the Common Core State Standards for lower grades • Central focus • Clearly stated to ensure that students understand the task • Clearly elicit the desired evidence • Appropriate grade-level difficulty, cognitive complexity, and reading level • Depth of Knowledge considered • Grades 3–5: items do not require a calculator Constructed Response The table below shows the number of students in each third-grade class at Lincoln School. Students in Third-Grade Class Number of Students Mrs. Roy 24 Mr. Grant 21 Mr. Harrison 22 Ms. Mack 25 There are 105 fourth-grade students at Lincoln School. How many more fourth-grade students than third-grade students are at Lincoln School? Show or explain how you found your answer. Examples of Poorly Written Items The table below shows the weights of three vehicles. Vehicle Car Motorcycle Truck Weight (in pounds) The table below shows the number of apples three students picked. Student Number of Apples 4,050 Bobby 107 497 Carlos 95 Jenna 121 12,159 Which list shows the vehicles in order from lightest to heaviest? Which list shows the number of apples picked in order from greatest to the least? ☐ ☐ ☐ ☐ ☐ ☐ ☐ ☐ car, motorcycle, truck motorcycle, car, truck truck, car, motorcycle truck, motorcycle, car 95, 107, 121 95, 121, 107 121, 107, 95 121, 95, 107 Examples of Poorly Written Items Mercedes received 32 pieces of candy on Halloween. She ate ¼ of the candy. How many pieces of candy did Mercedes have left? Show or explain how you found your answer. Examples of Poorly Written Items Look at the rectangle below. 3 feet 6 feet What is the area, in square feet, of the rectangle? ☐ 3 ☐ 15 ☐ 18 ☐ 63 Constructed Response Extended Response Ms. McCrary wants to make a rabbit pen in a section of her lawn. Her plan for the rabbit pen includes the following: • It will be in the shape of a rectangle. • It will take 24 feet of fence material to make. • Each side will be longer than 1 foot. • The length and width will measure whole feet. Part A Draw 3 different rectangles that can each represent Ms. McCrary’s rabbit pen. Be sure to use all 24 feet of fence material for each pen. Use the grid below. Click the places where you want the corners of your rectangle to be. Draw one rectangle at a time. If you make a mistake, click on your rectangle to delete it. Continue as many times as necessary. Pen 1: Length: Width: Area: (feet, square feet) (feet, square feet) (feet, square feet) Pen 3: Length: Width: Area: (feet, square feet) (feet, square feet) (feet, square feet) Pen 2: Length: Width: Area: (feet, square feet) (feet, square feet) (feet, square feet) Part B Ms. McCrary wants her rabbit to have more than 60 square feet of ground area inside the pen. She finds that if she uses the side of her house as one of the sides of the rabbit pen, she can make the rabbit pen larger. • Draw another rectangular rabbit pen. • Use all 24 feet of fencing for 3 sides of the pen. • Use one side of the house for the other side of the pen. • Make sure the ground area inside the pen is greater than 60 square feet. Use the grid below. Click the places where you want the corners of your rectangle to be. If you make a mistake, click on your rectangle to delete it. Use your keyboard to type the length and width of each rabbit pen you draw. Then type the area of each rabbit pen. Be sure to select the correct unit for each answer. [Students will input length, width, and area for each rabbit pen. Students will choose unit from drop down menu.] Use your keyboard to type the length and width of each rabbit pen you draw. Then type the area of each rabbit pen. Be sure to select the correct unit for each answer. Length: Width: Area: (feet, square feet) (feet, square feet) (feet, square feet) Capitalize on Technology • Technology-Enabled items • Technology-Enhanced items Technology-Enabled Items • Digital Media – – – – Video Animation Sound Interactive tools • Response Types – Selected – Constructed Technology-Enabled Selected or Constructed Responses that include Multimedia Brianna is running for class president. She needs to give a speech to the 4th grade class. Listen to the draft of her speech and then answer the questions that follow. (Test-takers listen to an audio version of the following speech.) “Hi, My name is Brianna. I am running for class president, and I hope you will vote for me. You know many of my friends said they would. I am involved in many activities, including track and theater. If I am elected, I will hold several fundraisers so that all students in the 4th grade can go on a trip at the end of the year. Also, we can donate a portion of the money to a charity of our choice. If you want a class president who will work hard for you and listen to your needs, please vote for me next week!” This speech needs to be revised before the student presents it. Which sentence should be omitted to improve the speech. A. I am running for class president, and I hope you will vote for me. B. You know many of my friends said they would. C. If I am elected, I will hold several fundraisers so that all students in the 4th grade can go on a trip at the end of the year. D. If you want a class president who will work hard for you and listen to your needs, please vote for me next week!” Example of Technology-Enabled Item Gregory is installing tile on a rectangular floor. • He is using congruent square tiles that each have a side length of ½ foot • The area of the floor is 22 square feet. • The width of the floor is 4 feet. Use the grid and the tile below to model the floor. What is the length, in feet, of the floor? Technology-Enhanced Items • Specialized interaction • May have digital media for stimulus • Same requirements as selected and constructed response items • Students manipulate information • Defined responses Technology-Enhanced Items Draw a line of symmetry through the figure below. The graph on the right shows a triangle. Draw the triangle after it is reflected over the y-axis. Classify each shape below based whether it contains at least one pair of parallel sides. Reorder the fractions below so that they are ordered from smallest to largest. 3/5 3/4 2/6 1/2 2/3 Comparing Technology-Enabled and Technology-Enhanced Items Gregory is installing tile on a rectangular floor. • He is using congruent square tiles that each have a side length of ½ foot. • The area of the floor is 22 square feet. • The width of the floor is 4 feet. Use the grid and the tile below to model the floor. What is the length, in feet, of the floor? 5.5 feet Draw a line of symmetry through the figure below. Technology-Enhanced Collects Evidence through a Non-Traditional Response Technology-Enhanced Collects Evidence through a Non-Traditional Response The value of y is proportional the the value of x. The constant of proportionality for this relationship is 1. On the grid below, graph this proportional relationship. Performance Tasks From the Smarter Balanced website (at the bottom of the Practice and Training Tests page): Classroom Activity Performance Task Performance Task Performance Task Performance Task Interim Assessments The Smarter Balanced Interim Assessments are to be available in January. SBAC Interims Interim Comprehensive Assessments (ICAs) Interim Assessment Blocks (IABs) Test Format • Same blueprints as summative • Computer adaptive or fixed form • Smaller than ICAs • Focus on sets of targets • Fixed form and can also be computer adaptive WV Printable Interim Resources Balanced Assessment System Interim assessments and practice performance tasks The WV Printable Interim Resources Are: Practice questions aligned to the currently used WV standards in all 4 content areas (ELA, Math, Science , and Social Studies) Writing performance tasks modeled from SBAC writing performance tasks (grades 3-11) Slide 71 Assessments that could be used by teachers as bell ringers, cluster assessments, interim practice, or group activities Optional interim choices for schools during the transition to SBAC interims The WV Printable Interim Resources Are NOT Slide 72 Not diagnostic assessments or benchmarks Not aligned to a particular or determined curriculum map; however, they do align to WV NxG clusters and standards and Smarter Balanced Claims for ELA and Math Not mandated or required Not secure test questions; however, the answer keys should be kept secure Printable Interim ResourcesWest Virginia Developed • ELA, includes practice writing performance tasks • Math, practice performance tasks under development • Science • Social Studies • Available to any @k12.wv.us educator at http://tinyurl.com/wvnxg-interims Type in your XXXXX@k12.wv.us account and password. Select a folder View and Print Questions? Please complete the survey on this training session. Go here: https://www.surveymonkey.com/r/VX8GGQX