STAAR ALTERNATE Texas Assessment Conference December 2011 Why is STAAR more rigorous? S T A N D A R D I Z A T I O N More rigor for the STAAR program, which includes STAAR Alternate, has been mandated by the Texas legislature. Our teachers and students are ready for more rigor, since they have met the challenges that have been asked of them over the years. More Rigorous Tasks and Observation Guidelines The assessment tasks have been made more rigorous by: requiring the student to do more for one predetermined criterion linking to a more challenging general education curriculum targeting higher prerequisite skills for a grade level or course assessment task than was focused on for TAKS–Alt More Rigorous Tasks and Observation Guidelines The assessment is now limited to two completed observations, because teachers reported that they emphasized quality instruction before the observation and rarely needed more than two observations. Students must now demonstrate all actions listed in each predetermined criterion using the specific action planned by the teacher, so that the teacher is more objective and focused when observing student performance. The student performs the predetermined criterion. The teacher notes what was observed during the observation. The teacher evaluates the student’s performance recorded in the notes to determine if the student performed the skill as planned and how much additional assistance was needed. The teacher answers the online evaluation questions using the notes. The Assessment Management System converts the recorded answers into the official score reported on the CSR. More Rigorous Tasks and Observation Guidelines The importance of the observation is stressed, because the performance of the student during the observation directly relates to the score the student will receive on the CSR. The importance of using the documentation form is stressed, because it is the official evidence for the evaluation in the Assessment Management system. Generalization can only be demonstrated with a change in materials, so that the focus is on skill acquisition and not situational factors. Viewing the Documentation Form The documentation form must be used during the assessment as follows: before the observation to preplan the observation, during or immediately after the observation to record student performance, and after the observation to evaluate the student’s performance in the online system. The state-required documentation forms are the only secure document related to STAAR Alternate once student performance data has been recorded. Others can view the first page of the documentation form during and after the preplanning by the test administrator. No one can view pages two and three of the documentation form. These pages must be kept secure by the teacher until the form is given to the CTC or DTC for storage by the close of the assessment window. Documentation forms will no longer be available on the TEA website after the close of the window. Important Difference Between…. Instruction Helping student to learn concept with as much assistance as needed. Observation Allowing student to show what he or she can do without assistance. More Rigor by Providing a Change in Materials Materials used in instruction should vary enough from those used during the observation, so that the student is not just rotely repeating an answer or response from a previous instructional session without truly demonstrating the skill. The student must provide a different answer to each predetermined criterion or respond to a different experience in the predetermined criterion than was observed during instruction. Replicating the exact task prior to the observation will compromise the validity of the student’s performance and should not occur. The change in materials must be content related and focused on the skill being assessed. Focus should be on skill acquisition and not on a consistent, repeated performance. Change in Materials Teachers must review the task before instruction begins to ensure that the task is not duplicated in instruction exactly as it is written. Teachers are required to provide instruction differently than the method planned for use during the assessment task observation. The method for the instructional approach may vary from assessment task to assessment task. Natural Occurrences Separate Lessons New Items Different Presentations Task Specific Change in Materials from Instruction to Assessment Must use! Ensures Standardization More Rigorous Scoring Scoring and evaluating the performance of students with significant cognitive disabilities is difficult due to the wide range of abilities; however, we want to make sure that the score fairly reflects each student’s actual performance and skill level. The selection of the complexity level affects scoring due to the weighting feature which allows more points for a higher complexity level. The complexity level selection should be based more on the developmental level of the student rather than the actual task. Test administrators should avoid selecting a task a student can already do, but rather select a task the student should be able to do with instruction and careful thought to access. Student Characteristics for the STAAR Alternate Complexity Levels Instruction More Rigorous Scoring Student assessments that are designated as No Response Observed require evidence that one essence statement per subject was planned on the first page of the documentation form and the observation attempted. The first page must be stored in the district as evidence of the attempted observation. No points are given for a prompted Demonstration of Skill performance, because the student was given the answer. Students are given two points for an independent generalized performance, so that the scoring mirrors the primary performance. The possible points for generalization are now 6 points per task which raises the total possible points per subject for STAAR Alternate from 72 (TAKS–Alt) to 84 which will require new standard setting in fall of 2012. Satisfactory New Performance Categories Unsatisfactory Accomplished More Rigorous Teacher Training Why do we have to take a test? There are no student test booklets and corresponding test directions for the test administrator to follow. The evaluation piece for both TELPAS and STAAR Alternate requires more extensive training. During peer review, the US Department of Education told us we had to evaluate test administrator understanding. Training Requirements All potential test administrators must: View all four modules and pass qualifications for each module when given two attempts, so that all procedures are fully understood. It is time for a refresher after four years. Receive supplemental training support before a third and final attempt is provided if the district decides to offer the third attempt. Review the STAAR Alternate test administrator manual and resources. Participate in local general test administration policy training and sign the STAAR Alternate oath. Only two attempts are allowed to pass each module at 80%, because statistics showed that 95% of the TAKS–Alt test administrators qualified after only two attempts. Teachers should be taking the training seriously, since the student’s score is a result of the test administrator’s understanding of all test administration procedures. Current Statistics for STAAR Alternate www.tea.state.tx.us/student.assessment/special-ed/staaralt Teachers can use resources while they are taking the qualifications: manuals, transcripts, and documents. Cannot get help from other people! Monitor if teachers are taking the qualification in the same room. Supplemental Training Support Flowchart What happens if the teacher does not pass after two attempts? Who can be a supplemental support provider ? The person providing the supplemental training support must function in a supervisory capacity for the campus or district and not be a peer of the test administrator. This can be a region or co-op representative if they provide routine support for teachers and can logically provide the face-toface supplemental training. A STAAR Alternate test administrator cannot be a supplemental support provider for another test administrator unless that person directly supervises the individual needing the support. The supplemental support provider must have viewed all four of the training modules and passed all four of the qualification activities. What should the supplemental training support include? The district will need to develop local guidelines specifically detailing what must be covered in the training support. The training should thoroughly review all the content in the modules and require the teacher to demonstrate to the supplemental support provider that the content has been understood. Suggestions one-on-one review of each page of the module checks for understanding through questions or by the teacher rephrasing the content assignments of sections of the STAAR Alternate manuals or other STAAR Alternate resources to study with follow-up session for discussion performance tasks allowing the teacher to demonstrate how to execute one of the four steps of the administration process Resources that Support Each Module The district has to be confident that each test administrator is well trained and ready to administer the assessment. The district decides who receives the training or supervision, who will provide the training or supervision, and what the training and supervision will entail. Region staff can help if they are trained, but the district must make the decision and give the password for the third and final attempt.. Supervision for the Test Administration Process ARD Process for STAAR Alternate Review the participation requirements to determine eligibility, note the justification for the determination on the form, and select the assessment from the state options. Review the assurances as a group to make sure that all critical considerations were discussed before the decision was made. Select the subjects/courses that the student will take and what corresponding assessments are required. Summarize the decisions and determine the instructional accommodations that will serve as the basis for the supports and materials documented on the state-required documentation form. Develop IEP goals and objectives for the academic instruction that will be provided. Determine who is responsible for verifying the information. Participation Requirements Step 1 Review the five requirements to make sure that the student meets all five criteria. Focus on evidence of a significant cognitive disability and how the student accesses the grade-level or course curriculum. Rule out students who have a learning disability and receive a modified general education curriculum. Participation Requirements Step II Initial the assurances that verify that the decision was based on evidence and educational need and not on AYP calculations, previous assessment performance, placement or service delivery, or demographic information. Assure that the committee discussed the impact of the decision on graduation plans and determined the courses (PEIMS number) or subjects that will be taken that year. Step III Summarize the assessment decisions. For grades 3-8, the enrolled grade determines the subjects that will be tested. Students are required to participate in all STAAR Alternate assessments sometime during high school with the exception of the World History/World Geography option. The ARD committee determines what year each high school course and assessment will be taken. This determination is no longer grade-level related. For the 2011-2012 administration, previous TAKS–Alt high school assessments count toward the STAAR Alternate testing requirements. English I (Met with TAKS-Alt Grade 9 Reading) English II (Met with TAKS-Alt Grade 10 ELA) English III (Met with TAKS-Alt Grade 11 ELA) Algebra I (Met with TAKS-Alt Grade 9 Math) Geometry (Met with TAKS-Alt Grade 10 Math) Biology (Met with TAKS-Alt Grade 10 Science) World Geography or World History (Met with Grade 10 Social Studies) US History (Met with Grade 11 Social Studies) District Monitoring is Crucial How can TEA help you? STAAR Alternate Testing Coordinator Checklist Lock/Unlock teacher accounts in the Assessment Management System to provide or deny access to the system as teachers qualify or fail to qualify. Cannot be an administrator and an alternate assessment teacher on the same campus. Texas Assessment Management System mini-sessions specifically for STAAR Alternate are occurring during this conference. For further assistance, call Pearson at 800-627-0225. No Interrater Reliability Study this year! More information about the audit will be provided at the January 4, 2012, TETN # 10043. How can teachers help you monitor the test administration? Let you know when: He or she has not passed a module after two attempts. ARD committees have changed the assessment decision. A student has extended absences and the completion of the assessment is in jeopardy. A student transfers in or out of the district and needs to be registered or unregistered for STAAR Alternate. Problems are occurring with the documentation forms. He or she is not seeing the correct student information or tested subjects/courses when the test administrator first accesses the assessment management system in January. Remind test administrators to be careful! Match the information on the documentation form with the information in the Assessment Management System! Reporting Performance TEA will be monitoring district test administration progress through summary reports to alert districts of concerns. Testing Irregularities If a student is enrolled in an alternate high school course that has a corresponding STAAR Alternate assessment, the student must take the assessment . Students who transfer into the district on or before March 30, 2012 must be assessed by the receiving district. Testing Irregularities Testing Irregularities Teachers must check all the evaluation data carefully before submitting the assessment. Remember that all the assessment data that is in the system will be submitted on April 20, 2012. Testing Irregularities As it has been from the beginning of the alternate assessment, it takes all of us to provide the best assessment we can for students. Have a great year!