STAAR Alternate State of Texas Assessments of Academic Readiness – Alternate Updates for 2013-2014 1 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) RETN Etiquette Please turn OFF cell phones If you must take a call, please take it outside Be sure your microphones are muted. Remember… You may be seen or heard by other sites at any time, even if you are not speaking to the presenter. 2 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Attendance and Handouts Credit for Attendance Access to Handouts • Your district site manager should provide you with a sign-in sheet • Please be sure that all participants who want credit for attendance signin • Coordinate with the site manager to return the signin sheet to ESC Region XI • Handouts are available online on the ESC Region XI website at http://www.esc11.net/P age/3791 • Click on “STAAR Alternate Training Resources” on the left side menu ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 3 After today, this session will be available for viewing via the VBrick system at http://vbrick.esc11.net 4 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Questions??? Opportunities to ask questions will be provided throughout the training. 5 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Objectives for this training • Review current STAAR Assessments • Review changes to STAAR Alternate for 2013-2014 • Understand district and campus responsibilities relative to STAAR Alternate • Review future plans for STAAR Alternate 6 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Let’s Review 7 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Student Assessment Division • Assessment Resources http://www.tea.state.tx.us/student.assess ment/ • Resource pages • STAAR • STAAR Modified • Student Assessment Resources • A-Z Directory • Subscribe to the Student Assessment Mailing List • STAAR Alternate • • • • STAAR L TELPAS TAKS TAKS Modified • What’s New in Student Assessment ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 8 STAAR Grades 3 – 8 Based on GRADE enrollment Subjects/Grades 3 4 5 6 7 8 Reading Mathematics Writing Science Social Studies Includes modified and alternate assessments ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 9 STAAR End-of-Course Assessments (EOC) Based on COURSE enrollment English English I Math Algebra I Science Social Studies Biology U.S. History English II Geometry Chemistry English III Algebra II Physics World History World Geography Includes modified and alternate assessments ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 10 Which test do students take? Students in grades 3–8 and students who entered grade 9 in 2011–2012 and thereafter STAAR General assessment for all students receiving grade level instruction STAAR L ELL’s who meet participation requirements STAAR Spanish (Gr. 3-5) STAAR Modified Students with disabilities who meet participation requirements for an alternate assessment based on modified achievement standards Students in grades 3 and above with significant cognitive disabilities STAAR Alternate Must meet participation requirements for an alternate assessment based on alternate achievement standards ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 11 Who takes STAAR Alternate? • Students receiving special education services who: • Have a significant cognitive disability • • • • Access TEKS through prerequisite skills Require supports throughout the day for nonacademic tasks Need specialized instruction in the natural environment Are routinely assessed through performance tasks • There are no limits on the number of students who can take a STAAR Alternate assessment, however… • Up to 1% of the tested population can be counted as proficient for AYP when tested with STAAR Alternate. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 12 Changes to STAAR Alternate for 2013-2014 13 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Updates to the Information Presented in the STAAR Alternate Modules/ Transcripts 14 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to the Modules • Only NEW test administrators are required to view the modules and pass the qualifications this year. • Any modules that have not been passed previously must be taken again before the test administrator can be given access to the Assessment Management System. • No changes were made to the modules or the transcripts. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 15 Changes to the Modules • Many of the screenshots in the modules show old resources. • Teachers should use the STAAR Alternate Resources webpage to ensure that the most current document is being used. • The screenshots for the Assessment Management system in Module 4 have last year’s date; however, the information provided is still accurate. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 16 Changes to the Modules • The “List of Resources” provided at the end of each module is incorrect. • An updated resources list is available on the STAAR Alternate Resources webpage. 17 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to the ARD Process 18 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to the ARD Process • Only ARD committees can select the complexity level or levels for each subject. • The teacher can no longer select the complexity level and must abide by the ARD committee decision. • If the teacher feels that the selected complexity level no longer reflects the student’s performance, the ARD committee must reconvene to evaluate the previous decision. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 19 Changes to the ARD Process • The 2013-2014 Participation Requirements, in both Spanish and English, have been posted. 20 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to the ARD Process Note the date on the form • STAAR Alternate Participation Requirements • State-required documentation form • Must be completed and retained by the district when eligibility for an alternate assessment is confirmed • MUST be included in the IEP Provided by ESC Region XI (Source: TEA Student Assessment Division) 21 Changes to the ARD Process Determine who is responsible for verifying the information. • The district personnel who completes these forms should be a member of the ARD committee who can verify the information on the form • These forms should be completed during the ARD committee meeting when assessment decisions are made. Provided by ESC Region XI (Source: TEA Student Assessment Division) 22 Changes to the ARD Process • All previous PowerPoint presentations regarding selecting the complexity levels for STAAR Alternate have been combined into the ARD Committee Training for the 2013-2014 Texas Assessment Program PowerPoint. 23 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources 24 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources • All resources, including the manuals, have been updated with the most up-to-date information. • The new security oath has been posted. • Documents have been updated to reflect the EOC courses to be assessed this year: • • • • Algebra I English I and English II Biology US History ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 25 Changes to Resources Change in Materials (Task Specific and Primary to Generalization) 26 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources • Assessment tasks and Essence statements are posted 27 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources – Essence Statements • Three of the four essence statements are new this year. 28 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources • Prerequisite skill targets were added to the Essence Statement documents that were posted in March. • These targets informed teachers as to the gradelevel link for the tasks prior to the posting of the assessment tasks and prerequisite skills in September. 29 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Expansion of Resources – Assessment Tasks • All assessment task documents have been posted and should be used as the main source for viewing the assessment tasks. • The documentation forms have the tasks listed on them, but do not provide the rich information for teachers that will assist them in planning the administration of the state-provided task. 30 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Expansion of Resources – Assessment Tasks • The Definitions and Examples pages for the assessment tasks have been expanded. • These pages proceed each essence statement and provide valuable information and ideas for the tasks. 31 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources – Documentation Forms The link to the documentation forms will not be posted until November 15th. 32 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Changes to Resources – Archives • Assessment resources from last year have been added to a new Archive section at the bottom of the Resources webpage. • Assessment tasks • Curriculum Framework documents • Performance Level Descriptors for English III, Geometry, World History, and World Geography 33 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) STAAR Alternate Responsibilities Manual for District/Campus Testing Coordinators <<>> Local Administrators and Supervisors and ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 34 STAAR Alternate Test Coordinator Checklist • Conduct and monitor STAAR Alternate Training • Assessment Management System • Secure documentation forms • Monitor the progress of assessments ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 35 STAAR Alternate Responsibilities Oath of Test Security and Confidentiality for STAAR Alternate Test Administrator 36 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) STAAR Alternate Responsibilities Manual for STAAR Alternate Test Administrators (Teachers) 37 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) STAAR Alternate Test Administrator (Teacher) Checklist • Test Administer training requirements • Step 1: Select the assessment task • Step 2: Implement the assessment task • Step 3: Observe and document student performance • Step 4: Evaluate student performance ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 38 STAAR Alternate Timelines • The STAAR Alternate Timeline has been posted and will be updated periodically as specific dates for events have been determined. 39 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Important Dates • 09/03/13–9/29/13 • Districts access the Assessment Management System to choose a student data upload option to register students for the 2013-2014 STAAR Alternate administration. Default requires the district to register students. • 09/29/13 • Deadline for entering the student data upload for registering students. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 40 Important Dates • October 7, 2013 • The final attempt for qualification activities can be accessed by district and campus staff from the Training Center after receiving the second attempt codes from testing coordinators. The Training Center access code for new personnel is STAARALT1314 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 41 Important Dates October 18, 2013 • Testing coordinators can access the Assessment Management System to make changes to student demographics from last year’s STAAR Alternate administration or data file submission and set up alternate assessment teachers and students for the current administration. This includes: • assigning students to their appropriate grade levels and courses for testing • addressing student changes in campuses (including those occurring due to promotion) • registering all students who will be assessed with STAAR Alternate • locking/unlocking teacher accounts as qualification activities are passed ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 42 Important Dates • November 15, 2013 • Documentation forms posted • January 6, 2014 – April 18, 2014 • STAAR Alternate Assessment Window • March 28, 2014 • Transfer cut-off date 43 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Results from 2012-2013 44 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Results for the 2012-2013 Administration of STAAR Alternate 2011-2012 2012-2013 86, 963 93, 438 55 67 86, 149 92, 313 Partial Score 61 102 No Response Observed 698 956 Complexity Level 3 11% 12% Complexity Level 2 55% 58% Complexity Level 1 34% 29% Number of Assessments Not Assessed Complete Score ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 45 Performance Data for 2014 • The adjusted cut score of 48 will be applied to the 2014 results to comply with House Bill 906 of the 83rd Legislative Session. 46 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Performance Data for 2014 • The student’s Confidential Student Report will also report growth between 2013 and 2014. • Growth results will be calculated using a stage change table and reported as Did Not Meet, Met, or Exceeded Growth. 47 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Future Development 48 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Impact of Recent Legislation • House Bill 5 of the 83rd Legislative Session called for a redesign of the State of Texas Assessments of Academic Readiness (STAAR®) Alternate assessment. “ The agency, in conjunction with appropriate interested persons, shall redevelop assessment instruments adopted or developed under Subsection (b) for administration to significantly cognitively disabled students in a manner consistent with federal law. An assessment instrument under this subsection may not require a teacher to prepare tasks or materials for a student who will be administered such an assessment instrument.” 49 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Impact of Recent Legislation • The bill eliminates portfolio and performancebased assessments used by other states, because these types of assessments require the individualization of materials and task administration. • Therefore, the Texas Education Agency (TEA) is considering implementing a standardized itembased assessment. • How this legislation will affect the use of accommodations to provide accessibility to students that may need additional materials is still being determined. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 50 Development Plans Focus Group • No Child Left Behind requires an assessment for students with significant cognitive disabilities that can be applied to 1% of the tested population for AYP purposes. • The assessment still needs to cover the state curriculum through prerequisite skills; thus our Vertical Alignment documents and Curriculum Framework documents will continue to be the basis for instruction and test item development for the new test design. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 51 Development Plans Focus Group • Focus Group meetings representing all regions will be held in Austin to review development plans. • The Focus Group participants are made up of teachers, administrators, ESC personnel, parents, and advocacy groups. • The Focus Group will advise Pearson and TEA on the feasibility of the proposed redesign and other administration issues. • The Focus Group will be reconvened at various stages of the development process. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 52 Development Plans Cognitive Lab • TEA and Pearson will be conducting a cognitive lab study to assist in the development of a redesign of STAAR Alternate. • The purpose of the lab is to observe teachers and students interacting with sample test items to determine the quality of the test administrator instructions, the usability of the test materials, and the accessibility for the student to the images and language provided in the test items. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 53 Development Plans Cognitive Lab • Specifically, the cognitive lab study can help TEA answer the following research questions: • Can students respond to items with two-dimensional graphics? • Is the range of item complexity too difficult or too easy for students? • What accommodations may be needed for student accessibility to the two-dimensional graphics for the items? • How long does it take students to respond to the items? • Teachers will be able to provide feedback and suggestions through a post-observation interactive interview of 15 questions. 54 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Development Plans Cognitive Lab • The cognitive lab study will be conducted for approximately 50 students in ESC regions 6, 12, 13, and 20. • Subjects to be sampled with redesign items are Grades 3, 4, and 7 reading; Grades 3, 4, and 7 math; Grade 7 writing; Grades 5 and 8 science; English I; algebra; and US history. • Volunteers have been requested in those regions and many districts have already volunteered and been contacted. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 55 Development Plans Cognitive Lab • Each teacher will be asked to administer four test items per subject to one student. • Districts select the campuses, teachers and students to participate. • The cognitive lab will be held from September 19th until November 1st. • TEA will contact volunteering districts to arrange a pre-observation meeting with the teachers to review the items and discuss the observation. • A team of Pearson and TEA staff will observe the test administration session and interview the teacher after the session. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 56 Development Plans Pilot Study • TEA will also be conducting a Pilot Study for STAAR Alternate during the 2013-2014 school year. • Both small and large districts are asked to volunteer. • Each teacher volunteer will be asked to administer one assessment, approximately 24 questions, to one student. • Subjects in the Pilot Study include Grades 4 and 7 reading, Grades 4 and 7 math, Grade 7 writing, Grade 5 science, English I, algebra I, and US history. 57 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Development Plans Pilot Study • TEA will contact volunteering districts to ensure that a variety of students, spanning all ability levels, is included in the study. • Districts will select the teachers and the students. • More details regarding the length of the pilot window and the number of teachers and students requested for a given district will be provided at a later date. ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 58 Development Plans Pilot Study Volunteers needed! • To volunteer your district, contact a STAAR Alternate team member at 512-463-9536 or staaralt@tea.state.tx.us 59 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) ARD Committee Decisions for Next Year • The new assessment will be an item based test; There will no complexity levels • Participation requirements may change but the test will not be expanded to include the “modified” assessment • ARD Committees can only decide if the student requires an alternate assessment due to instruction based on alternate achievement standards ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 60 Anything else? • Check the STAAR Alternate Resources page http://www.tea.state.tx.us/student.assess ment/special-ed/staaralt/ Contact Student Assessment 512-463-9536 staaralt@tea.state.tx.us 61 ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) Education Service Center Region XI Assessment Contacts • Laura Carson – Coordinator for Curriculum, Instruction and Assessment (817) 740-7573 or lcarson@esc11.net • Peggy DeMoss – Federal and State Assessment (817) 740-7529 or pdemoss@esc11.net • Sharon Rutherford – Special Education Assessment (817) 740-7574 or srutherford@esc11.net ESC Region 11 Fort Worth, Texas (Source: TEA Student Assessment) 62