SCHOOL ASSESSMENT COORDINATOR (SAC) TRAINING January 13 and 14, 2016 ACCESS for ELLs 2.0 & Alternate ACCESS for ELLs Office of Accountability Research, Evaluation & Assessment ACCESS 2.0 1 Important Dates 2 Test Overview 3 WIDA Systems : AMS and WIDA-us 4 Roles and Responsibilities : Training Requirements 5 Structure of the Test 6 Before Testing 7 Accommodations NE 8 Test Security 1 Office of Accountability Research, Evaluation & Assessment Introduction ACCESS for ELLs 2.0 • The ACCESS is an English language proficiency assessment based on the Minnesota Standards for English Language Development, developed by the WIDA Consortium. • There are four language domains assessed by the ACCESS: Reading, writing, listening and speaking. NEW • The ACCESS is administered online at grades 1-12. NEW • The test is available in six grade-level clusters: Grades K, 1, 2-3, 4-5, 6-8, 12. • The Kindergarten ACCESS is a paper-pencil assessment. 2 Office of Accountability Research, Evaluation & Assessment Important Dates • 12/14/15 - Pre-ID file data provided by the state • 1/13/16 - Receive paper accommodated and other paper test materials • 2/1/16 – 3/24/16 - ACCESS for ELLs 2.0 test window • 4/1/16 - All paper test materials returned to DRC • 5/23/16 - Retrieve early student-level results in Test WES • 7/28/16 - Public release of results • 8/1/16 - District receives student paper results, ISRs 1 3 Office of Accountability Research, Evaluation & Assessment Test Overview 2 4 Office of Accountability Research, Evaluation & Assessment Benefits of the Online Test • Built-in accommodations and accessibility features appropriate for a range of student needs • Staged adaptivity targets students’ individual range of language skills • Increased ease for test administrators • Logistical flexibility as a result of being able to simultaneously administer multiple grades and proficiency levels • Central scoring by DRC for all four domains • Test Administrators will not need to determine tiers 5 Office of Accountability Research, Evaluation & Assessment Student Experience • Graphic-supported items • Audio-supported directions • Narrated and guided introduction by a human voice for each domain test • Practice items • Modeled responses for the productive domains • Simple navigation • Embedded accessibility features, such as: – Magnification – Highlighter – Writing tools (e.g. cut and paste, copy, underline) 6 Office of Accountability Research, Evaluation & Assessment Domains & Online Grade Level Clusters *Note: Kindergarten will remain an interactive, paper-based kit. 7 Office of Accountability Research, Evaluation & Assessment Response Capture • Listening and Reading: student responses will be captured digitally and scored by the online test engine • Speaking: student responses will be recorded (captured digitally) and automatically sent to DRC for scoring by trained raters • Writing: typed student responses will be recorded (captured digitally) and automatically sent to DRC for scoring by trained raters; handwritten responses will also be returned to DRC for scoring - - Writing provisions, page 23 8 Office of Accountability Research, Evaluation & Assessment Paper-based Test Forms 9 Office of Accountability Research, Evaluation & Assessment WIDA Systems • Assessment Management System (AMS) • WIDA-us 3 10 Office of Accountability Research, Evaluation & Assessment Two WIDA Systems For ACCESS 2.0 WIDA Assessment Management System (AMS) https://www.wida-ams.us/ • For Test Administration WIDA-us https://www.wida.us/ • For Training 11 Office of Accountability Research, Evaluation & Assessment WIDA Assessment Management System (WIDA AMS) One-stop resource for all tools needed for ACCESS for ELLs 2.0 administration https://www.wida-ams.us/ 12 Office of Accountability Research, Evaluation & Assessment WIDA-us 13 Office of Accountability Research, Evaluation & Assessment Roles and Responsibilities 4 14 Office of Accountability Research, Evaluation & Assessment Roles and Responsibilities - SAC ACCESS School Assessment Coordinator Inventory test materials immediately upon receipt and returns all test materials to DRC Inc Consolidates and request additional materials needed for testing. Request additional materials from robin.lane@spps.org or michael.wirtz@spps.org Schedule test sessions Makes sure test administration is performed by trained test proctors Distributes test materials on each day of the test Reminds test proctors that all test materials are to be kept secure and confidential at all times 15 Office of Accountability Research, Evaluation & Assessment Roles and Responsibilities, cont. Test Administrators Completes online WID training for each domain Becomes familiar with procedures for test accommodations for ELLs with disabilities Administers the online ACCESS for ELLs via AMS For Paper Tests: - Properly account for test booklet security immediately before, during, and after test administration - Assures that pre-ID labels are attached to test booklets correctly or that student data is properly bubbled in on test booklet covers if no label is provided 16 Office of Accountability Research, Evaluation & Assessment Required Training on WIDA-us Online Test Coordinator Checklist • Required for School Assessment Coordinators (SACs) • SAC checklist was emailed to you. Will also be available on REA Test Coordinator site: http://rea.spps.org/Test_Coordination2 Online Test Administrator Checklist • Required for Test Administrators Handout • ACCESS 2.0 Training Guidelines 17 Office of Accountability Research, Evaluation & Assessment WIDA-us : Required Training 18 Office of Accountability Research, Evaluation & Assessment Structure of the Test 5 19 Office of Accountability Research, Evaluation & Assessment NEW Order of Administration • The new online test is staged adaptive, meaning students will progress through the test based on their performance on previous folders (test items grouped around a common theme) and domains. Based on their performance in an individual folder, the test engine will determine the appropriate next folder for individual students. • Students must first take the Listening and Reading tests because their performance on those domains determines their placement on the remaining domains (Speaking and Writing). • Students should take the Listening test first, followed by the Reading test. Then, students may take Speaking and Writing in either order. This sequence is reflected in the graphic below. • The Listening Test and Reading Test may be administered on the same day. • The Speaking Test and Writing Test cannot be be administered on the same day as the Listening and Reading Tests. 20 Office of Accountability Research, Evaluation & Assessment Estimated Administration Times Students work at their own pace using the following guidelines: 21 Office of Accountability Research, Evaluation & Assessment Information About the Writing Domain • The different test delivery and response modes of the Writing test are designed to meet the needs of all learners: See Provisions Next Page See Provisions Next Page 22 Office of Accountability Research, Evaluation & Assessment Provisions for the Writing Domain • While the ACCESS for grades 1–12 is administered primarily online, there are provisions for the writing subtest as follows: • The grades 1–3 writing subtest is entirely a paper administration, meaning students will read prompts and write their responses in a paper test booklet. • The grades 4–5 writing prompts are presented to students online and students respond in a writing response booklet. If students in grades 4–5 are competent at keyboarding and wish to respond online, the school should determine if it will allow individual students the option to respond online. Students who will respond online need to be moved to the appropriate session in WIDA AMS. • Students in grades 6–12 who are inexperienced, unfamiliar, or uncomfortable with keyboarding may write their responses in a writing response booklet. The writing prompts are presented to students online. Students who will respond on paper need to be moved to the appropriate session in WIDA AMS. 23 Office of Accountability Research, Evaluation & Assessment Before Testing Handouts • Computer Registration Instructions for ACCESS 2.0 • Flashdrive 6 24 Office of Accountability Research, Evaluation & Assessment Register Student Computers Handout, Page 1 25 Office of Accountability Research, Evaluation & Assessment Register Student Computers Handout, Page 2 26 Office of Accountability Research, Evaluation & Assessment 27 Office of Accountability Research, Evaluation & Assessment Office of Accountability Research, Evaluation & Assessment Student Test Tickets & Rosters 29 Office of Accountability Research, Evaluation & Assessment Accommodations • All accommodations must be updated in IEP and 504 plans. Accommodations are automatically entered into AMS. • Paper accommodations for the grades 1–12 ACCESS for ELLs 2.0 will be available as required by a student's IEP or 504 plan. • Accommodations Descriptions Document - Available on REA Test Coordinator site http://rea.spps.org/Test_Coordination2 7 30 Office of Accountability Research, Evaluation & Assessment WIDA Assessment Management System (WIDA AMS) Within the system, designated staff may: • Access any needed user guides or software downloads • Add students for test sessions • Designate accommodations • Create test sessions • Print test tickets • Monitor student progress • View/print reports 31 Office of Accountability Research, Evaluation & Assessment Test Security • • • • Nondisclosure Agreement Test items Security Measures for 2015-16 Staff Security Training 8 32 Office of Accountability Research, Evaluation & Assessment Test Security Policies • Nondisclosure Agreement – Everyone with secure access to ACCESS 2.0 must complete the Nondisclosure Agreement. – Test Monitors & data entry personnel must accept the agreement in PearsonAccess or they will not be able to monitor tests or enter student responses. – Everyone with access to the test items must complete the Nondisclosure Agreement. – Anyone who may come in contact with or see test items, can be asked by a student about an item or handle test materials must sign a Nondisclosure Agreement. – Paper Nondisclosure Agreement available here on REA website: http://rea.spps.org/Test_Coordination2 33 Office of Accountability Research, Evaluation & Assessment Test Security Policies cont. • All Test Items are secure – Discussions of items are not allowed with students and co-workers. – Test items and student tests are not allowed to be reviewed by teachers or building staff. – Test items may not be reproduced in any form or by anyone. – Cell phone cameras are not allowed. – Emails or discussions in on-line social media are not allowed. 34 Office of Accountability Research, Evaluation & Assessment Test Security & Training Proctors • School SAC Meeting • You must ˗ hold a training meeting for your monitors, ˗ have them sign-in to prove they attended the meeting, ˗ allow time for monitors to read the non-disclosure agreement, ˗ have them sign one Non-Disclosure Agreement per school year, collect the NonDisclosure Agreements and file. • Topics to Cover during your Training Session • • • • • • Proctors must be impartial observers during the test administration. Reproducing or paraphrasing an item in an email or in writing is a breach in security. Cell phones, PDAs or translation devices may not be used. Dictionaries may not be used. Test Tickets must be collected from students before leaving the testing room. All instructional posters and graphics in the computer lab or where students will be taking the ACCESS 2.0 must be covered or removed. 35 Office of Accountability Research, Evaluation & Assessment Test Security & Training Proctors, cont. • Test Administration Report (TAR) • The TAR is used to record test misadministrations and reasons for invalidations. • The SAC completes the TAR and forwards a copy to Robin or Michael in the testing office. • The TAR must be kept on file for 12 months. • The TAR is available here on REA website: http://rea.spps.org/Test_Coordination2 • Examples of misadministrations • A student uses a calculator during a non calculator segment. • A student engages in inappropriate behavior or action that results in a test being invalidated. • A student refuses to take an assessment or cheats on an assessment, requiring the assessment to be invalidated. • A student’s responses are transferred by staff from an answer document to the Data Entry Interface incorrectly. 36 Office of Accountability Research, Evaluation & Assessment Security Measures for 2015-16 Tip Line • MDE has launched a Test Security Tip Line. • Educators, parents, students and others can report suspected incidents of cheating, improper or unethical behavior on any Statewide assessments. • Links to the Test Security Tip Line are available in two places on the MDE web site. ˗ View the Test Administration page (MDE>School Support>Test Administration) ˗ View the Testing Information page (MDE>Just for Parents> Testing Information) 37 Office of Accountability Research, Evaluation & Assessment Site Visit Checklist 38 Office of Accountability Research, Evaluation & Assessment Front and Back Covers of Test Booklet SAINT PAUL SCHOOLS 2014-2015 0625 X MN 123 X X X Place correct student label here if available. X X X X X MARSS # Fill in grids if you do not have a correct label. X X X CIF # 39 Office of Accountability Research, Evaluation & Assessment Contact Information For more information, please contact the WIDA Help Desk: 1-866-276-7735 or help@wida.us MDE http://education.state.mn.us/mde/index.html REA Test Coordinator Site http://rea.spps.org/Test_Coordination2 DRC DRC Customer Service: WIDA@datarecognitioncorp.com or 1-855-787-9615. SPPS District Assessment Coordinators (DACs) Robin Lane Office; 651-767-8257 Cell: 651-335-3594 Email: robin.lane@spps.org Michael Wirtz Office: 651-632-3776 Cell: 651-261-0045 Email: michael.wirtz@spps.org 40 Office of Accountability Research, Evaluation & Assessment