ACCESS for ELLs® Pre-Administration 2013-2014 November 12, 2013 - 9:00am - 11:30am November 13, 2013 - 1:00pm - 3:30pm November 14, 2013 - 9:00am - 11:30am Deborah Houston, Assessment Carol Johnson, Title III/ESOL Georgia Department of Education 1 Welcome to Pre-Administration Training for ACCESS for ELLs While you are waiting, please do the following: Configure your microphone and speakers by going to: • Tools – Audio – Audio setup wizard Confirm your connection speed by going to: • Tools – Preferences – Connection speed If your name and system name do not appear together on the Participants’ List, please this information in the chat box. GaDOE Objectives Important GaDOE and WIDA Updates Identification and Exit Criteria Test Administration Reminders and Updates GaDOE Including the Alternate ACCESS for ELLs® Ordering Receipt of Test Materials Test Administration Returning Test Materials 2013-2014 ACCESS for ELLs Key Dates (includes Alternate ACCESS) Task Tests Ordered Start Date October 15, 2013 End Date November 26, 2013 Systems order online through MetriTech’s secure website. Pre-ID Ordering October 15, 2013 Systems submit student demographic data to MetriTech. December 3, 2013 Pre-Administration Training November 12, 2013 November 14, 2013 Systems Receive Assessment Materials January 13, 2014 January 17, 2014 Assessment Window January 21, 2014 March 6, 2014 March 4, 2014 March 11, 2014 April 8, 2014 April 18, 2014 Data Validation Window MetriTech Ships Reports to Systems and GaDOE May 5, 2014 May 9, 2014 Post-Assessment Training May 7, 2014 May 8, 2014 Systems Ship Materials to MetriTech GaDOE 4 Change in the Delivery of WIDA Assessment Webinars NEW beginning in 2013-2014! WIDA has developed common webinars on assessment topics that were delivered by consultants in previous years. – Ensures consistency of messages about assessments – Outreach to all states 5 Change in the Delivery of WIDA Assessment Webinars The WIDA created webinars cover the following topics and will be/were posted by: • W-APT Test Administration – September 1, 2013 • ACCESS for ELLs Test Administration – October 15, 2013 • Alternate ACCESS Test Administration – October 15, 2013 • ACCESS for ELLs Score Report Interpretation – April 1, 2014 • Alternate ACCESS for ELLs Score Report Interpretation – April 1, 2014 The webinars are accessible in the WIDA Download library (http://wida.us/downloadLibrary.aspx), in the ACCESS for ELLs section. Viewers will need to log in using their username and password for their ACCESS training account. 6 Go to Download Library: http://wida.us/downloadLibrary.aspx . See bottom two postings – for 20132014 ACCESS Test Administration webinars. 7 Update- Form 302 Reading Test Timing The extra time provided in the Reading test has been extended from five minutes to ten minutes. The test directions have been revised as follows: • The Reading Test is designed to take no more than 35-45 minutes. In rare situations, test administrators may use their professional judgment in determining whether a student(s) needs additional time to complete the test. The test administration time does not include time for convening students, taking attendance, distributing and collecting test materials, explaining test directions, or completing practice items. • Please note that that this change does not affect students with IEPs/504 Plans who require an extended time accommodation. 8 Update- Form 302 Listening Test Timing The Listening Test of ACCESS for ELLs, will be media-based. This means that all Listening items for all tiers and grades 1-12 are prerecorded. Rather than listening to the test administrator read the scripted items, the students will listen to a recording. This allows for students to listen to more authentic language use, such as conversations involving more than one speaker. Test items will be administered via audio from a CD or streamed online via a secure password-protected site. • ACCESS for ELLs test materials will include 1 CD for every 8 test forms at each grade and tier. The CD can be played on a standard CD player or a computer with a CD/DVD drive with speakers. As an additional option, the Listening Test can be streamed online from a secure MetriTech, Inc. website. 9 Update- Form 302 Listening Test Timing What to do? Use CD or Stream? • Local system personnel will not need to inform Metritech in advance as to ‘how’ the Listening Test will be administered. The CD will be included in the shipment with other materials in January 2014. • If the CD is not going to be used (e.g., suitable equipment is not available) the STC shall contact MetriTech to request the link to the website for streaming the audio. • The Listening audio is a part of secure testing materials, therefore STC may not request the link prior the arrival on materials shipment. • STC may request additional copies of the CDs in the same manner as request are made for other materials by calling or faxing the AMO Order Form to MetriTech. 10 Listening Test- Technology Requirements • CD Player or • Desktop or laptop computer (if playing the CD on the computer or streaming audio from the Internet) • Speakers (Do not use headphones to administer the Listening Field Test) The Listening Test CD can be played on a CD player, or on a desktop or laptop computer. If a computer is used to play the Listening Test CD during the test administration, make sure that the computer is hooked up to working external speakers and meets the minimal technological requirements listed in the table on the following page. 11 Minimal Technical Requirements for Playing an Audio CD on a Computer Internet Provider Type • DSL • Cable • Fiber Optic (FiOS) • Satellite • WiFi hotspot with adequate bandwidth (this can vary depending on the number of users and is not recommended as a first choice for Internet connection.) Hardware Requirements • • • • • • • • 500 NHz processor, AMD, Intel, Via Windows XP or later for PCs OS X or later, Linux 7 or later for Macs 128 MB of RAM or more Supported audio device — onboard or add-in audio card Wired or wireless network connection External speakers Browser of a dedicated software player, such as VLC, Quicktime, WMP, etc. 12 WIDA Password Change Process WIDA will no longer have access to passwords. If someone forgets the password to their account, the WIDA Help Desk can send a link to reset the password. • If you need to update any of your personal information, such as your password, school, or district, please login to the training course and enter your updates under "My Account Info" in the gray column on the main menu page. • To sign in to the training course, please visit www.wida.us. • If you have any questions please contact the WIDA Help Desk, 866-276-7735 or help@wida.us. 13 Identification of ELs Entry/ Exit Guidance 14 Who must be scheduled for ACCESS for ELLs® ? 1. All students designated as “EL-Y” must take the ACCESS assessment 2. Any student who enters the district during the ACCESS testing window and is identified as EL must be administered ACCESS. “EL-M” students should NOT be administered the ACCESS for ELLs® assessment!! $23 = EL-M GaDOE 15 Who may administer ACCESS for ELLs®? Two requirements must be met: 1. Hold a Georgia Professional Standards Commission Certificate and 2. Annually pass the WIDA on-line ACCESS for ELLs® certification with passing score of 80% or higher on modules TA will be administering. GaDOE Kindergarten W-APT® Identification Eligibility for Language Assistance Services for ELs GaDO 17 E K- 12 MODEL® Identification Eligibility for Language Assistance Services for ELs GaDO 18 E Grades 1-12th WAPT Eligibility GaDOE 19 Information and Flow Charts for Eligibility and Exit Criteria for Language Assistance Services may be found in the 2013-2014 ESOL Resource Guide and on the GaDOE ESOL & Title III webpage at: http://www.gadoe.org/Curriculum-Instruction-andAssessment/Curriculum-and-Instruction/Pages/English-toSpeakers-of-Other-Languages-(ESOL)-and-Title-III.aspx GaDOE Tier Structure of ACCESS for ELLs® 6 1 ENTERING 2 3 4 EMERGING DEVELOPING EXPANDING 5 R E A C H I N G BRIDGING Tier A Tier B Grades 1-12 Tier C K – Adaptive GaDOE 21 Tier A Placement Criteria For ELs who: • have arrived in the U. S. or entered school in the U. S. within this academic school year without previous instruction in English; • currently receive literacy instruction only in their native language; and/or • have recently tested at the lowest level of English language proficiency. GaDOE 22 Tier B Placement Criteria For ELs who: • have social language proficiency and some, but not extensive, academic language proficiency in English; and/or • have acquired some literacy in English, though have not yet reached grade-level literacy. Note: 70-80% of ELs will be administered Tier B of ACCESS for ELLs ® GaDOE 23 Tier C Placement Criteria For ELs who: • are approaching grade level literacy and academic language proficiency in the core content areas; and/or • will likely meet the state's exit criteria for support services by the end of the academic year. In Georgia, most students will exit using Tier C GaDOE 24 Tier Placement Summary • Follow Criteria for Tier Placement at www.wida.us) • Use previous test scores (W-APT and ACCESS) • Use teacher judgment – collaborate with general education teacher • If in doubt, place the student in the higher tier GaDOE 25 Reminder: Pre-ID Labels If the label is incorrect, discard the label and bubble in the student information on the front and back covers of the test booklet Pre-ID labels that are incorrect or provided for students who will not be tested may be discarded Do not cross out or write in information on a Pre-ID label: this does not change any data and causes misinformation when tabulating your students’ information GaDOE 26 Reminder: Pre-ID Labels If a label has been placed on a test booklet in error: put an “X” through the demographic information and mark through the bar code, covering it completely using a heavy black marker GaDOE 27 Reminder: Marking Booklets Detailed directions to assist you in filling out the student information on test booklets are on pp. 19-23 of the Test Administration Manual. GaDOE 28 Reminders and Accommodations • Remember, test accommodations are only available to students with disabilities (IEP or 504 Plan in place). • For GaDOE approved Accommodations, refer to Student Assessment Handbook 2013-2014, Accommodations Table 4. • Accommodations by Domain GaDOE 29 Accommodations By Domain Each of the Two Letter Accommodations recorded on the back of the test book will be listed, along with their long name as found in the District and School Test Administration Manual (as shown below) GaDOE 30 Accommodations By Domain To the right of each Accommodation there would be a space for to mark one or all of the domains - in the following order Listening, Reading, Writing and Speaking. GaDOE 31 Test Administration Guidelines • The Test Administration Manual (TAM) has specific instructions and suggestions for administering the test – page numbers are subject to change for this coming administration. • Materials Handling for schools is discussed on pages 5-17. • Test Scheduling and Coordination Information is on pages 33-38. • Test Accommodation Information is on pages 39-45. • Speaking Test Administration Information begins on page 62. • If you have questions about materials, please call MetriTech‘s Customer Service at 800.747.4868. GaDOE 32 Reminder Annual Recertification! Test Administrators and the Online Course: • Do training in own time • Refer back many times if necessary • Access sample items • Access sound files and scoring rationale to calibrate Speaking ratings • Download and print Test Administration Manual (TAM) • Take quizzes for certification (80% is pass) GaDOE 33 Reminder Online Training Course System Test Coordinators are responsible for enrolling all Test Administrators (TAs) in their local district. • To create accounts, visit www.wida.us and click the “Login” button on the top right corner. • To access the account creator, please enter your WIDA website login information. • To remove a login for your district, email help@wida.us with the TA’s name, district, and email address. GaDOE 34 Reminder Recommendation… Prior to ACCESS for ELLs® test administration, share with ELs: 1.Their last ELP levels (ACCESS or W-APT) to aid in setting purpose for the test, and 2.Sample “Retired” ACCESS for ELLs® items to familiarize ELs to testing format. (Download from the WIDA website: http://www.wida.us/assessment/ACCESS/) GaDOE 35 Examiners/ Test Administrators Next Steps • Study TAM* • Watch the Kindergarten training video* • Practice Speaking on-line samples* • Review Writing samples online and in TAM • Take on-line quizzes for TA certification* • Practice entire test administration with materials. (Districts will receive materials from MetriTech one week prior to opening of testing window.) • Remember must group by Tier and Grade Level Cluster! * Password protected on the WIDA website GaDOE 36 The Alternate ACCESS GaDOE 37 Continue to code “SPD” for ELs, who cannot take one or more domains GaDOE 38 GaDOE 39 Who should take the Alternate ACCESS for ELLS? • Only ELs with significant cognitive disabilities. Typically includes students who have one or more of the existing categories of disabilities under IDEA (e.g.; intellectual disabilities, autism, traumatic brain injury, multiple disabilities, etc.). • Students with significant cognitive disabilities may be assessed via an alternate assessment based on alternate achievement standards. The US Department of Education defines an alternate achievement standard as one that “sets an expectation of performance that differs in complexity from a grade-level achievement standard.” Alternate achievement standards must be aligned to state academic content standards, although they may reflect prerequisite or entry-level skills. (Adapted from U. S. Department of Education: Alternate Achievement Standards of Students with the Most Significant Cognitive Disabilities Non Regulatory Guidance, August 2005). GaDOE 40 Georgia Participation Criteria 1. The student has been classified as an EL. 2. The student has been classified as a special education student and is receiving special education services. 3. The student has a significant cognitive disability. 4. The student participates in the Georgia Alternate Assessment (GAA). Importantly, students shall not be administered both the Alternate ACCESS for ELLs and the ACCESS for ELLs. 41 Georgia Test Examiners It is recommended that the examiner be an educator who is familiar with the student and their special needs – and with whom the student feels comfortable. As with the “general” ACCESS for ELLs, all Examiners are required to complete an WIDA online course (that will be specific to the Alternate ACCESS) and earn a qualifying score to administer the assessment. 42 Georgia Accommodations • Always defer to GaDOE’s accommodation policies for language proficiency. • The Alternate ACCESS TAM provides only recommendations on accommodations. • The Student Assessment Handbook, 2013-2014 Table 4 – Approved Accommodations for Students with Disabilities 43 Accommodations Section 4 of the Test Administration Manual 44 GaDOE Assessment Resources The Student Assessment Handbook, 2013-2014 is located on the GaDOE website Assessment Page in the ‘For Educators’ portlet. http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/default.aspx • Participation of EL Students in State Assessments, pages 137140. • Additional Considerations for Accommodations, pages 141-145. • Table 4 – Approved Accommodations for Students with Disabilities, pages 146-149. 45 Georgia’s customized slides from the Introduction to Alternate ACCESS, October 24, 2012, webinar, are located on the WIDA website. Click on: Consortium> Members> Georgia> Assessment Materials & Training The customized slides address our state’s ALT ACCESS participation requirements and use of accommodations. GaDOE 46 Overage Policy Important Reminder About Order Quantities States and districts will be charged for unused test booklets in excess of 15% of the total order. Carefully check your order, only ordering for the population you will be testing. Remember: LEAs will automatically receive 10% overage with order. >15 % = GaDOE 47 Materials Ordering In October 2013, MetriTech emailed materials and Pre-ID ordering information to the System Test Coordinator. During the ordering process, the STC will have the opportunity to update the following: • • • • Name Email Address Phone and Fax numbers Shipping Address – this is where materials will be sent; NO Post Office Boxes! GaDOE 48 Test Materials Ordering Web-Page Ordering – MetriTech Home www.metritech.com GaDOE 49 Test Materials Ordering Web-Page Ordering – Select the Appropriate Test Type GaDOE 50 51 Test Materials Ordering Web ordering not successful? Use the WIDA Order Form link on the MetriTech “Welcome” web page (www.MetriTech.com) to download the required form. Fax it to 217.398.5798 Email it to wida@metritech.com or Call customer service at 800.747.4868 9:00am4:00pmEST for assistance. Large Print or Alternate ACCESS materials may be ordered via customer service. GaDOE 52 Test Materials Ordering Freight Shipping: To handle private carrier freight shipping, districts must this criteria: • • • • • Must receive no less than 4,000 test booklets plus ancillary materials. Receive pallet(s) delivery at dock. Ship return packages via pallet(s). Shrink-wrap pallet(s) prior to return pickup. Requires pallet jack or forklift to load pallet(s) on truck. * If your district/LEA meets the above criteria and you would like materials shipped Freight instead of UPS Ground, please contact MetriTech Customer Support at (800) 747-4868. GaDOE 53 Test Materials Ordering Pre-ID Information and Ordering • A PDF document and Sample Pre-ID spreadsheet detailing specific instructions for supplying your students’ Pre-ID information should be downloaded using appropriate MetriTech “Welcome” web page links. • If you have questions about Pre-ID file creation, please call 800.747.4868 and ask for Pre-ID support team. MetriTech can receive files in the following formats: Excel CSV (Comma Delimited) • Tab Delimited ASCII Text GaDOE 54 Pre-ID Information & Ordering File Layout GaDOE 55 Pre-ID Information & Ordering Sample Excel File: GaDOE 56 Receipt of Materials GaDOE 57 Receipt of Materials As we discuss in the next few slides the receipt of materials for the ACCESS for ELLs, keep in mind that there is a separate set of materials for the Alternate ACCESS. Exception: Receipt of ACCESS for ELLs Materials (Alternate ACCESS) Alternate ACCESS test materials will arrive in a separate shipment. Alternate ACCESS test materials will have unique serial numbers assigned to your district/school and must be returned at the close of the test window. Alternate ACCESS test materials will have their own paperwork mirroring the paperwork for the ACCESS for ELLs materials. GaDOE Receipt of Materials • Districts with 10 or more schools participating will receive the materials packaged by school; otherwise, the materials will be packaged by booklet type. • You will receive one or more boxes. Each box will be identified as containing WIDA Secure Testing Materials and will be numbered – alerting you to the number of boxes you should have received. Cut down and SAVE the boxes for returning the materials to MetriTech. A sticker like this will be on every box you receive GaDOE Receipt of Materials District Bag • • Box 1 will contain the paperwork for the District and the schools. District paperwork is in the first plastic bag. That bag contains the following pages in the order you will see them: Master Materials List – All materials shipped to the district District copy of School Materials Lists (the district overage will be the first sheet) Optional Services Order Form Internal Tracking Security Check List Documentation of Materials Not Returned Additional Materials Order Form Agreement to Maintain Confidentiality Information Agreement to Maintain Confidentiality Letter (stays at District) District School Header Sheet (for materials to be scored) Unused & Non Scorable Testing Materials Header Sheet District and School Test Administration Manual Schedule & Special Instructions for your state GaDOE Receipt of Materials District/LEA Bag Optional Services Order Form Order additional copies of provided reports After processing has been completed and hard copy student reports are available for shipment, each districts’ scored data will be available for secure download from MetriTech’s website (a free service). GaDOE Electronic Data Options By April 18, 2014 STCs may also return the Optional Form (PINK) Call MetriTech to request a CD be created for your system and included with your report shipment in May. After this date, a data CD will cost $50. GaDOE Receipt of Materials Return Instructions: The second plastic bag contains return instructions for the District. After familiarizing yourself with the materials in the bag, move them to a safe place until testing is completed for your District/LEA and you are ready to begin the return process The bag contains: Return Shipping Instructions – 2-sided document District/LEA Packing Instructions – 2-sided document RS – UPS Return Instructions and RS Labels for shipping GaDOE Receipt of Materials School Bag(s): Each school will have its own plastic bag which should be forwarded to the school with their test materials Each bag contains the following: School Materials List – one for each school School Header Sheet Unused & Non Scorable Header Sheet Internal Tracking Security Checklist District & School Test Administration Manual Schedule & Special Instructions for Your State Pre-ID Header (if District has provided Pre-ID data) Pre-ID Labels – sorted by grade, then alpha by student last name, first name, MI, birth date GaDOE Receipt of Materials School Bag(s): School’s Pre-ID Labels GaDOE School Bag(s) Distribution of Materials: After confirming all materials have arrived and your District has what it needs to administer ACCESS, distribute materials to the schools for testing Districts and schools must follow the same security guidelines in place for all state-mandated secure assessments – you must confirm that your district has received all assigned serial bar coded test materials Districts will then distribute the test materials and the school plastic bags to each participating school – assigning serial numbered booklets to each school GaDOE Returning Materials GaDOE 67 Materials Return : Once testing is completed, each school should package their materials as directed and return them to the district– checking to ensure all serial numbered materials assigned are accounted for Districts will double check that ALL materials have been returned and are packaged correctly Districts will seal and update the box labels and put RS labels on all boxes to be shipped Call UPS to schedule a pick-up if the district does not have a regularly scheduled pick-up Call MetriTech customer service at 800.747.4868 if you require assistance with UPS GaDOE Test Materials Ordering Freight Shipping: To handle private carrier freight shipping, districts must this criteria: • • • • • Must receive no less than 4,000 test booklets plus ancillary materials. Receive pallet(s) delivery at dock. Ship return packages via pallet(s). Shrink-wrap pallet(s) prior to return pickup. Requires pallet jack or forklift to load pallet(s) on truck. * If your district/LEA meets the above criteria and you would like materials shipped Freight instead of UPS Ground, please contact MetriTech Customer Support at (800) 747-4868. INSTRUCTIONS for Return: 1. Follow Return Materials Packing Instructions to repackage all test materials. 2. Load boxes neatly on pallet(s). 3. Shrink-wrap each pallet securely. 4. Call MetriTech at (800) 747-4868 to arrange private carrier freight shipping. GaDOE 69 Materials Return MetriTech Receiving: Once materials are in MetriTech’s warehouse, they will confirm that all boxes shipped from a GA school district have been received. If boxes are damaged and/or the paperwork and materials returned do not agree, we will contact the district with questions Scorable booklets are separated for high-speed imaging Non-Scorable materials are serial barcode scanned and then securely recycled. GaDOE MetriTech Scoring Data Validation: After the completion of scanning/scoring for each state, MetriTech will post the demographic data captured for each student to our secure web site. At that point STC will have the opportunity to update the information for their students. Participation in this step helps to ensure the accuracy of student reports (and of the WIDA Dashboard for each state, as well as data collection for the consortium.) GaDOE Questions? GaDOE Questions or Comments? For production, distribution, scoring and reporting questions, contact MetriTech: 1-800-747-4868 or wida@metritech.com For questions specific to Georgia’s ACCESS for ELLs® test administration, contact Deborah Houston, Assessment: (404) 657-0251 or dhouston@doe.k12.ga.us For questions specific to Georgia’s W-APT and ESOL support of ELs, contact Carol Johnson, ESOL & Title III: (404) 463-1858 or cjohnson@doe.k12.ga.us For other questions, contact the WIDA Help Desk: (866) 276-7735 or help@wida.us GaDOE 73 Save the Dates! ACCESS Score Interpretation Post-Assessment Training, via webinar May 7-8, 2014 GaDOE