District Test Coordinator Spring 2012 Pretest Workshop End-of-Course (EOC) Tests January 24 and 25, 2012 Louisiana Department of Education and Pacific Metrics Corporation Rebecca Clifton―Technology Coordinator May 2012 EOC Tests Key Dates Key Dates February 7–9 Hands-on training workshops March 26 Test Coordinators Manual available April 9–20 Registration window April 4 Test Administration Manual available April 18 Half-day Deadline for ordering braille materials and sessions Communication Assistance scripts April 23–May 18 Testing window May 25 Rescoring deadline #1 June 18 Rescoring deadline #2 Rescore #1 date – rescore results will be returned prior to the summer retest registration window. 2 May 2012 EOC Test Administration • Algebra I Operational Test* • English II Operational Test • Geometry Operational Test • Biology Operational Test • English III Operational Test • US History Field Test *Applied Algebra I form for students enrolled in the Applied Algebra course 3 Required Student Participation All public school students (including students in charters and lab schools) completing one of the following courses in May 2012 must participate in the administration. EOC Test Course Code Algebra I 160321 Applied Algebra I 160331 Algebra I, Part 2 160338 Integrated Mathematics I 160339 Algebra I, Middle School 160380 English II Test English II 120332 Geometry Test Geometry 160323 Applied Geometry 160332 Biology Test Biology 150301 English III Test English III 120333 US History Field Test US History 220403 Algebra I Test 4 Course Spring 2012 EOC Tests Training Workshops Hands-On Training Workshops Feb. 7, 2012 Ouachita Parish—O.P. Instructional Annex Feb. 8, 2012 East Baton Rouge Parish—Christa McAuliffe Center Feb. 9, 2012 St. Bernard Parish—Chalmette Elementary Half-day sessions • – Morning: 8:30 A.M.–11:30 A.M. – Afternoon: 12:30 P.M.–3:30 P.M. Pre-registration required via CourseWhere STCs and Teachers/Test Administrators are encouraged to attend. • • 5 EOC Tests Home Page www.louisianaeoc.org • Provides log-in access to the administrative menus and demonstration site • Provides links to testing materials, manuals, guides, and other important resources • Contains up-to-date bulletins on EOC testing 6 Online Demonstration Site • Available February 2 to District and School Test Coordinators, Teachers, Test Administrators, and students at https://eocdemo.louisianaeoc.org −Account Creation Code: EOCDemo123 • Allows administrative users to practice registration and test administration tasks • Allows students to complete a sample test to become familiar with the EOC Tests system interface • Provides ability to create training accounts for schoollevel workshops or independent trainings 7 EOC Tests System Tutorial • Available year-round for District and School Test Coordinators, Teachers, Test Administrators, and students from the EOC Tests home page under the Technology Resources tab • Provides an audio-visual tour of the EOC Tests system • Teaches the user to navigate through the system • Provides helpful tips for users 8 Assessment Materials • Test Coordinators Manual (TCM) • Test Administration Manual (TAM) • Technology Guidelines • Assessment Guides for Algebra I, English II, Geometry, Biology, English III, and US History • Testing materials – – – – Algebra I, Geometry, and Biology Typing Help Geometry Reference Sheet Graph paper Writer’s Checklist and Model Bibliographic and Parenthetical Citation pages for English II and English III – Online calculator 9 Registration Alerts • District Test Coordinator ID and password letters for the 2011–2012 school year were e-mailed on October 17, 2011. – If you do not have the letters from October, contact the EOC Tests Help Desk. • DTCs should review School Test Coordinator contact information and issue ID and password letters to each STC. • DTCs must schedule schools for testing before STCs can begin registering their students. • Registering during the two-week window gives your school the opportunity to plan ahead. 10 Test Preparation Alerts • Student enrollment data will be uploaded into the EOC Tests system from a file provided by the LDOE. • For students who have EOC Tests as part of their graduation requirements: – Retest students will be uploaded into Retester classes for Algebra I, English II, Geometry, and Biology 11 Test Preparation Alerts (cont’d) • Student enrollment data does not include the assignment of testing accommodations. – Prior to testing, accommodations must be entered for all students with special education, section 504, or LEP status. Note: If accommodations are not assigned to students before testing begins, students will not receive the accommodations Large Print or Tests Read Aloud and the correct online form will not be assigned for students using braille. This could result in an administrative error. 12 Test Accommodations for Students with Disabilities • Large Print – Online accommodated form – Provides a larger type-size that may be adjusted by students • Tests Read Aloud – For operational tests, an online accommodated form provides audio. – For field tests, a script must be ordered from LDOE to read aloud to students. • Braille 13 – Provides students with a braille version of the operational tests – Must be ordered from Pacific Metrics – The test administrator must enter student responses online. Test Accommodations for Students with Disabilities (cont’d) • Communication Assistance – A script is provided to use for signing or cueing the test to students who are hearing-impaired. – Script must be ordered from LDOE. – Students must test in a small group. • Answers Recorded − Allowed for students who are unable to use a keyboard or write responses − Administered individually to allow the student to dictate or sign their responses • Assistive Technology – Calculator may be used for entire EOC test if an approved accommodation. The online calculator is not provided for all test items, so a manual calculator must be available to students. 14 Test Accommodations for Students with Disabilities (cont’d) • Extended/Adjusted Time – Student must be given sufficient time to respond to every test question. – Tests must be completed within scheduled testing dates, including makeup testing dates. • Individual/Small Group Administration − For students requiring more attention − Maximum of 8 students • Transferred Answers – Allowed for students who are unable to use a keyboard – Test administrator must enter responses online exactly as student wrote them. • 15 Other – Must not breach security or invalidate the purpose of test Test Accommodations for LEP Students • Tests Read Aloud • Extended/Adjusted Time • Individual/Small Group Administration • Provision of English/Native Language Word-toWord Dictionary (No Definitions) • Test Administered by ESL teacher or by Individual Providing Language Services 16 Accommodated Test Forms • Algebra I, English II, Geometry, Biology, and English III Tests – – – – Online Large-print form Online Tests Read Aloud form Communication Assistance Script Braille form (not available for the Applied Algebra form) • US History Field Test – Online Large-print form – Tests Read Aloud/Communication Assistance Script – Braille form is not available for field tests. NOTE: Braille forms, Communication Assistance Scripts, and Tests Read Aloud/Communication Assistance Scripts must be ordered by April 18, 2012. 17 Scheduling Reminders • There are no time limits for the EOC tests. • The suggested times are estimates only. • Although it is important to use the computer resources efficiently, it is essential that each student have sufficient time to complete the test. • Not allowing sufficient time is considered an administrative error. • When scheduling session 1 of the English II and English III tests, make sure that all students have ample time to finish their compositions because the writing session must be completed on the same day it is begun. Scheduling Reminders (cont’d) • When scheduling computer labs and classrooms, make sure to allow time for make-up testing. • Student reports are only available to teachers during the test administration and approximately one week following each administration. – Approximately 2 to 3 weeks after each administration, student reports for standards-based subjects will be available to STCs from the Reports, Previous Administrations feature. • Student CSV score (grade) files are only available to teachers, STCs, and DTCs during the test administration. Suggested Testing Times ALGEBRA I* Session 1 2 3 Total Description Multiple choice, no calculator Constructed response, calculator Multiple choice, calculator Items 25 3 25 53 Testing Time 40 minutes 20 minutes 40 minutes 100 minutes *Applied Algebra I form for students enrolled in the Applied Algebra course ENGLISH II Session 1 2 3 Total Description Writing prompt Multiple choice, passage-based and discrete Multiple choice, passage-based and discrete Items 1 Testing Time 45 minutes 24* 40 minutes 32* 40 minutes 57 125 minutes *The number of items in sessions 2 and 3 may vary for the English II test, depending on the form that a student receives. 20 Suggested Testing Times (cont’d) GEOMETRY Session 1 2 3 Total Description Multiple choice, no calculator Constructed response, calculator Multiple choice, calculator Items 25 3 25 53 Testing Time 40 minutes 20 minutes 40 minutes 100 minutes Items 25 3 25 53 Testing Time 40 minutes 20 minutes 40 minutes 100 minutes BIOLOGY Session 1 2 3 Total 21 Description Multiple choice Constructed response Multiple choice Suggested Testing Times (cont’d) ENGLISH III Session 1 2 3 Total Description Writing prompt Items 1 Testing Time 45 minutes Multiple choice, passage-based and discrete 36* 40 minutes Multiple choice, passage-based and discrete 22* 40 minutes 59 125 minutes *The number of items in sessions 2 and 3 may vary for the English III test, depending on the form that a student receives. US HISTORY Session 1 2 3 Total 22 Description Multiple choice Constructed response Multiple choice Items 25 3 25 53 Testing Time 40 minutes 20 minutes 40 minutes 100 minutes Test Administration Alerts • The daily access code is unique to each class and must be retrieved each day prior to testing. • Teachers/Test Administrators must make sure that students with accommodations receive their accommodations during testing (i.e., correct test form, extended time, etc.). • Students must exit sessions correctly to receive scores two school days after exiting the third session. • The secure browser must be closed after each student has finished testing and at the end of the testing day. – The administrator password to exit the secure browser is the same for the duration of the test administration. – This password is secure and must not be shared with students. 23 Test Administration Alerts (cont’d) • Bandwidth requirements for US History are expected to be higher than other EOC tests. – The test will include graphics, photographs, and maps. • Recommendations for planning: – US History bandwidth requirements will be e-mailed to DTCs and District Technology Coordinators by Feb. 2, 2012 and included in the Technology Guidelines. DTCs and District Technology Coordinators should work with their Internet Service Provider (ISP) to determine district bandwidth caps and options for making changes during critical times. Make sure the number of students testing concurrently at each school is limited to what the infrastructure can support. If possible, schedule US History testing during slower testing periods within the district. 24 Types of EOC Tests System Reports • Standards-based reports (include scale scores and achievement levels) – Algebra I English II Geometry – Biology – – • Raw-score reports (include number and percent correct) – English III (Standards-based reports for English III will be available in September 2012.) • Field test reports (Include raw score for multiple-choice items only.) – US History NOTE: Reports from Previous Administrations are available from the DTC and STC menus under the Reports tab. Student-level Reports District Level • In past EOC test administrations, DTCs have not had access to student level test results during testing. An enhancement is being implemented for May 2012, which will provide DTCs with direct access to a District-Level CSV Student Score File. • District Test Coordinators have access to district- and school-level reports for all schools in their district. The following reports become available to the District Test Coordinator approximately three weeks after an administration. – – – – – – 26 Student Report Student Item Analysis Report Class Report School Report School CSV File District CSV File Yearly Summary Reports (District Level) • Projected to be released in early August (Combine December and May administrations.) • Available to District Test Coordinators only − District Summary Report − District Achievement Level Report − District Subgroup Report − District Economic Status Report − District Special Education Exceptionality Report − District Test Accommodations Report − District Subgroup CSV File 27 Yearly Summary Reports (School Level) • Projected to be released in early August (Combine December and May administrations.) • Available to District and School Test Coordinators – School Economic Status Report – School Subgroup Report – School Special Education Exceptionality Report – School Achievement Level Report 28 School-level Reports • Reports available to STCs and Teachers during each administration – – – – Student Report Student Item Analysis Report Class Report CSV Student Score File (standards-based subjects only) • School Test Coordinators have access to reports for their school only. • Teachers have access to reports for their students only. – Reports are only available to teachers during a test administration and approximately one week after the administration ends. 29 School-level Reports (cont’d) • Reports available to STCs after each administration (standards-based only) – – – – – 30 Student Report Student Item Analysis Report Class Report School Report School CSV File Resource Material for Reports • End-of-Course Tests Interpretive Guide – Describes all reports in detail – Available from home page, https://www.louisianaeoc.org, under Instructional Resources tab • End-of-Course Tests System User Guide – Describes procedures for accessing EOC reports during and after the testing window and for accessing Student Test History – Available from DTC and STC menus under the Reports tab 31 New System Features (December 2011) • Added District CSV Upload feature • Added STC Edit Class Roster feature Released new version of EOC secure browser • – Windows v2.30.3 – Mac v1.23.0 32 New System Features (May 2012) • Add Student CSV Score File to DTC menu – Allows District Test Coordinators to generate a CSV file with student scores (by subject area) • New DTC report with daily testing information – Summarizes testing information by school and subject (i.e., number of students registered, number of students tested) • • Enhancements to District CSV Upload Enhancements to Avery Labels and Student Rosters – Displays asterisk when students have assigned accommodations 33 New System Features (cont’d) (May 2012) • Enhancements to Student Testing Environment – Allows students to use tab key to indent text when writing essays or answering constructed-response questions 34 Student Test History Function • Allows DTCs and STCs to search and display a student’s test history across EOC operational administrations. (Student Test History Reports can also be downloaded and printed.) – DTCs can search across all districts. – STCs can search within their school. • Allows DTCs to search for students who match a selected set of demographic information – State ID – Last name, first name, and district code • 35 Allows DTCs to download a district history data file that contains student test histories associated with the district, including test histories for current and past students Student Test History Function (cont’d) • Allows DTCs to merge student test history records based on a selected set of demographic information – Merge feature (DTCs only) is currently available during EOC test administrations and in between administrations. – Feature is not available immediately after an administration when administrations are closed, and history data is being captured. – Schedule time to complete merges between February 6th – May 21st 36 EOC Rescore Process • Parents and students may request the rescoring of an EOC test if the test is high stakes (counts as part of the student’s graduation requirement), and the student’s scale score is within 10 points of the Fair achievement level. • Additional information about the Rescoring Process, and the Request for Rescoring form can be found on the EOC Tests home page under Test Coordinator Materials tab. 37 Summer Retest Administration • Retest administration for Algebra I, Applied Algebra I, English II, Geometry, and Biology students – Potential retesters will be populated into the EOC Tests System. – Reports for retesters will be available to the STC at the school where the student was enrolled during the school year. – Student scores will be available within two school days after a student completes all three test sessions. Key Dates 38 June 18–22 Registration Window June 25–29 Testing Window EOC Client Services Each District Test Coordinator and Technology Coordinator is assigned a direct Pacific Metrics point of contact. • Direct technical support is provided to districts that experience major issues during testing. • – It is important that District Test and Technology Coordinators monitor the reopened test sessions report at the end of each testing day. • 39 Tools are used to monitor the EOC Tests system and network traffic during testing. Technology Strategies • Develop a strong relationship between DTCs, District Technology Coordinators, Network Administrators, and STCs. • Involve District Technology Coordinators and Network Administrators in assisting schools in EOC testing preparation. • Assign a Technology Coordinator at each school and provide training, if necessary. • Make sure the School Technology Coordinator has contact information for the District Technology Coordinator/Network Administrator. • Establish a procedure for reporting technical issues to the District Technology or Test Coordinator. 40 General Technology Recommendations • Prepare computer labs/classrooms carefully and well in advance of the beginning of testing • Make sure all district and school personnel are aware of EOC testing dates and understand the impact of daily tasks on EOC testing – – – – – 41 Video streaming Teleconferencing Uploading grade files Running reports Backing up data Technology Preparation The EOC Tests secure browser should be downloaded. • – The old version of the EOC browser (copper-colored icon) should be removed and a new version must be downloaded to all computers that will be used for testing. The new version has a blue icon. The Scalable Vector Graphics (SVG) Viewer should be installed. This is required to properly display the graphics in the EOC tests. (You can go to step 1 on the EOC home page to check the SVG viewer.) The contrast setting on computer monitors should be checked prior to testing. (You can go to step 2 on the EOC home page to check the contrast.) • • 42 Technology Preparation (cont’d) Computers should be tested using the EOC Tests compatibility script. • – This script allows you to check the configuration of each computer prior to administering the tests. District and School Technology Coordinators should work with the network administrator to make sure labs are configured properly and security settings will not affect testing. • – Security software on each computer should be checked to ensure EOC is added as a trusted site. – If using AVG security software, temporarily disable the identity protection and resident shield components. 43 District-level Technology Preparation • Bypass the EOC IP address in the firewall (205.140.219.21). • Disable content filters (temporarily). • Disable proxy servers, if possible (temporarily). • Disable server caching (temporarily). • Disable software that attempts to refresh desktop images or to capture student’s screens (Deepfreeze, Fortress, etc.). • Deactivate programs that block access to links to MP3 files. 44 District-level Technology Preparation (cont’d) • Prioritize the EOC Tests System so incoming/outgoing traffic is a high priority. • Schedule district activities that could consume Internet bandwidth late in the day (large print jobs, grade uploading, video teleconferencing, etc.). • Add a rule to the Internet filter to allow all hosts direct access to EOC (https://www.louisianaeoc.org). • Ensure that permissions are provided to the School Technology Coordinator so downloads (Adobe Flash, SVG viewer, etc.) are not blocked on lab/classroom computers. 45 School-level Test Preparation • Avoid using wireless networks in labs/classrooms, if possible. • Verify routers are working correctly and that bandwidth load is distributed appropriately. • Check cables in the labs/classrooms to ensure they are secure and are the correct type (ex: CAT5e is rated for 200 Mb/s and CAT 6 cables are rated for 1 Gb/s). • Relocate power strips in the labs/classrooms so they cannot be easily “tripped” by students kicking them during testing. 46 School-level Test Preparation (cont’d) • Check computers to ensure sound devices are enabled (not muted) and the volume is set at a medium level. • Ensure that lab/classroom computers are configured to minimize cheating. − Use manila folders or other visual barriers to prevent students from viewing other students’ computer screens. • Ensure that each lab/classroom has a place to post important information. – The daily access code – Instructions on how to properly exit a test session by clicking the exit button and not by turning the machine off or using Ctrl + Alt + Del 47 Technology Resources • EOC Technology Guidelines – Available from the EOC Tests home page, https://www.louisianaeoc.org, (under the Technology resources tab) • EOC Tests Help Desk – 866-810-1095 (available from 7:00 – EOChelp@LouisianaEOC.org 48 A.M.–5:00 P.M. CT) English II/English III EOC Field Tests • English II − One writing session (approximately 50 minutes) • English III − One writing session (approximately 50 minutes) 49 English II/English III Field Test Key Dates Key Dates March 26 Test Coordinators Manual available* April 9–20 Registration window April 4 Test Administration Manual available* April 13 Deadline for ordering Tests Read Aloud/Communication Assistance scripts April 18–April 20sessions Eng II/Eng III Field Test window Half-day *An Eng II/Eng III section will be included in the Spring 2012 Test Coordinators Manual and Test Administration Manual. 50 Field Test Assignment • Most schools will be assigned one field test. • Eng II FT will be assigned to approximately 33% of the schools. • Eng III FT will be assigned to approximately 40% of the schools. • US History will be assigned to approximately 33% of the schools. • A small percentage of schools (7%) will have to administer both the Eng II and Eng III field tests. − No student in these schools will have to take both of the field tests 51 Field Test Participation and Notification • Schools not assigned the US History field test may participate in the test. − Students will have to be entered/uploaded into the EOC Tests system by the DTC/STC. • Assignments will be made by February 17 − Pacific Metrics will notify DTCs − DTCs will notify schools 52 Additional Field Test Information • Accommodated Field Test Forms (English II, English III) – Online Large-print form – Tests Read Aloud/Communication Assistance Script – Braille form is not available for field tests. • Student score reports will not be available. 53