Winter 2014 Florida Next Generation Sunshine State Standards (NGSSS) End-of-Course (EOC) Assessments Training Materials for Test Administrators Algebra 1, Biology 1, Civics, Geometry, and U.S. History 1 Test Administration Manual One manual (Winter 2014 NGSSS EOC Manual) is provided for the Winter 2014 administration. Scripts and instructions for administering computer-based tests (CBT) ONLY are included in this manual. Scripts and instructions for administering computer-based and paper-based accommodations are located at www.FLAssessments.com/EOC. 2 TestNav 8 (TestNav) • New Platform for Winter 2014 and beyond • Access www.FLAssessments.com/TestNav8 – Technical Specifications – Resources • Features available to all students: – Color contrast, increase/decrease text size, zoom, magnifier tool, and line reader tool • Accommodated forms: – Text-to-speech and masking 3 CBT Test Administrator Quick Reference Guide • The CBT Test Administrator Quick Reference Guide is available at www.FLAssessments.com/A dditionalResources. • This guide lists possible error messages students may encounter, explanations for each message, and troubleshooting solutions. 4 Test Administration Schedule • The Winter 2014 NGSSS EOC testing schedule is December 1-19. – Algebra 1, Biology 1, Civics, Geometry, and US History must be completed by December 19. • The tests may be administered in any order, by school, based on needs of students within a school. One subject test does not need to be completed before another begins, and subject tests may be administered concurrently. – Additionally, testing should be completed within the least number of days possible but must be completed by the last date noted above. • All paper accommodations (for students with documented accommodations only) must be administered on the first five days 5 of testing window; December 1-5. EOC Manual 1, Training Packet Test Administration Schedule Testing Duration • Each NGSSS EOC assessment will be administered in one 160minute session with a scheduled 10-minute break after 80 minutes. Individual restroom breaks are permitted as needed. • Students may not be dismissed during the first 80 minutes. At the beginning of the break, any students who have completed testing may be dismissed. • After the 10-minute break, students may be dismissed from the testing room as they complete testing. • No special incentives should be given to students to encourage them to finish early. • Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day. 6 EOC Manual 1 Students to be Tested Students with Disabilities • Students with disabilities participate in the statewide assessment program by taking one of the following: ̶ EOC assessment without accommodations, ̶ EOC assessment with accommodations, or ̶ Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. • See Appendix A of the manual for information regarding accommodations. 7 EOC Manual 5; Appendix A Students with Disabilities Accommodations • Administration Accommodations − − − − − Flexible Flexible Flexible Flexible Flexible presentation responding scheduling setting Assistive Devices and Tools • Paper-based Accommodations − − − − Regular print Braille Large print (No longer a Unique Accommodation for CBT) One-item-per-page (OIPP) (No longer a Unique Accommodation for CBT) 8 EOC Manual 6; Appendix A English Language Learners Accommodations • ESOL Levels 1-4 Only – Students who are currently receiving services in a program operated in accordance with an approved district LEP plan: Flexible Setting Flexible Scheduling Assistance In Heritage Language Approved Dictionary EOC Manual Appendix A 9 Test Security Per Test Security Statute, s. 1008.24, F.S., and Florida State Board Rule, 6A-10.042, FAC, inappropriate actions by school or district personnel can result in student or classroom invalidations, loss of teaching certification, and/or involvement of law enforcement. Examples of prohibited activities include the following: • Reading or viewing the passages or test items before, during, or after testing • Revealing the passages or test items • Copying the passages or test items • Explaining or reading passages or test items for students • Changing or otherwise interfering with student responses to test items • Copying or reading student responses • Causing achievement of schools to be inaccurately measured or reported 10 EOC Manual 17-18, Appendix C Test Irregularities/ Missing Materials • Test administrators should report any test irregularities (e.g., disruptive students, loss of Internet connectivity) and possible security breaches to the school assessment coordinator immediately. • Schools must investigate ANY report of missing materials and report missing secure materials (e.g., Student Authorization Ticket, used work folder, Session Roster) to Student Assessment & Educational Testing immediately at 305-995-7520. • If a test irregularity or security breach is identified, the school assessment coordinator must contact Student Assessment & Educational Testing to discuss possible test invalidations. Note: Secure student information (e.g., SSN) must not be communicated via email. EOC Manual 19 11 Electronic Devices • School personnel must ensure that students do not have access to their cell phones or other electronic devices at any time during testing, including breaks (restroom breaks, etc.), even if they do not use them or have them turned off. − “Possession” is defined as “within arm’s reach,” even if the electronic device is not visible. − Students should not have cell phones in their pockets, clipped to their belts, at their desks, or anywhere they can be easily accessed during testing or breaks. • If a student is found to be in possession of ANY electronic devices during testing or during a break, his or her test must be invalidated. • Students and parents/guardians must be made aware of this policy prior to testing. 12 EOC Manual 30, 31, Appendix D Testing Rules Acknowledgment • All EOC assessments include a Testing Rules Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” • The last portion of the testing rules read to students now reads, “After the test, you may not reveal details about the test items to anyone. This includes any type of electronic communication, such as texting, emailing, or posting online, for example, on websites like Facebook, Twitter, or Instagram. If you are found sharing information about test items, your test will be invalidated.” • Students and their parents/guardians should be made aware of the testing rules prior to testing. 13 EOC Manual 32, 34 BEFORE TESTING 14 Prepare the Room for Testing • Make sure that each room is free of distractions and has – Comfortable seating – Good lighting – Sufficient workspace – Adequate ventilation • Make sure that: – students are not facing each other when seated at tables – there is at least three feet between students – students cannot view others’ computer screens (visual barriers are installed) • Remove or cover all visual aids on student desks or displayed in the room, such as posters showing mathematical and scientific concepts. EOC Manual 27 15 Test Materials Needed (as applicable): • • • • • • • • • • • • Winter 2014 EOC Test Administration Manual Scripts and Instructions for administering CBT/PBT accommodations Session Roster or Administration Record/Security Checklist Seating Chart Student Authorization Tickets Test Group Code Security Log CBT Work Folders CBT Worksheets Calculators Reference Sheets or Periodic Tables Test and Answer Books (accommodations) 16 EOC Manual 29-31 and www.FLAssessments.com/EOC Winter 2014 EOC Manual • The Winter 2014 End-of-Course Assessments Test Administration Manual must be used to read the non-accommodated CBT test administration script(s) to students. • When testing students with accommodations, you may need to modify the scripts. Review the scripts BEFORE testing begins to determine the necessary modifications. • NEW! The scripts and instructions for the administration of accommodated computer-based test forms (text-to-speech and/or masking) and paper-based accommodations are located at www.FLAssessments.com/EOC. 17 EOC Manual 33, 37-89 and www.FLAssessments.com/EOC Training – Test Administrators and Proctors • • Read the Florida Test Security Statute and the State Board of Education Test Security Rule (Appendix C) in the test administration manual. Ensure that test administrators sign the Test Administration and Security Agreement and Test Administrator Prohibited Activities Agreement • • • • (Appendix D). Train your test administrators and proctors, including non-school-based instructors (e.g., itinerant teachers). Test administrators must be certified educators. Test administrators must NOT administer the EOC assessments to their relatives or friends. If any students who require accommodations are testing at your school, discuss with test administrators how accommodations will be provided (Appendix A). EOC Manual 17-18 and Appendix A, C, D; Training Packet 18 Training – Test Administrators and Proctors, cont. Supervise Test Administration While students are working, ensure that students: • Have cleared the area around their workstations of all materials except for Student Authorization Tickets, pens or pencils, and, as applicable, calculators, work folders, worksheets, reference sheets, and periodic tables. • Check the Testing Rules Acknowledgment box and enter the correct test group code. • Do not have electronic devices (except for approved calculators) of any kind during testing, even if they do not use them. • Do not talk to other students or make any disturbance. • Are working independently. • Are working in the correct test. 19 EOC Manual 35 Training – Test Administrators and Proctors, cont. Supervise Test Administration • It is not appropriate to use cell or classroom phones, grade papers, or work on the computer during testing. • While you may encourage students to continue working, you may not talk with them about test items or help them with their answers. • If a student’s computer is disconnected from the test, contact the school assessment coordinator or technology coordinator to help diagnose any technical issues. The student will need to be resumed in PearsonAccess before logging back in. • If a student has continual difficulty logging in or gets kicked out of the test more than once, do not have the student continue attempting to log in until the issue is diagnosed and resolved. • If students finish the test in the first 80 minutes before the 10-minute break, you may encourage them to go back and check their work. 20 EOC Manual 35, 115 Training – Preparing for CBT • Ensure that all software applications, including Internet browsers, are closed on all student workstations. • Start TestNav, type in the correct URL, and open each student workstation to the student login screen, but do not log in for students. • Display the student comment form URL (www.FLAssessments.com/EOCStudentCommentForm) on the day of testing, or create shortcuts on student workstations to ensure each student is able to complete the form after testing. • Ensure that the test administrator has a way to contact the technology coordinator or school coordinator during testing 21 without leaving the room unattended. EOC Manual 35, 115, scripts Session Roster • School assessment coordinators will provide a Session Roster (CBT only), which includes the following information: − − − − − − − − Test Administration Session Name Test to be Administered Password Student Names Student ID Numbers Student Birth Dates Class Information − Test Form/Form Group Type − Username − Blank space to record attendance and accommodations information • Session Rosters may be used to record required administration information. 22 EOC Manual 9-10, 155 Session Roster (cont.) Session Rosters must be handled in a secure manner and returned to the school assessment coordinator immediately after each test session is completed. 23 EOC Manual 9-10, 113 Required Administration Information Record the following required information on your Session Roster or Administration Record/Security Checklist: Students assigned to the room Attendance information Accommodations provided to students Accommodations used by students Test group code Unique security number of secure documents assigned to each student (paper-based accommodations only) • Signatures of test administrator and school assessment coordinator • Dates and times for when secure materials are received and returned 24 • • • • • • EOC Manual 27-28 Student Authorization Tickets • • • • NEW: For the test, each student needs a Username and Password, which are printed on the Student Authorization Tickets. Students will need a pen or pencil during testing to sign their tickets. Provide each student a ticket only AFTER all students have entered the testing room, as instructed in the script, and all tickets must be collected BEFORE students leave the testing room. Student Authorization Tickets must be handled in a secure manner and returned to the school assessment coordinator immediately after each day of testing is completed. EOC Manual 7 25 Seating Chart • An accurate seating chart must be maintained for each testing room for each test session. Seating charts should record the following information: − Room name/number − Subject − Student names and their location in the room during testing − Direction students are facing − Date − Starting and stopping times − Test administrator name − Names of proctors (if applicable) − Test group code − Session name in PearsonAccess (CBT) − NEW: Laptop/Mobile Device Assignment (if applicable) • If students are moved to a new location or the seating configuration changes during testing, a new seating chart must be created. 26 EOC Manual 28 and Training Packet (see sample provided) Test Group Code • A test group code is a unique four-digit number used as a security measure to identify a group of students tested together. • School assessment coordinator will provide the test group code. • Each testing room must use a different test group code. • Students will enter the test group code before beginning the test, as indicated in the scripts. • If students are absent for a test session, a different unique code must be used for each make-up session. • The code must be recorded on the required administration information and on each seating chart. 27 EOC Manual 8 Security Log A Security Log must be maintained for each testing room. Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room. 28 EOC Manual 29 and Appendix D Work Folders • The Florida Computer-Based Testing Work Folder is a piece of yellow 11x17 paper folded in half with graph paper printed on the back cover. • For the Algebra 1, Biology 1, and Geometry EOC assessments, students are provided with work folders to work the problems. • Work folders must be distributed to students at the beginning of each test session. • Ensure that students have enough desk space to use their folders. • Collect all work folders when students finish testing before they leave the testing room, and return folders to the school assessment coordinator. • Used work folders are secure materials. 29 EOC Manual 8 CBT Worksheets • If schools choose to provide them, students taking the computer-based Civics and U.S. History Assessment may use a CBT Worksheet to make notes rather than using the CBT notepad tool. • The worksheet is an 8½ x 11 page (located in Appendix D and PearsonAccess) that may be copied and distributed to students at the beginning of a test session. • Students must have enough desk space to use their worksheets. • Collect all worksheets when students finish testing before they leave the testing room, and return worksheets to the school assessment coordinator. • Used worksheets are secure materials. 30 EOC Manual 9 and Appendix D Four-Function Calculators TestNav The computer-based TestNav Algebra 1 and Biology 1 EOC Assessments have a built-in four-function calculator. Students may use the built-in calculator, or they may use a handheld fourfunction calculator. Test administrators should provide handheld calculators at the beginning of a test session to all students who request them. Adequate supply of approved four-function calculators should be made available. Students with visual impairments may use the approved large key/large display calculators or approved talking calculators supplied by the FDOE. 31 EOC Manual 9-10 Scientific Calculators TestNav The TestNav Geometry EOC Assessment has a built-in scientific calculator. Students may use handheld scientific calculators, if the school has chosen to provide them. Handheld scientific calculators will not be provided by the FDOE for students taking the Geometry EOC Assessment using TestNav. The approved talking scientific calculator is the Orion TI-36X or one that is comparable in function to the Orion TI-36X. No other calculators may be used. Students with visual impairments may use large key/large display scientific calculators that are comparable in function to the approved scientific calculators (on pages 9-10 of the Winter 2014 EOC Manual). 32 EOC Manual 9-10 Reference Sheets and Periodic Tables • Reference sheets and periodic tables are provided in an online format only for CBT testers. However, schools may provide hardcopy reference sheets or periodic tables to students. • Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix D of the manual (also available at www.FLAssessments.com/EOC). • If your school will provide hardcopy reference sheets or periodic tables to students, check each copy before distributing to students and follow the instructions in the administration scripts. • Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts. • Once students complete the test session, the test administrator should collect all reference sheets and periodic tables. • Used reference sheets and periodic tables are secure materials. 33 EOC Manual 10 and Appendix D Additional Items • Pens and/or pencils – Ensure each student has a pen or pencil to sign his or her authorization ticket and make notes or work the problems during testing – Students taking paper-based tests must use No. 2 pencils • Clock or watch • Signs (Appendix D) ̶ ̶ Do Not Disturb Sign—display on all entrances Electronic Devices Sign—display where it will be visible to all students in the testing room EOC Manual 29-30 and Appendix D 34 DURING TESTING 35 Supervision of Test Administration • Ensure that test sessions have been started in PearsonAccess • Provide test administrators with additional materials, as necessary. • Monitor each testing room to ensure that test administration and test security policies and procedures are followed, seating charts and Security Logs are properly completed, and required administration information is collected. • Be available during testing to answer questions from test administrators and to ensure that there are no technical issues. • Arrange for and supervise make-up administrations. 36 EOC Manual 115 Monitor Session Status After a session begins, you can monitor the real-time status of students. Refer to the following table for a description of each possible status. 37 EOC Manual 117 Early Warning System • Certain circumstances, such as loss of an Internet connection, trigger the “Early Warning System” (EWS) on the interface that students see during testing. The EWS alerts students to possible problems with the transmission of their test data and allows the test administrator to take action to ensure student responses are captured. 38 EOC Manual Scripts and 119. AFTER TESTING EOC Manual 121-141 39 Test Invalidation • A test MUST be invalidated if either of the following circumstances occurs: ̶ A student has an electronic device during testing ̶ A student is cheating during testing ̶ A student is given an accommodation not allowed on EOC assessments ̶ A student is given an accommodation not indicated on the student’s IEP, Section 504 plan, or ELL plan ̶ An error occurs in test administration or procedures that could compromise the validity of test results ̶ A student is given unauthorized help during testing • A test MAY be invalidated if one of the following circumstances occurs: ̶ A student becomes ill and is unable to finish ̶ A student is not allowed the correct amount of time ̶ A student was not provided an allowable accommodation indicated on the student’s IEP, Section 504 plan, or ELL plan ̶ A disruption occurs during testing (e.g., severe weather) ̶ A student is disruptive during testing 40 EOC Manual 24-25, 126-127 Paper-Based Tests (PBT) • The following slides relate to the administration of paperbased tests (regular print, large print, one-item-per-page, or braille), which are available for eligible students who have such accommodations identified in their IEPs or Section 504 plans. • The upper-left corner of the following slides show an image of a pencil and a paper-based test (see below) to indicate that this information pertains to paper-based tests only. 41 PBT Materials Materials Needed for Testing • Test Documents ̶ ̶ ̶ ̶ ̶ Algebra 1 EOC Assessment Test and Answer Books Biology 1 EOC Assessment Test and Answer Books Civics EOC Assessment Test and Answer Books Geometry EOC Assessment Test and Answer Books U.S. History EOC Assessment Test and Answer Books • Reference Sheets (Algebra 1 or Geometry) • Periodic Tables (Biology 1) • Calculators (approved four-function or scientific) 42 EOC Manual 30 PBT Security Numbers • Used to account for each test and answer book. • Consists of a nine-digit number followed by a check digit located in the upper right corner of test and answer books. • Packing list shows the number ranges assigned to each school, and written documentation of the number ranges must be maintained at all times during distribution and return of books. • Test administrator should maintain a list of all secure materials assigned to him or her, including any additional materials assigned throughout the administration. • Blank Administration Record/Security Checklist is provided in PearsonAccess and in Appendix D of the manual. 43 EOC Manual 19-21 and Appendix D PBT Defective Materials, DNS and UNDO Bubbles • If a defective test and answer book is identified before testing begins, the student should be given a replacement document and the defective document should be returned with all other NOT TO BE SCORED materials. • If a student discovers that a document is defective during testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement when the test session is over. – The DNS bubble must be gridded on the defective document and it should be returned with NOT TO BE SCORED materials. • If a defective test and answer book is identified after testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement. The defective document should be returned with all other NOT TO BE SCORED materials. • If a DNS bubble has been gridded by mistake, erase the DNS bubble and grid the UNDO bubble. Package the document with TO BE SCORED materials. 44 EOC Manual 22-23 Appendices Appendices in the 2014-2015 EOC Manual include: • Appendix A—Accommodations • Appendix B—Pearson Support and PearsonAccess • Appendix C—Test Security Statute and Rule • Appendix D—Forms, Cover Sheets, Checklists, Signs 45 Comment Forms • After testing, test administrators, school coordinators, and technology coordinators are encouraged to complete the appropriate comment form located at www.FLAssessments.com/EOC. • FDOE and Pearson appreciate feedback from district and school personnel. 46 EOC Manual 153 Reminders Test Security Policies and Procedures • Per Florida State Board of Education Rule 6A-10.042, FAC, and Test Security Statute, s. 1008.24, F.S. (see Appendix C), district and school personnel are required to maintain test security before, during, and after testing. • Please remember that inappropriate actions can result in student or classroom invalidations and/or loss of teaching certification. • All school personnel, including itinerant teachers and proctors, must receive thorough training in test administration and security policies and procedures, familiarize themselves with all relevant content of the test administration manual, read the Statute and Rule in Appendix C, and then sign a Test Administration and Security Agreement (Appendix D). 47 EOC Manual 17-18; Appendix C and D Reminders Test Administrator Policies • ALL test administrators must be certified educators. • Test administrators are required to sign a Test Administrator Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document. • The Florida EOC Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement may be copied together so that double-sided, single-page copies can be distributed to test administrators. • School assessment coordinators must file the signed forms with their signed security agreements. • Test administrators must NOT administer the EOC assessments to their family members EOC Manual 19-20; Appendix C and D 48 Pearson Support and PearsonAccess Contact Pearson Support at: • 1-877-847-3043 (Monday–Friday, 7:00 am–8:30 pm ET) • Florida@support.pearson.com Appendix B in the Winter 2014 EOC Manual provides the following information: • PearsonAccess ̶ User accounts (FDOE distributed instructions for setting up user accounts to district assessment coordinators.) ̶ Browser requirements ̶ Logging in for the first time ̶ Resetting passwords • Training Center ̶ Test Setup Exercise EOC Manual Appendix B 49 Thank you for ensuring secure and successful administrations of the EOC assessments this year. 50