Winter 2014 Florida Next Generation Sunshine State Standards (NGSSS) End-of-Course (EOC) Assessments Training Materials for School Assessment Coordinators Algebra 1, Biology 1, Civics, Geometry, and U.S. History 1 Test Administration Manual One manual (Winter 2014 NGSSS EOC Manual) is provided for the Winter 2014 administration. Scripts and instructions for administering computer-based tests (CBT) ONLY are included in this manual. Scripts and instructions for administering computer-based and paper-based accommodations are located at www.FLAssessments.com/EOC. 2 TestNav 8 (TestNav) • New Platform for Winter 2014 and beyond • Access www.FLAssessments.com/TestNav8 – Technical Specifications – Resources • Features available to all students: – Color contrast, increase/decrease text size, zoom, magnifier tool, and line reader tool • Accommodated forms: – Text-to-speech and masking 3 CBT Resources • The Technology Coordinator Guide can be accessed at www.FLAssessments.com/AdditionalResour ces. – This guide provides instructions and information that technology coordinators will need to prepare schools for computer-based testing. • Information and instructions for technology coordinators to follow before, during, and after testing are now provided at www.FLAssessments.com/TestNav8 – Technology coordinators must familiarize themselves with all information at this site prior to the beginning of test administration. 4 CBT Test Administrator Quick Reference Guide • The CBT Test Administrator Quick Reference Guide is available at www.FLAssessments.com/A dditionalResources. • This guide lists possible error messages students may encounter, explanations for each message, and troubleshooting solutions. 5 Test Administration Schedule • The Winter 2014 NGSSS EOC testing schedule is December 1-19. – Algebra 1, Biology 1, Civics, Geometry, and US History must be completed by December 19. • The tests may be administered in any order, by school, based on needs of students within a school. One subject test does not need to be completed before another begins, and subject tests may be administered concurrently. – Additionally, testing should be completed within the least number of days possible but must be completed by the last date noted above. • All paper accommodations (for students with documented accommodations only) must be administered on the first five days 6 of testing window; December 1-5. EOC Manual 1, Training Packet Test Administration Schedule Testing Duration • Each NGSSS EOC assessment will be administered in one 160minute session with a scheduled 10-minute break after 80 minutes. Individual restroom breaks are permitted as needed. • Students may not be dismissed during the first 80 minutes. At the beginning of the break, any students who have completed testing may be dismissed. • After the 10-minute break, students may be dismissed from the testing room as they complete testing. • No special incentives should be given to students to encourage them to finish early. • Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day. 7 EOC Manual 1 Students to be Tested Algebra 1 The following students will take the Algebra 1 EOC Assessment: • All students enrolled in and will be completing one of the following courses: – Algebra 1 – 1200310 – Algebra 1 Honors – 1200320 – Algebra 1-B – 1200380 – Pre-AICE Mathematics 1 – 1209810 – IB Middle Years Program/Algebra 1 Honors – 1200390 Note: Students enrolled in an annual course will not test until the spring. 8 EOC Manual 1 Students to be Tested Algebra 1 (cont.) Students are also eligible to participate if they: • Failed the test • Have scores invalidated/no score/no grade (NG) • Are taking a course via part-time virtual program and are at 80% or more complete and recent completers • Are enrolled in the Adult program and are at 80% or more complete and recent completers • Want to take the assessment to earn course credit (Credit Acceleration Program) • Are new to the district (private school, out of state/country) EOC Manual 1 9 Students to be Tested Biology 1 The following students will take the Biology 1 EOC Assessment: • All students enrolled in and completing one of the following courses: – Biology 1 – 2000310 – Biology 1 Honors – 2000320 – Pre-AICE Biology IGCSE Level – 2000322 – Biology Technology – 2000430 – Florida’s Pre-IB Biology 1– 2000800 – IB Biology 1 - 2000805 – IB Middle Years Program Biology – 2000850 – Integrated Science 3 – 2002440 – Integrated Science 3 Honors – 2002450 Note: Students enrolled in an annual course will not test until the spring.10 EOC Manual 2 Students to be Tested Biology 1 (cont.) Students are also eligible to participate if they: • Have scores invalidated/no score/no grade (NG) • Are taking a course via part-time virtual program and are at 80% or more complete and recent completers • Are enrolled in the Adult program and are at 80% or more complete and recent completers • Want to take the assessment to earn course credit (Credit Acceleration Program) Note: Students that have failed the Biology 1 EOC test may participate if they want to pass it to be eligible for a scholar designation. 11 EOC Manual 2 Students to be Tested Civics The following students will take the Civics EOC Assessment: • All students enrolled in and completing one of the following courses: – M/J Civics – 2106010 – M/J Civics – 2106015 – M/J Civics & Career Planning – 2106016 – M/J Civics, Advanced – 2106020 – M/J Civics, Advanced – 2106025 –M/J Civics, Advanced & Career Planning – 2106026 –M/J IB MYP Civics Advanced – 2106027 –M/J IB MYP Civics Advanced & Career Planning – 2106028 –M/J Civics and Digital Technologies – 2106029 –M/J U.S. History & Civics - 2100045 Note: Students enrolled in an annual course will not test until the spring.12 EOC Manual 2 Students to be Tested Civics (cont.) Students are also eligible to participate if they: • Have scores invalidated/no score • Are taking a course via part-time virtual program and are at 80% or more complete and recent completers 13 EOC Manual 2 Students to be Tested Geometry The following students will take the Geometry EOC Assessment: • All students enrolled in and completing one of the following courses: – – – – Geometry – 1206310 Geometry Honors – 1206320 IB Middle Years Program Geometry – 1206810 Pre-AICE Mathematics 2 IGCSE Level – 1209820 Note: Students enrolled in an annual course will not test until the spring. 14 EOC Manual 3 Students to be Tested Geometry (cont.) Students are also eligible to participate if they: • Have scores invalidated/no score/no grade (NG) • Are taking a course via part-time virtual program and are at 80% or more complete and recent completers • Are enrolled in the Adult program and are at 80% or more complete and recent completers • Want to take the assessment to earn course credit (Credit Acceleration Program) 15 EOC Manual 3 Students to be Tested U.S. History The following students will take the U.S. History EOC Assessment: • All students enrolled in and completing one of the following courses: – United States History – 2100310 – United States History Honors – 2100320 – Visions and Countervisions: Europe, U.S. and the World from 1848 – 2100390 – Visions and Countervisions: Europe, U.S. and the World from 1848 Honors – 2100480 Note: Students enrolled in an annual course will not test until the spring. 16 EOC Manual 3 Students to be Tested U.S. History (cont.) Students are also eligible to participate if they: • Have scores invalidated/no score/no grade (NG) • Are taking a course via part-time virtual program and are at 80% or more complete and recent completers • Are enrolled in the Adult program and are at 80% or more complete and recent completers • Want to take the assessment to earn course credit (Credit Acceleration Program) Note: Students that have failed the US History EOC test may participate if they want to pass it to be eligible for a scholar designation. EOC Manual 3 17 Students to be Tested Special Program Students • Miami-Dade Online (M-DOA) • Home Education • Florida Virtual School Full-time (K-8 and High School) English Language Learners (ELLs) All ELLs who complete the applicable courses are expected to participate in EOC assessments no matter how long these students have been receiving services or have been enrolled in a U.S. school. EOC Manual 3-5, Appendix A; Training Packet 18 Students to be Tested Students with Disabilities • Students with disabilities participate in the statewide assessment program by taking one of the following: ̶ EOC assessment without accommodations, ̶ EOC assessment with accommodations, or ̶ Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. • See Appendix A of the manual for information regarding accommodations. 19 EOC Manual 5; Appendix A Students with Disabilities Accommodations • Administration Accommodations − − − − − Flexible Flexible Flexible Flexible Flexible presentation responding scheduling setting Assistive Devices and Tools • Paper-based Accommodations − − − − Regular print Braille Large print (No longer a Unique Accommodation for CBT) One-item-per-page (OIPP) (No longer a Unique Accommodation for CBT) 20 EOC Manual 6; Appendix A Students with Disabilities Accommodated Test Forms TestNav 8: Assigning an Accommodated Form Click “Specify” or “Override” on the Session Details screen to assign a specific form. Form Name in PearsonAccess Accommodations Offered TTS TEXT-TO-SPEECH MASKING ANSWER AND CUSTOM MASKING TTS + MASKING TEXT-TO-SPEECH, ANSWER AND CUSTOM MASKING NOTE: Allowable assistive devices may be used with any TestNav 8 forms. EOC Manual 111-112 21 English Language Learners Accommodations • ESOL Levels 1-4 Only – Students who are currently receiving services in a program operated in accordance with an approved district LEP plan: Flexible Setting Flexible Scheduling Assistance In Heritage Language Approved Dictionary EOC Manual Appendix A 22 SWD and ELL Recording Accommodations • Student accommodations can be recorded in the Test Session Details screen in “Manage Test Sessions” by clicking on a student’s name. – Click the Edit button. • Select the accommodations used by the student in the drop-down menus. • Click the Save button. • Click “Go back to Session Detail” to record accommodations for additional students EOC Manual 127-129 23 File Download Manager (FDM) The following briefings provide pertinent information regarding the EOC: • Briefing ID # 14070: Procedures to Record Courses in 24 the Transcript Review and Course Evaluation (TRACE) System Test Security Per Test Security Statute, s. 1008.24, F.S., and Florida State Board Rule, 6A-10.042, FAC, inappropriate actions by school or district personnel can result in student or classroom invalidations, loss of teaching certification, and/or involvement of law enforcement. Examples of prohibited activities include the following: • Reading or viewing the passages or test items before, during, or after testing • Revealing the passages or test items • Copying the passages or test items • Explaining or reading passages or test items for students • Changing or otherwise interfering with student responses to test items • Copying or reading student responses • Causing achievement of schools to be inaccurately measured or reported 25 EOC Manual 17-18, Appendix C State and District Requirements • Standards, Guidelines, and Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/TestCh airInfo/InfoForTestChair.asp – Adopted by School Board – General Guidelines • Florida Test Security Statute and Rule • Test Security Screencast for Test Administrators and Proctors • School Procedural Checklist (FM-6927) • District Monitors EOC Manual 17-18; Appendix C; Training Packet 26 Test Irregularities/ Missing Materials • Test administrators should report any test irregularities (e.g., disruptive students, loss of Internet connectivity) and possible security breaches to the school assessment coordinator immediately. • Schools must investigate ANY report of missing materials and report missing secure materials (e.g., Student Authorization Ticket, used work folder, Session Roster) to Student Assessment & Educational Testing immediately at 305-995-7520. • If a test irregularity or security breach is identified, the school assessment coordinator must contact Student Assessment & Educational Testing to discuss possible test invalidations. Note: Secure student information (e.g., SSN) must not be communicated via email. EOC Manual 19 27 Test Irregularities/ Security Breaches • For test irregularities requiring further investigation by the district and for security breaches, a written report must be submitted within 7 working days after the irregularity or security breach was identified. The report must include: – – – – The nature of the situation The time and place of the occurrence The names of the people involved A description of the communication between the district assessment coordinator’s office and school personnel – How the incident was resolved – What steps are being taken to avoid future test irregularities or security breaches • Schools should submit completed reports to the Office of Student Assessment & Educational to be forwarded to the FDOE. 28 EOC Manual 19 Electronic Devices • School personnel must ensure that students do not have access to their cell phones or other electronic devices at any time during testing, including breaks (restroom breaks, etc.), even if they do not use them or have them turned off. − “Possession” is defined as “within arm’s reach,” even if the electronic device is not visible. − Students should not have cell phones in their pockets, clipped to their belts, at their desks, or anywhere they can be easily accessed during testing or breaks. • If a student is found to be in possession of ANY electronic devices during testing or during a break, his or her test must be invalidated. • Students and parents/guardians must be made aware of this policy prior to testing. 29 EOC Manual 30, 31, Appendix D Testing Rules Acknowledgment • All EOC assessments include a Testing Rules Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” • The last portion of the testing rules read to students now reads, “After the test, you may not reveal details about the test items to anyone. This includes any type of electronic communication, such as texting, emailing, or posting online, for example, on websites like Facebook, Twitter, or Instagram. If you are found sharing information about test items, your test will be invalidated.” • Students and their parents/guardians should be made aware of the testing rules prior to testing. 30 EOC Manual 32, 34 Caveon Forensic Analyses • Caveon will analyze data to identify highly unusual test results for two primary groups: – Students with extremely similar test responses; and – Schools with improbable levels of similarity, gains and/or erasures. • Only the most extreme results are flagged and withheld – One in a trillion chance of the pattern occurring by chance 31 PreID File and Test Sessions Winter 2014 • Winter PreID file is based on student information as of: October 31 – New students or changes to student demographics after October 31 will not be included in PearsonAccess. – PreID labels will not be generated for PBT accommodations • All students testing on the computer that were captured in the PreID file will be in a class named: FL CLASS • Test sessions were automatically created via the PreID upload. Test sessions are named: – – – – – ALG-ALGEBRA BIO-BIOLOGY CIV-CIVICS GEO-GEOMETRY HIS-HISTORY • PreID information may be verified in PearsonAccess on or after32 November 17. EOC Manual 96-100 and Training Packet Verify Student Information & Create Test Sessions • Print the Session Roster for each test session (Algebra 1, Biology 1, etc.) as applicable • Compare against school generated list to verify: – Student eligibility, and – Student Name and Florida ID number for accuracy • Place verified students in new test sessions or keep them in the original sessions. • Add new students using the “Create New Student wizard” and place them in test sessions. − Note: Management of student information in PearsonAccess can begin on or after November 17 • Maintain a list of test sessions to cache test content for all sessions. – Test sessions can be cached one week prior to the testing window. EOC Manual 96-100 and Training Packet 33 BEFORE TESTING 34 Communicate Testing Policies Students and Parents/Guardians • Electronic Devices Policy—If students are found with ANY electronic devices, including, but not limited to, cell phones and smartphones, during testing OR during breaks, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on testing days. • Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test. Students and parents/guardians should be made aware of this policy. If a student does not feel well on the day of testing, it may be best for the student to wait and be tested on a make-up day. Please make sure parents/guardians are aware of the test administration schedule and understand that appointments should not be scheduled on testing days. EOC Manual 30, 31-32, and Test Chairperson Info Website 35 Communicate Testing Policies, (cont.) Students and Parents/Guardians • Testing Rules Acknowledgment—Prior to testing, students will be asked to affirm a Testing Rules Acknowledgment that reads: “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” • Discussing Test Content after Testing—The last portion of the testing rules read to students before they sign/check the acknowledgment reads, “After the test, you may not reveal details about the test items to anyone. This includes any type of electronic communication, such as texting, emailing, or posting online, for example, on websites like Facebook, Twitter, or Instagram. EOC Manual 31-32 and Test Chairperson Info Website 36 Receive and Prepare Test Materials • You will receive the following materials, as appropriate for your school: – School Boxes (test materials—contents listed on page 91 of the Winter 2014 EOC Manual) – Special Document Boxes • If your school is providing hardcopy CBT Worksheets, reference sheets, or periodic tables, make a sufficient number of copies for all students taking the assessments. Each copy must be carefully checked against the original. • Save the original boxes for returning TO BE SCORED special document materials. • If you need additional materials or if you have questions, contact the Test Distribution Center at 305-995-3743. 37 EOC Manual 91 and 130-141, Appendix D Maintain Security • Inventory the contents of your boxes within 24 hours of receipt and report missing materials immediately. • Report materials discrepancies immediately to Student Assessment Office at 305-995-7520. • Keep materials secure at all times. • Maintain the Test Materials Chain of Custody Form at all times. • No more than three people should have access to the locked storage area. • Do not open shrink-wrapped materials or begin preparing materials (applying student labels) more than three days prior to testing. • Under no circumstances are students permitted to assist in preparing secure materials before testing or in organizing and returning materials after testing. 38 EOC Manual 91, Appendix D, and Training Packet Arrange Practice Test Sessions • All students MUST participate in an ePAT session conducted at their school to familiarize themselves with the different features of the TestNav 8 testing platform. • Schedule and arrange practice tests (ePATs) as described in the Winter 2014 EOC Manual. • Before a student can participate in a computer-based administration, he/she must participate in an ePAT session to familiarize themselves with the different features of the TestNav 8 testing platform. • To access accommodated and non-accommodated CBT practice tests content and scripts for administering the ePATs, go to www.FLAssessments.com/ePATs. 39 EOC Manual 26 Arrange Practice Test Sessions, cont. • Students who require accommodated CBT forms (e.g., text-to-speech and/or masking) must complete a practice test for the specific accommodated form or form combination they will use during testing. 40 EOC Manual 26 Prepare the Room for Testing • Make sure that each room is free of distractions and has – Comfortable seating – Good lighting – Sufficient workspace – Adequate ventilation • Make sure that: – students are not facing each other when seated at tables – there is at least three feet between students – students cannot view others’ computer screens (visual barriers are installed) • Remove or cover all visual aids on student desks or displayed in the room, such as posters showing mathematical and scientific concepts. EOC Manual 27 41 CBT Preparations • Please ensure that: − TestNav 8 has been properly installed and tested before the first day of testing. − Proctor Caching computers have been set up properly. • Each testing computer is configured to refer to a Proctor Caching computer in order to obtain test content. − Test content has been cached for all scheduled test sessions. − Each computer station is equipped with a keyboard and mouse (or other pointing device). − Monitors are correctly displaying test items with shading. − Instant messaging, email notification, screen savers, power savers, and remote desktop are disabled. − Anti-virus, auto-scan and/or auto-update, system restore utilities, Windows Security Firewall, web content filtering, or other software that may impact CPU speed or scan/block information transferred between the workstation and the servers is disabled or delayed. EOC Manual 6, 27, Scripts, Checklists in Appendix D 42 CBT Preparations, cont. • Please ensure that: − Test administrators are familiar with how to access TestNav 8 software from student workstations and how to access the student comment forms. − Proctor Caching computer and Proctor Caching software are turned on and remain running each day of testing. − Any monitoring software that would allow test content on student workstations to be viewed on another computer during testing MUST be turned off. − CBT Test Administrator Quick Reference Guide is used to help diagnose technical issues during testing. − Students and teachers not testing refrain from using any streaming media or other high-bandwidth applications while students are testing. EOC Manual 6, 120, Checklists in Appendix D 43 Test Materials Needed (as applicable): • • • • • • • • • • • • Winter 2014 EOC Test Administration Manual Scripts and Instructions for administering CBT/PBT accommodations Session Roster or Administration Record/Security Checklist Seating Chart Student Authorization Tickets Test Group Code Security Log CBT Work Folders CBT Worksheets Calculators Reference Sheets or Periodic Tables Test and Answer Books (accommodations) 44 EOC Manual 29-31 and www.FLAssessments.com/EOC Winter 2014 EOC Manual • The Winter 2014 End-of-Course Assessments Test Administration Manual must be used to read the non-accommodated CBT test administration script(s) to students. • When testing students with accommodations, you may need to modify the scripts. Review the scripts BEFORE testing begins to determine the necessary modifications. • NEW! The scripts and instructions for the administration of accommodated computer-based test forms (text-to-speech and/or masking) and paper-based accommodations are located at www.FLAssessments.com/EOC. 45 EOC Manual 33, 37-89 and www.FLAssessments.com/EOC Training – Test Administrators and Proctors • • Read the Florida Test Security Statute and the State Board of Education Test Security Rule (Appendix C) in the test administration manual. Ensure that test administrators sign the Test Administration and Security Agreement and Test Administrator Prohibited Activities Agreement • • • • (Appendix D). Train your test administrators and proctors, including non-school-based instructors (e.g., itinerant teachers). Test administrators must be certified educators. Test administrators must NOT administer the EOC assessments to their relatives or friends. If any students who require accommodations are testing at your school, discuss with test administrators how accommodations will be provided (Appendix A). EOC Manual 17-18 and Appendix A, C, D; Training Packet 46 Training – Test Administrators and Proctors, cont. Supervise Test Administration While students are working, ensure that students: • Have cleared the area around their workstations of all materials except for Student Authorization Tickets, pens or pencils, and, as applicable, calculators, work folders, worksheets, reference sheets, and periodic tables. • Check the Testing Rules Acknowledgment box and enter the correct test group code. • Do not have electronic devices (except for approved calculators) of any kind during testing, even if they do not use them. • Do not talk to other students or make any disturbance. • Are working independently. • Are working in the correct test. 47 EOC Manual 35 Training – Test Administrators and Proctors, cont. Supervise Test Administration • It is not appropriate to use cell or classroom phones, grade papers, or work on the computer during testing. • While you may encourage students to continue working, you may not talk with them about test items or help them with their answers. • If a student’s computer is disconnected from the test, contact the school assessment coordinator or technology coordinator to help diagnose any technical issues. The student will need to be resumed in PearsonAccess before logging back in. • If a student has continual difficulty logging in or gets kicked out of the test more than once, do not have the student continue attempting to log in until the issue is diagnosed and resolved. • If students finish the test in the first 80 minutes before the 10-minute break, you may encourage them to go back and check their work. 48 EOC Manual 35, 115 Training – Preparing for CBT • Ensure that all software applications, including Internet browsers, are closed on all student workstations. • Start TestNav, type in the correct URL, and open each student workstation to the student login screen, but do not log in for students. • Display the student comment form URL (www.FLAssessments.com/EOCStudentCommentForm) on the day of testing, or create shortcuts on student workstations to ensure each student is able to complete the form after testing. • Ensure that the test administrator has a way to contact the technology coordinator or school coordinator during testing 49 without leaving the room unattended. EOC Manual 35, 115, scripts Proctors When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors. 1-25 students Test Administrator* 26-50 students Test Administrator and 1 Proctor 51-75 students Test Administrator and 2 Proctors *FDOE strongly encourages the use of proctors in all testing rooms, even those with 25 or fewer students. Note: Students cannot serve as proctors or volunteers. 50 EOC Manual 18 Session Roster • School assessment coordinators will provide a Session Roster (CBT only), which includes the following information: − − − − − − − − Test Administration Session Name Test to be Administered Password Student Names Student ID Numbers Student Birth Dates Class Information − Test Form/Form Group Type − Username − Blank space to record attendance and accommodations information • Session Rosters may be used to record required administration information. 51 EOC Manual 9-10, 155 Session Roster (cont.) Session Rosters must be handled in a secure manner and returned to the school assessment coordinator immediately after each test session is completed. 52 EOC Manual 9-10, 113 Required Administration Information Record the following required information on your Session Roster or Administration Record/Security Checklist: Students assigned to the room Attendance information Accommodations provided to students Accommodations used by students Test group code Unique security number of secure documents assigned to each student (paper-based accommodations only) • Signatures of test administrator and school assessment coordinator • Dates and times for when secure materials are received and returned 53 • • • • • • EOC Manual 27-28 Student Authorization Tickets • • • • NEW: For the test, each student needs a Username and Password, which are printed on the Student Authorization Tickets. Students will need a pen or pencil during testing to sign their tickets. Provide each student a ticket only AFTER all students have entered the testing room, as instructed in the script, and all tickets must be collected BEFORE students leave the testing room. Student Authorization Tickets must be handled in a secure manner and returned to the school assessment coordinator immediately after each day of testing is completed. EOC Manual 7 54 Seating Chart • An accurate seating chart must be maintained for each testing room for each test session. Seating charts should record the following information: − Room name/number − Subject − Student names and their location in the room during testing − Direction students are facing − Date − Starting and stopping times − Test administrator name − Names of proctors (if applicable) − Test group code − Session name in PearsonAccess (CBT) − NEW: Laptop/Mobile Device Assignment (if applicable) • If students are moved to a new location or the seating configuration changes during testing, a new seating chart must be created. 55 EOC Manual 28 and Training Packet (see sample provided) Test Group Code • A test group code is a unique four-digit number used as a security measure to identify a group of students tested together. • School assessment coordinator will provide the test group code. • Each testing room must use a different test group code. • Students will enter the test group code before beginning the test, as indicated in the scripts. • If students are absent for a test session, a different unique code must be used for each make-up session. • The code must be recorded on the required administration information and on each seating chart. 56 EOC Manual 8 Security Log A Security Log must be maintained for each testing room. Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room. 57 EOC Manual 29 and Appendix D Work Folders • The Florida Computer-Based Testing Work Folder is a piece of yellow 11x17 paper folded in half with graph paper printed on the back cover. • For the Algebra 1, Biology 1, and Geometry EOC assessments, students are provided with work folders to work the problems. • Work folders must be distributed to students at the beginning of each test session. • Ensure that students have enough desk space to use their folders. • Collect all work folders when students finish testing before they leave the testing room, and return folders to the school assessment coordinator. • Used work folders are secure materials. 58 EOC Manual 8 CBT Worksheets • If schools choose to provide them, students taking the computer-based Civics and U.S. History Assessment may use a CBT Worksheet to make notes rather than using the CBT notepad tool. • The worksheet is an 8½ x 11 page (located in Appendix D and PearsonAccess) that may be copied and distributed to students at the beginning of a test session. • Students must have enough desk space to use their worksheets. • Collect all worksheets when students finish testing before they leave the testing room, and return worksheets to the school assessment coordinator. • Used worksheets are secure materials. 59 EOC Manual 9 and Appendix D Four-Function Calculators TestNav The computer-based TestNav Algebra 1 and Biology 1 EOC Assessments have a built-in four-function calculator. Students may use the built-in calculator, or they may use a handheld fourfunction calculator. Test administrators should provide handheld calculators at the beginning of a test session to all students who request them. Adequate supply of approved four-function calculators should be made available. Students with visual impairments may use the approved large key/large display calculators or approved talking calculators supplied by the FDOE. 60 EOC Manual 9-10 Scientific Calculators TestNav The TestNav Geometry EOC Assessment has a built-in scientific calculator. Students may use handheld scientific calculators, if the school has chosen to provide them. Handheld scientific calculators will not be provided by the FDOE for students taking the Geometry EOC Assessment using TestNav. The approved talking scientific calculator is the Orion TI-36X or one that is comparable in function to the Orion TI-36X. No other calculators may be used. Students with visual impairments may use large key/large display scientific calculators that are comparable in function to the approved scientific calculators (on pages 9-10 of the Winter 2014 EOC Manual). 61 EOC Manual 9-10 Reference Sheets and Periodic Tables • Reference sheets and periodic tables are provided in an online format only for CBT testers. However, schools may provide hardcopy reference sheets or periodic tables to students. • Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix D of the manual (also available at www.FLAssessments.com/EOC). • If your school will provide hardcopy reference sheets or periodic tables to students, check each copy before distributing to students and follow the instructions in the administration scripts. • Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts. • Once students complete the test session, the test administrator should collect all reference sheets and periodic tables. • Used reference sheets and periodic tables are secure materials. 62 EOC Manual 10 and Appendix D Additional Items • Pens and/or pencils – Ensure each student has a pen or pencil to sign his or her authorization ticket and make notes or work the problems during testing – Students taking paper-based tests must use No. 2 pencils • Clock or watch • Signs (Appendix D) ̶ ̶ Do Not Disturb Sign—display on all entrances Electronic Devices Sign—display where it will be visible to all students in the testing room EOC Manual 29-30 and Appendix D 63 DURING TESTING 64 Supervision of Test Administration • Ensure that test sessions have been started in PearsonAccess • Provide test administrators with additional materials, as necessary. • Monitor each testing room to ensure that test administration and test security policies and procedures are followed, seating charts and Security Logs are properly completed, and required administration information is collected. • Be available during testing to answer questions from test administrators and to ensure that there are no technical issues. • Arrange for and supervise make-up administrations. 65 EOC Manual 115 Monitor Session Status After a session begins, you can monitor the real-time status of students. Refer to the following table for a description of each possible status. 66 EOC Manual 117 Early Warning System • Certain circumstances, such as loss of an Internet connection, trigger the “Early Warning System” (EWS) on the interface that students see during testing. The EWS alerts students to possible problems with the transmission of their test data and allows the test administrator to take action to ensure student responses are captured. 67 EOC Manual Scripts and 119. AFTER TESTING EOC Manual 121-141 68 Test Invalidation • A test MUST be invalidated if either of the following circumstances occurs: ̶ A student has an electronic device during testing ̶ A student is cheating during testing ̶ A student is given an accommodation not allowed on EOC assessments ̶ A student is given an accommodation not indicated on the student’s IEP, Section 504 plan, or ELL plan ̶ An error occurs in test administration or procedures that could compromise the validity of test results ̶ A student is given unauthorized help during testing • A test MAY be invalidated if one of the following circumstances occurs: ̶ A student becomes ill and is unable to finish ̶ A student is not allowed the correct amount of time ̶ A student was not provided an allowable accommodation indicated on the student’s IEP, Section 504 plan, or ELL plan ̶ A disruption occurs during testing (e.g., severe weather) ̶ A student is disruptive during testing 69 EOC Manual 24-25, 126-127 Marking Tests Complete Students should be in “Completed” status after they submit the test. Student tests should only be Marked Complete in one of the following circumstances: • A student had to leave the test (e.g., cheating, illness) and will not finish the test. (After being marked complete, school personnel will invalidate the test.) • A student finished the test but exited instead of submitting the test and the test should be scored. • As otherwise directed by FDOE or Pearson after a technical difficulty or other extenuating circumstance. EOC Manual 124-125 70 School Assessment Coordinator After Testing • CBT clean-up activities must be completed by 4:00 pm on the last day of the testing window. • “Delete” all not started sessions and “Stop” all started sessions • Please remember the following: – Absent students should be removed from the test session (not marked complete). If absent students have already been marked complete, nothing else needs to be done. – Students in “Ready” status must be removed from the session before it can be stopped. – If students are in “Active,” “Exited,” or “Resumed” status, they will need to be marked complete. • • • • Update student information, if necessary. Invalidate tests, if applicable. Record accommodations for ESE and ELL students, if applicable. Ensure that school technology coordinators purge test content from 71 EOC Manual 100, 123-129 the Proctor Caching computer(s). Organizing CBT Materials • • • Verify that all distributed secure materials have been returned. Report any missing materials to Student Assessment & Educational Testing at 305-995-7520 and conduct the necessary investigation. Organize materials and return them as instructed in the “Friendly Reminder” (Training Packet). − Copy the seating charts, required administration information, Session Rosters, Chain of Custody forms, and Security Logs, file the copies, and return the originals in the District Assessment Coordinator ONLY boxes. − Return used and unused CBT work folders and worksheets in the District Assessment Coordinator ONLY Box. − Securely return used reference sheets and used periodic tables in the District Assessment Coordinator ONLY Box. − Inventory and securely store handheld calculators. − Recycle test administration manuals once results are received and verified for all students tested. − Keep Student Authorization Tickets, signed copies of the Test Administration and Security Agreement and Test Administrator Prohibited Activities Agreement Forms for one calendar school year, and then destroy them. EOC Manual 121 72 Paper-Based Tests (PBT) • The following slides relate to the administration of paperbased tests (regular print, large print, one-item-per-page, or braille), which are available for eligible students who have such accommodations identified in their IEPs or Section 504 plans. • The upper-left corner of the following slides show an image of a pencil and a paper-based test (see below) to indicate that this information pertains to paper-based tests only. 73 PBT Materials Materials Needed for Testing • Test Documents ̶ ̶ ̶ ̶ ̶ Algebra 1 EOC Assessment Test and Answer Books Biology 1 EOC Assessment Test and Answer Books Civics EOC Assessment Test and Answer Books Geometry EOC Assessment Test and Answer Books U.S. History EOC Assessment Test and Answer Books • Reference Sheets (Algebra 1 or Geometry) • Periodic Tables (Biology 1) • Calculators (approved four-function or scientific) 74 EOC Manual 30 PBT Chain of Custody Form • The Test Materials Chain of Custody Form is available in Appendix D of the EOC Manual and at www.FLAssessments.com/EOC. • The purpose of this form is to track test materials at all times, including: – their location – the dates and times activities are completed – the names of the persons performing various activities involving the materials • Schools must retain copies (electronic or hardcopy) of completed forms for their files after materials are packaged for pickup and return the originals in the District Assessment Coordinator ONLY Box. 75 EOC Manual 92 and Appendix D PBT Security Numbers • Used to account for each test and answer book. • Consists of a nine-digit number followed by a check digit located in the upper right corner of test and answer books. • Packing list shows the number ranges assigned to each school, and written documentation of the number ranges must be maintained at all times during distribution and return of books. • Test administrator should maintain a list of all secure materials assigned to him or her, including any additional materials assigned throughout the administration. • Blank Administration Record/Security Checklist is provided in PearsonAccess and in Appendix D of the manual. 76 EOC Manual 19-21 and Appendix D PBT Student Demographic Information 77 EOC Manual 11-16, 114, 121-123 PBT Defective Materials, DNS and UNDO Bubbles • If a defective test and answer book is identified before testing begins, the student should be given a replacement document and the defective document should be returned with all other NOT TO BE SCORED materials. • If a student discovers that a document is defective during testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement when the test session is over. – The DNS bubble must be gridded on the defective document and it should be returned with NOT TO BE SCORED materials. • If a defective test and answer book is identified after testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement. The defective document should be returned with all other NOT TO BE SCORED materials. • If a DNS bubble has been gridded by mistake, erase the DNS bubble and grid the UNDO bubble. Package the document with TO BE SCORED materials. 78 EOC Manual 22-23 PBT Return of Materials Return Materials to District Assessment Coordinator After testing, school assessment coordinators should return materials according to the instructions in the EOC Manual: 1. Verify that all distributed secure materials have been returned. Complete your Chain of Custody form. Notify Student Assessment & Educational Testing immediately at 305-995-7520 if any secure materials are missing. 2. Check for and remove any stray reference sheets or periodic tables from test and answer books to prevent issues during the scanning process; however, do NOT review test items or student responses. 3. If a test has been invalidated, verify that the DNS bubble has been gridded and that the document is placed with TO BE SCORED materials. • • Verify that the DNS bubble has been gridded on a defective document and that the document is placed with NOT TO BE SCORED materials. Verify that no DNS bubble has been gridded by mistake. If it has, verify that the DNS bubble has been erased and the UNDO bubble has been gridded and place the document with TO BE SCORED materials. 79 EOC Manual 130-141 and Training Packet (see Friendly Reminder) PBT Document Count Forms Complete Document Count Forms 1. Verify that all documents from make-up sessions are included. 2. Do not copy blank count forms; however, once the count forms are completed, you may copy them for your records. 3. Place each completed form on top of the first stack of corresponding TO BE SCORED test and answer books. 4. Verify the accuracy of all information entered; inaccurate information may delay the scoring process. 80 EOC Manual 130-132 PBT Paper Bands • Each document type must be banded separately. You may use more than one paper band per document type, if necessary. • Documents for each special program (FLVS Full-Time High School, M-DOA, Home Education, etc.) must be banded separately. • Complete all fields on the paper band. 81 EOC Manual 133 PBT Package Materials Package Materials for Return To Be Scored Boxes (Label Colors) Not To Be Scored Boxes (Label Color) PURPLE Labeled Boxes Algebra 1 Biology 1 Civics Geometry US History LARGE PRINT OIPP – YELLOW Labeled Boxes Including unused special documents District Assessment Coordinator Only Box (no label) BRAILLE - PINK 82 EOC Manual 130-141 and Training Packet (see Friendly Reminder) PBT TO BE SCORED Test and Answer Books Packaging Diagram 83 EOC Manual 138 PBT Special Documents Packaging Diagram (Large Print, OIPP, and Braille) 84 EOC Manual 139 EOC Manual 140-141 and Training Packet (see Friendly Reminder) District Assessment Coordinator ONLY Box EOC TEST • • • • • Algebra 1 Biology 1 Civics Geometry US History MATERIALS INCLUDED • • • • • • • • • • Original Administration Record/Security Checklist or school’s developed form Chain of Custody Form (PBT only) Original Security Logs Original Seating Charts CBT Work Folders (used and unused) CBT Worksheets (used and unused) Reference Sheets (used) Periodic Tables (used) Session Rosters Original School Procedural Checklist (FM-6927) LABEL COLOR No Return Label – Mark Box “District Coordinator ONLY” Keep copies of documentation for your records. However, do not make copies of the work folders or worksheets. Note that the Student Authorization Tickets must be kept at the school for one calendar 85 school year. Return Schedule Winter 2014 TO BE SCORED BOXES PURPLE (Regular Print, All subjects) ALGEBRA 1 BIOLOGY 1 CIVICS GEOMETRY US HISTORY WHITE – (Large Print, All subjects) WHITE – (OIPP, all subjects) PINK– (Braille, all subjects) Hand-deliver EOC “To Be Scored” and “Not To Be Scored” paper-based test materials to the Test Distribution Center (TDC) by 3:00 p.m. on: Tuesday, December 9 or Wednesday, December 10 YELLOW* – NOT TO BE SCORED BOXES Note: District Assessment Coordinator ONLY Box/Envelope is due to TDC by January 8 or 9, 2015. 86 Training Packet (see Friendly Reminder) Appendices Appendices in the 2014-2015 EOC Manual include: • Appendix A—Accommodations • Appendix B—Pearson Support and PearsonAccess • Appendix C—Test Security Statute and Rule • Appendix D—Forms, Cover Sheets, Checklists, Signs 87 Comment Forms • After testing, test administrators, school coordinators, and technology coordinators are encouraged to complete the appropriate comment form located at www.FLAssessments.com/EOC. • FDOE and Pearson appreciate feedback from district and school personnel. 88 EOC Manual 153 Reminders Test Security Policies and Procedures • Per Florida State Board of Education Rule 6A-10.042, FAC, and Test Security Statute, s. 1008.24, F.S. (see Appendix C), district and school personnel are required to maintain test security before, during, and after testing. • Please remember that inappropriate actions can result in student or classroom invalidations and/or loss of teaching certification. • All school personnel, including itinerant teachers and proctors, must receive thorough training in test administration and security policies and procedures, familiarize themselves with all relevant content of the test administration manual, read the Statute and Rule in Appendix C, and then sign a Test Administration and Security Agreement (Appendix D). 89 EOC Manual 17-18; Appendix C and D Reminders Test Administrator Policies • ALL test administrators must be certified educators. • Test administrators are required to sign a Test Administrator Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document. • The Florida EOC Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement may be copied together so that double-sided, single-page copies can be distributed to test administrators. • School assessment coordinators must file the signed forms with their signed security agreements. • Test administrators must NOT administer the EOC assessments to their family members EOC Manual 19-20; Appendix C and D 90 Pearson Support and PearsonAccess Contact Pearson Support at: • 1-877-847-3043 (Monday–Friday, 7:00 am–8:30 pm ET) • Florida@support.pearson.com Appendix B in the Winter 2014 EOC Manual provides the following information: • PearsonAccess ̶ User accounts (FDOE distributed instructions for setting up user accounts to district assessment coordinators.) ̶ Browser requirements ̶ Logging in for the first time ̶ Resetting passwords • Training Center ̶ Test Setup Exercise EOC Manual Appendix B 91 Contact Information Student Assessment and Educational Testing Maria C. Bruguera, Director mbruguera@dadeschools.net Mara Ugando, Staff Specialist mugando@dadeschools.net ITS - Infrastructure and System Support Mr. Javier Perez, Executive Director JPerez@dadeschools.net Telephone Number: 305-995-3331 Mr. Roly Avila, Supervisor RAvila@dadeschools.net Telephone Number: 305-995-3334 Phone: 305-995-7520 Fax: 305-995-7522 92 Thank you for ensuring secure and successful administrations of the EOC assessments this year. 93