Spring 2015 Florida Standards Assessments Training Materials Computer-Based Grades 5–11 ELA Reading; Grades 5–8 Mathematics; and Algebra 1, Geometry, and Algebra 2 EOC Assessments Paper-Based Grades 3 & 4 ELA Reading and Mathematics Overview District and school personnel should read and have access to the following materials, available in the FSA Portal only: – Grades 3 & 4 FSA TA Manual (for Test Administrators) – Spring 2015 Scripts and Instructions for Administering Paper-Based FSA Assessments (Grades 5-11 ELA Reading, Grades 5-8 Mathematics, and EOCs) (for School Assessment Coordinators and Test Administrators) – Spring 2015 Scripts for Administering Computer-Based FSA Accommodations (for School Assessment Coordinators and Test Administrators) – 2014–2015 FSA Paper-Based Materials Returns Instructions (for District and School Assessment Coordinators) – TIDE User Guide (for District and School Assessment Coordinators) – Test Administrator User Guide (for School Assessment Coordinators , Test Administrators, and Technology Coordinators) – ORS User Guide (District and School Assessment Coordinators) 4 Test Administration Manual—CBT Scripts and instructions for administering the computer-based Grades 5–11 FSA ELA Reading; Grades 5 –8 FSA Mathematics; and FSA Algebra 1, Geometry, and Algebra 2 End-of-Course (EOC) assessments are included in the Spring 2015 FSA CBT Manual. 5 Test Administration Manual—PBT (Online Only) For the Spring 2015 administration of Grades 3 & 4 FSA ELA Reading and Mathematics, there is not a separate hardcopy test administration manual. Instead, test administrators must refer to the Grades 3 & 4 FSA TA Manual, which is available ONLY in the portal, for scripts for administering the paper-based Grades 3 & 4 FSA ELA Reading and Mathematics, as well as test administrator responsibilities before, during, and after testing. Test administrators must familiarize themselves with these instructions prior to testing. For test administration and security policies and procedures, test administrators should read the appropriate sections of the Spring 2015 FSA CBT Manual, including the General Information sections and the Test Security Statute and Rule in Appendix B. 6 FSA Paper-Based Materials Return Instructions District and school personnel should refer to the 2014–2015 FSA Paper-Based Materials Return Instructions, available in the FSA Portal, for guidance regarding the packaging and return of paper-based materials after testing. This information is not provided in the test administration manuals for the FSA assessments. 7 Test Administration Schedule Grade Levels Tested by Subject and Mode 10 Test Administration Schedule Session Lengths by Grade Level and Subject FSA ELA Reading Component All FSA ELA Reading Component assessments are administered in two sessions over two days. Grade Session Length Number of Sessions 3 80 minutes 2 4 80 minutes 2 5 80 minutes 2 6 85 minutes 2 7 85 minutes 2 8 85 minutes 2 9 90 minutes 2 10 90 minutes 2 11 90 minutes 2 11 Test Administration Schedule Session Lengths by Grade Level and Subject FSA Mathematics All FSA Mathematics assessments are administered over two days. For Grades 6–8, the three sessions may be administered as determined by the district: Sessions 1 and 2 on Day 1 and Session 3 on Day 2, OR Session 1 on Day 1 and Sessions 2 and 3 on Day 2. Grade Session Length Number of Sessions 3 80 minutes 2 4 80 minutes 2 5 80 minutes 2 6 60 minutes 3 7 60 minutes 3 8 60 minutes 3 12 Test Administration Schedule Session Lengths by Grade Level and Subject FSA EOC Assessments All FSA EOC assessments are administered in two sessions over two days. Any student who has not completed the session by the end of the allotted time may continue working; however, each session may last no longer than half the length of a typical school day. 13 Subject Session Length Number of Sessions Algebra 1 90 minutes 2 Geometry 90 minutes 2 Algebra 2 90 minutes 2 Test Administration Schedule • Test administrators must allow the exact amount of time allotted for test sessions and must not collect test materials or instruct students to submit computer-based tests until the end of the test session. • While some students may finish before the time allotted for testing ends, this policy is in place to provide a fair environment for students who require all or most of the allotted time and to avoid pressuring any student to finish early. 14 Glossary of Terms • American Institutes for Research (AIR): AIR is the assessment vendor for FSA assessments. • Data Recognition Corporation (DRC): DRC is the vendor responsible for processes associated with paper-based FSA materials, including printing, shipping, receiving, and scanning. • District/School Labels: Districts and schools will receive District/School Labels, which must be applied to hand-gridded test and answer books. If a document is hand-gridded and an On-Demand PreID Label cannot be printed, then a District/School Label must be applied to ensure the student’s results are reported to the correct district and school. 15 Glossary of Terms • DO NOT PROCESS Labels: Districts and schools will receive DO NOT PROCESS Labels, which must be applied to any USED NOT TO BE SCORED test and answer books that should NOT be scanned or counted for participation (i.e., responses were transcribed into another test and answer book). The DO NOT PROCESS Label should be applied in the same location as the PreID or District/School Label and should cover the label currently on the test and answer book. • FSA Portal: Resources and information for district and school personnel are located in the FSA Portal, which is accessed at www.FSAssessments.org. The portal is organized by user roles and also includes links to the Test Delivery System (TDS), Test Information Distribution Engine (TIDE), and Online Reporting System (ORS). 16 Glossary of Terms • On-Demand PreID Labels: On-Demand PreID Labels may be printed locally for any students who were not included in the original PreID upload for this administration or for students who transferred to a school after the PreID upload. Districts and schools will receive blank labels for printing On-Demand PreID Labels. • Online Reporting System (ORS): ORS allows school and district personnel to track the progress of student computerbased testing and access student results. ORS is accessed via the FSA Portal using the same username and password used to access other AIR systems. 17 Glossary of Terms • School Box Range Sheet: The School Box Range Sheet shows the number of boxes packaged for each site within a district. For district sites, the School Box Range Sheet will identify the number of boxes packaged for each school and the district. For school sites, the School Box Range Sheet will identify the total number of boxes shipped to the school. • Secure Browser: The secure browser allows students to access the computer-based FSA assessments. This software must be installed on all computers or devices that will be used for student testing. A link to download the secure browser is located in the FSA Portal. 18 Glossary of Terms • Session ID: Session IDs are unique codes generated by the Test Administrator Interface. In addition to their Username and First Name, students use the Session ID to log in to computer-based FSA assessments. Test Administrators must record the Session ID as part of their required administration information. • Student Interface: Students use the Student Interface to log in to and take computer-based FSA tests. • Test Administrator Interface: Test administrators use the Test Administrator Interface to create and monitor test sessions for all computer-based FSA assessments. 19 Glossary of Terms • Test Delivery System (TDS): All computer-based FSA assessments are administered via TDS, which includes the Test Administrator Interface as well as the Student Interface. • Test Information Distribution Engine (TIDE): TIDE is the enrollment and user management system for the FSA assessments. Student enrollment and test eligibility information is managed via TIDE. All school and district personnel who will administer FSA assessments must have user accounts in TIDE. • Test Tickets: Test Tickets contain login information for students. Each student must have a test ticket to log in to computer-based FSA assessments. Test tickets are generated in TIDE and contain the following fields: Username, Last Name, First Name (password), Grade, Date of Birth, Student ID Number, District, and School. 20 FSA Help Desk Contact the FSA Help Desk at: • 1-866-815-7246 (Monday–Friday, 7:00am–8:30 pm ET) • fsahelpdesk@air.org 21 Navigating This Presentation • In the slides that follow, the right portion of the header will indicate when slides are relevant to computer-based testing (CBT), paperbased testing (PBT), or both: • Prior to the role-specific sections in the last half of this presentation (e.g., Test Administrator Before Testing), instances of test administrator, school assessment coordinator, and technology coordinator are bold-faced in order to clearly indicate to which roles each slide relates. 22 Students to Be Tested CBT PBT All students enrolled in tested grade levels/subject participate in the Spring 2015 FSA administration with or without accommodations, per Section 1008.22(3)(a), Florida Statutes. Special Program Students • Make arrangements to test special program students (Home Education, McKay Scholarship, FTC Scholarship, Virtual School, etc.). The parent/guardian is responsible for contacting the district to register the student for the selected assessments and for transporting the student to and from the district-assigned testing location. The parent/guardian is also responsible for providing the following to the testing location on or before the day of the test: all student demographic information, photo identification (if the student is unknown to the test administrator or other school staff), and emergency contact information. 23 Students to Be Tested CBT PBT English Language Learners (ELLs) • All ELLs participate in statewide assessments. • ELLs who have been enrolled in a U.S. school for less than one year may be exempt from the FSA ELA Reading &Writing assessments. Exempt ELLs must participate in CELLA. • All ELLs enrolled in tested grade levels and subjects are expected to participate in FSA Mathematics and EOC assessments no matter how long these students have been enrolled in a U.S. school. • See Appendix A of the Spring 2015 FSA CBT Manual for information regarding allowable accommodations for ELLs. 24 Students to Be Tested CBT PBT Students with Disabilities • Students with disabilities participate in the statewide assessment program by taking one of the following: – FSA without accommodations, – FSA with accommodations, or – Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. • See Appendix A of the Spring 2015 FSA CBT Manual for information regarding allowable accommodations for students with disabilities. 25 CBT PBT Accommodations General Information about Accommodations • Appendix A in the Spring 2015 FSA CBT Manual provides information concerning allowable accommodations for students with disabilities and ELLs. The test administrator and the school assessment coordinator are responsible for ensuring that arrangement for accommodations have been made prior to the test administration dates. • For eligible students participating in the paper-based Grades 3 & 4 FSA ELA Reading and FSA Mathematics assessments, the following accommodations are available: Large print Contracted braille Uncontracted braille One-item-per-page 26 CBT PBT Accommodations General Information about Accommodations (cont.) For eligible students participating in the computer-based FSA ELA Reading, Mathematics, and EOC assessments, the following accommodations are available: • Accommodated Computer-Based Forms Masking Masking + Text-to-speech Text-to-speech • Reading Passage Booklets Regular print reading passage booklets large print reading passage booklets • Paper-Based Test Materials Regular print Uncontracted braille Large print One-item-per-page Contracted braille 27 Make-Up Administration Procedures CBT PBT • All security and administration procedures must be followed while conducting make-up tests. Please remember that after ANY administration, initial or make-up, secure materials must be returned immediately to the school assessment coordinator and placed in locked storage. Secure materials must never remain in classrooms or be removed from the school’s campus overnight. • For all FSA assessments, sessions must be completed in the designated order. For example, Session 1 MUST be completed before Session 2. For assessments with three sessions, students must complete Session 1 and Session 2 before completing Session 3. Any students absent for a session may not participate in the next session until they have completed the session that they missed. For make-up testing, two-day tests should still be administered over two days. 28 Test Materials PBT Grades 3 and 4 students participating in the Spring 2015 FSA ELA Reading and Mathematics administrations will receive the following test materials: • Grade 3 ELA Reading Test and Answer Book • Grade 3 Mathematics Test and Answer Book • Grade 4 ELA Reading Test and Answer Book • Grade 4 Mathematics Test and Answer Book • Directions for Completing the Grades 3 & 4 FSA ELA Reading Items • Directions for Completing the Grades 3 & 4 FSA Mathematics Items Students taking Grades 3 and 4 Mathematics are not provided with standalone references sheets, calculators, or rulers for this test administration. Students taking paper-based tests are not provided with CBT Worksheets, Work Folders, or scratch paper of any kind. 29 Test Materials CBT Students participating in the computer-based Grades 5–11 FSA ELA Reading Component, Grades 5–8 FSA Mathematics, and FSA EOC assessments will receive the following materials as applicable: • CBT Worksheets (ELA Reading Component only) • Florida Computer-Based Testing Work Folders (Mathematics and EOCs only) • Reading Passage Booklets (ELA Reading Component with eligible accommodation only) Paper-based accommodated test materials will be provided for students who require them. 30 Test Materials CBT CBT Worksheets CBT Worksheets, provided for students taking the FSA ELA Reading Component, are single-page, letter-sized worksheets. Students may use the front and back of the worksheet to take notes during each session of ELA Reading. The Testing Rules Acknowledgement is printed on the back of the CBT Worksheet. CBT Worksheets are not provided for students testing with paperbased accommodations. These students may use the blank space in their test and answer books to take notes. Used worksheets are considered secure materials and must be kept in locked storage and returned in the District Assessment Coordinator ONLY box. 31 Test Materials CBT Work Folders Florida Computer-Based Testing Work Folders, provided for students taking FSA Mathematics and EOCs, are four-page folders that students may use to work the mathematics problems. The Testing Rules Acknowledgment is printed on page two. The last page of the folder (back cover) is printed with graph paper. Work folders are not provided for students testing with paperbased accommodations. These students may use the blank space in their test and answer books to work the problems. Used work folders are considered secure materials and must be kept in locked storage and returned in the District Assessment Coordinator ONLY box. 32 Test Materials CBT Reading Passage Booklets Reading Passage Booklets are provided for eligible students taking a computer-based ELA Reading assessment who have this accommodation indicated in their IEPs or Section 504 plans. Regular print and large print versions of the passage booklets are available. The booklet contains reading passages but do not contain test items. Students may write in the booklets but will respond to test items on the computer or device they will use for the assessment. Reading Passage Booklets are secure materials and must be stored in a secure location before and after testing. 33 Test Materials CBT Scientific Calculators Grades 7 and 8 FSA Mathematics and Algebra 1, Geometry, and Algebra 2 EOC assessments include a scientific calculator in the test delivery system. The scientific calculator is available for Session 2 and 3 of the Grades 7 and 8 Mathematics and for Session 2 of the Algebra 1, Geometry, and Algebra 2 EOCs. Handheld scientific calculators MAY will be provided to ALL students during the appropriate test sessions. FDOE is not providing a list of approved handheld calculators; instead, a list of required and prohibited functionalities is available in the FSA Portal. Providing a calculator in the incorrect test session or with prohibited functionalities is cause for test invalidation. 34 Test Materials CBT Headphones/Earbuds • Grades 5–11 students MUST have headphones or earbuds for the CBT ELA Reading Component assessment. • FDOE does not provide headphones or earbuds. Students may use their own. These should be checked to ensure they work with the computer or device the students will use for the assessment prior to the first day of testing. • A sound check is built in to the assessment, and students are asked to verify that headphones and earbuds are working prior to entering the test. 35 Test Materials CBT Computer Preparations The AIR Secure Browser must be installed on all computers or devices that students will use for testing. Instructions for installing the Secure Browser are available in the FSA Portal. Information on devices supported for testing may be found in the System Requirements for Online Testing, also available in the portal. Support During Testing During testing, a test administrator should not attempt to resolve technical issues if it is disruptive to students. The test administrator must have a way to contact the school assessment coordinator or technology coordinator without leaving the room unattended. If a student has difficulty logging in or gets kicked out of his or her test more than once, the student should not continue to attempt to log in until the issue is diagnosed and resolved. 36 CBT PBT Test Security Per Test Security Statute, s. 1008.24, F.S., and Florida State Board Rule, 6A10.042, Florida Administrative Code (FAC), inappropriate actions by school or district personnel can result in student or classroom invalidations, loss of teaching certification, and/or involvement of law enforcement. Examples of prohibited activities include the following: • Reading or viewing the passages or test items before, during, or after testing • Revealing the passages or test items • Copying the passages or test items • Explaining the passages or test items for students • Changing or otherwise interfering with student responses to test items • Copying or reading student responses • Causing achievement of schools to be inaccurately measured or reported 43 Test Security Policies and Procedures CBT PBT • The security of all test materials must be maintained before, during, and after test administration. Under no circumstances are students permitted to assist in preparing secure materials before testing or in organizing and returning materials after testing. • After ANY administration, initial or make-up, secure materials (e.g., passage booklets, test tickets, used worksheets, used work folders) must be returned immediately to the school assessment coordinator and placed in locked storage. The Test Materials Chain of Custody Form must be maintained at all times. 44 Test Security Policies and Procedures CBT PBT • No more than three people should have access to the locked storage room. Secure materials must never be left unsecured and must not remain in classrooms or be taken off the school’s campus overnight. Secure materials should never be destroyed (e.g., shredded, thrown in the trash), except for soiled documents, as described in the “Hazardous Materials” section of the Spring 2015 FSA CBT Manual. • Any monitoring software that would allow test content on student workstations to be viewed or recorded on another computer during testing must be turned off. 45 Test Security Policies and Procedures CBT PBT • School administrators, school assessment coordinators, technology coordinators, test administrators, and proctors must receive adequate training prior to test administration and all personnel must sign and return a Test Administration and Security Agreement stating that they have read and agree to abide by all test administration and test security policies and procedures. Additionally, any other person who assists the school assessment coordinator, technology coordinator, or test administrator must sign and return an agreement. • Test administrators must sign a Test Administrator Prohibited Activities Agreement, located in Appendix D of the Spring 2015 FSA CBT Manual. Remember that ALL test administrators must be certified educators. Non-certified school personnel must NOT be allowed to serve as test administrators. 46 Test Security Policies and Procedures CBT PBT • Each school is required to maintain an accurate Security Log, provided in Appendix D of the Spring 2015 FSA CBT Manual, and an accurate seating chart for each testing room. Anyone who enters a testing room for the purpose of monitoring the test is required to sign the log. This applies to test administrators, proctors, and anyone who relieves a test administrator, even for a short break, regardless of how much time he or she spends monitoring a testing room. • Test administrators must NOT administer tests to their family members. Students related to their assigned test administrator should be reassigned to an alternate test administrator. In addition, under NO circumstances may a student’s parent/guardian be present in that student’s testing room. 47 Test Security Policies and Procedures CBT PBT Proctors When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors. PBT (Grades 3-4 and PBT Accommodations) CBT (Grades 5-11) Proctors Required 1-30 students 1-25 students Test Administrator 31-60 students 26-50 students Test Administrator and 1 Proctor 61-90 students 51-75 students Test Administrator and 2 Proctors 48 Test Security Policies and Procedures CBT PBT Proctors (cont.) • FDOE strongly recommends the use of proctors in all testing rooms, even those with fewer than 26 (CBT) or 31 (PBT) students whenever possible. • Proctors and anyone who assists with any aspect of test preparation or administration must be informed of the test security laws and rules prohibiting any activities that may threaten the integrity of the test. Each proctor who monitors a testing room for any length of time must sign a Test Administration and Security Agreement and the Security Log for that room. 49 Test Security Policies and Procedures CBT PBT Proctors (cont.) • School personnel and non-school personnel may be trained as proctors. Prior to testing, all proctors should be informed or their duties and of the appropriate test security policies and procedures. School personnel duties may include preparing and distributing materials. Non-school personnel may assists test administrators during test administration; however, they may NOT participate in any of the test administration procedures (e.g., distributing and collecting test materials, providing accommodations). Volunteers (e.g., parents, retired teachers) may be trained as proctors and may perform non-school personnel duties. • All proctors may help monitor rooms during test administration; however, they may NOT assist in rooms where their family members are testing. 50 Test Security Policies and Procedures CBT PBT Security Numbers All regular print test and answer books, Reading Passage Booklets, and special document (large print, braille, and one-item-per-page) test materials are secure documents and must be protected from loss, theft, and reproduction in any medium. A unique identification number and a bar code are printed on the front cover of all secure documents. The security number consists of the last eight digits of the identification number. These eight digits are located under the barcode on the right. In the sample barcode, the security number is 00000001. 51 Test Security Policies and Procedures CBT PBT Security Numbers (cont.) A range sheet on top of each pack of test and answer books identifies the range of security numbers in the pack. Schools are expected to maintain test security by using the security numbers to account for all secure test materials before, during, and after test administration until the time they are returned to the contractor. 52 Test Security Policies and Procedures PBT Hazardous Materials • If a used test and answer book is soiled (e.g., with blood or vomit), the district assessment coordinator should email the security number to the FSA Help Desk, attention DRC, at fsahelpdesk@air.org. At their discretion, school personnel may transcribe the responses into a replacement test and answer book. • The damaged test and answer book should then be destroyed or disposed of in a secure manner (e.g., shredding, burning). Soiled test and answer books should not be returned with test materials. 53 Test Security Policies and Procedures CBT PBT Missing Materials • Schools must investigate ANY report of missing materials and report missing secure materials (e.g., test and answer books, Reading Passage Booklets, used planning sheets) to the district assessment coordinator immediately. • A form to report missing secure materials can be found at www.FSAssessments.org. School personnel and district assessment coordinators may use this form, manipulate this form, or create their own form to submit with a written report. 54 Test Security Policies and Procedures CBT PBT Missing Materials (cont.) • Within 30 calendar days of the incident, a written report must be submitted to FDOE. The report must include, as applicable: – the nature of the situation, – the time and place of the occurrence, – the names of the people involved, – copies of completed forms, – a description of the communication between the district assessment coordinator’s office and school personnel, – how the incident was resolved, and – what steps are being implemented to avoid future losses. 55 Test Irregularities/ Security Breaches CBT PBT • Test administrators should report any test irregularities (e.g., disruptive students, loss of Internet connectivity) to the school assessment coordinator immediately. A test irregularity may include testing that is interrupted for an extended period of time due to a local technical malfunction or severe weather. School assessment coordinators must notify district assessment coordinators of any test irregularities that are reported. Decisions regarding test invalidation should not be made prior to communicating with the district assessment coordinator. • Test administrators should report possible breaches of test security (e.g., secure test content that has been photographed, copied, or otherwise recorded) to the school assessment coordinator immediately. If a security breach is identified, the school assessment coordinator must contact the district assessment coordinator. 56 Test Irregularities/ Security Breaches CBT PBT • For test irregularities requiring further investigation by the district and for security breaches, a written report must be submitted within 10 calendar days after the irregularity or security breach was identified. • District assessment coordinators should submit the report through FDOE’s ShareFile site (fldoe.sharefile.com), using the process outlined in the Spring 2015 FSA CBT Manual. 57 Test Invalidation/Defective Materials Policies and Procedures CBT PBT Test Invalidation • Remember that the main purpose of invalidation is to identify when the validity of test results has been compromised. • A test administrator should discuss any situation involving possible invalidation with the school assessment coordinator, and the situation should be investigated immediately. • If a situation described in the Test Invalidation/Defective Materials Policies and Procedures section of the Spring 2015 FSA CBT Manual occurs, test administrators should discuss the situation with the school assessment coordinator, and the situation should be investigated immediately. 58 Test Invalidation/Defective Materials Policies and Procedures CBT PBT Test Invalidation (cont.) • Grid the DNS bubble on paper-based tests that are invalidated. If a DNS bubble is gridded by mistake, erase it completely and grid the UNDO bubble. Remember that invalidated paper-based tests should be returned with TO BE SCORED test and answer books in order to be counted for participation purposes. • Test invalidations for CBT assessments are handled in TIDE. Invalidating a test will require the student’s ID number and the reason for invalidation. Complete instructions on invalidating tests via TIDE are available in the TIDE User Guide. 59 Test Invalidation/Defective Materials Policies and Procedures PBT DNS Guidelines for Defective Materials • If a defective test and answer book is identified before testing begins, give the student a replacement book. Return the defective test and answer book with all other NOT TO BE SCORED materials. It is NOT necessary to grid the DNS bubble if the test and answer book is defective and UNUSED and has been packaged properly for return with all other NOT TO BE SCORED materials. • If the test and answer book is defective and USED, a DO NOT PROCESS Label MUST be applied. Remember that the DO NOT PROCESS Label should be applied to any used NOT TO BE SCORED test and answer books that should NOT be scanned or counted for participation (i.e., responses were transcribed into another test and answer book). The DO NOT PROCESS Label should be applied in the same location as the PreID or District/School Label and should cover the label currently on the test and answer book. 60 Test Invalidation/Defective Materials Policies and Procedures PBT DNS Guidelines for Defective Materials (cont.) • If a student discovers that the test and answer book is defective during testing, give the student a replacement document with the same form number. The form number is printed below the FSA logo on the front cover of each book. If a replacement book with the same form number is not available, give the student a book with any form number. After the test session has ended, the student must, under the supervision of the test administrator, transfer the exact responses from the defective test and answer book to the replacement test and answer book. • If the defective test and answer book has a PreID Label applied, do not remove the label. You may either create a new On-Demand PreID Label via TIDE or grid all information on the student grid sheet and attach a District/School Label to the replacement test and answer book. (See the Script for Gridding a Non-Preidentified Student Grid Sheet in the Grades 3 & 4 FSA TA Manual or the Spring 2015 Scripts and Instructions for Administering Paper-Based FSA Assessments.) Instructions for printing On-Demand PreID Labels are available in the TIDE User Guide. Grid the DNS bubble on the defective USED test and answer book, apply the DO NOT PROCESS Label, and return the book with all other NOT TO BE SCORED materials. 61 CBT PBT Appendices Appendices in the Spring 2015 FSA CBT Manual include: • Appendix A—Accommodations • Appendix B—FSA Help Desk • Appendix C—Florida Test Security Statute and Rule • Appendix D—Perforated Forms and Signs School personnel administering both computer-based and paper-based FSA assessments should familiarize themselves with the information in the appendices of the Spring 2015 FSA CBT Manual prior to testing. 62 CBT Manual—Appendix A: Accommodations CBT PBT • Appendix A of the Spring 2015 FSA CBT Manual provides specific information and instructions regarding the following: – Test Accommodations for Students with Disabilities (General Information) – Accommodations for Students with Disabilities – Unique Accommodations – Accommodations for ELLs • School personnel responsible for administering tests to students with accommodations must familiarize themselves with all relevant information in Appendix A before testing. • Large print, one-item-per-page, and braille test administrator responsibilities for those administering paper-based accommodated versions of Grades 5-11 ELA Reading, Grade 5 -8 Mathematics, and EOCs are included in the Spring 2015 Scripts and Instructions for Administering Paper-Based FSA Assessments. 63 Grades 3 & 4 FSA TA Manual— Appendix A: Accommodations PBT • Appendix A of the Grades 3 & 4 FSA TA Manual provides specific information and instructions regarding the following accommodations for Grades 3 and 4 students only: – Test Accommodations for Students with Disabilities (General Information) – Accommodations for Students with Disabilities – Unique Accommodations – Accommodations for ELLs – Large Print Test Administrator Instructions – Braille Test Administrator Instructions – One-Item-Per-Page Test Administrator Instructions • School personnel responsible for administering tests to students with accommodations must familiarize themselves with all relevant information in Appendix A before testing. 64 Appendix D: Forms and Signs CBT PBT The following forms and signs, available in the portal and in Appendix D of the Spring 2015 FSA CBT Manual, should be used before, during, or after testing: • Test Administration and Security Agreement • Test Administrator Prohibited Activities Agreement • Test Materials Chain of Custody Form • Security Log • Administration Record/Security Checklist • Do Not Disturb Sign • Electronic Devices Sign 65 Test Administrator Before Testing Checklist CBT PBT Carefully read the Spring 2015 FSA CBT Manual, the Grades 3 & 4 FSA TA Manual, the Test Administrator User Guide, and any local directions provided. Resolve any remaining questions with the school assessment coordinator. Read the Test Security Policies and Procedures section and Appendix C of the Spring 2015 Computer-Based Test Administration Manual, then sign the Test Administration and Security Agreement. Read and sign the Test Administrator Prohibited Activities Agreement. Establish an appropriate setting for test administration and remove or cover any unauthorized aids in the testing room. Ensure you have a form to collect required administration information during testing. Prepare a Security Log and a seating chart to be used in your testing room. 66 Test Administrator Before Testing Checklist CBT PBT Make copies of the Do Not Disturb sign and the Electronic Devices sign to post prior to testing. Assemble all materials for test administration. Ensure that students and their parents/guardians understand policies regarding electronic devices, leaving campus during testing, the Testing Rules Acknowledgment, and discussing test content after testing. If you are administrating test to students who require accommodations, discuss with your school assessment coordinator how accommodations will be provided. Ensure you understand how to create, monitor, and close test sessions in the Test Administrator Interface in TDS (CBT only). 67 Test Administrator Before Testing CBT PBT • Test administrators MUST be certified educators. If you are not a certified educator, you may not administer an FSA assessment. • Read, sign, and return a Test Administration and Security Agreement, which indicates that you: – Have read the appropriate sections of the test administration manual(s). – Are familiar with test security statute and security policies. – Have received adequate training. • Read, sign, and return a Test Administrator Prohibited Activities Agreement. • Failure to sign the agreements and comply with the policies and procedures as indicated may result in the invalidation of student tests and/or loss of teaching certification. 68 Test Administrator Before Testing CBT Conduct Training Test • Prior to a CBT administration, conduct a training test session based on instructions from your school assessment coordinator. • Training tests contain sample test items to prepare students for the computer-based FSA assessments and will help familiarize you and your students with the CBT tools, as well as the process for responding to items on the computer. • Students should practice on the type of computer or device they will use for testing (e.g., PC, tablet, laptop). • Students who will test using accommodated computer-based forms (text-tospeech, masking) must practice using an accommodated training test administered through the TA Training Site. • Students should be encouraged to access the training test on the portal and practice on their own. 69 Test Administrator Before Testing CBT PBT Prepare the Room for Testing • • • • Tests should be administered in a room that has comfortable seating and good lighting. Make sure that the room is adequately ventilated and free of distractions. Remove or cover all visual aids in the room, such as word lists or charts showing mathematical concepts. Students may not have access to any unauthorized aids. Discuss any concerns with your school assessment coordinator. If administering a computer-based test, sufficient workspace should be provided for students to use their test materials (passage booklets, worksheets, work folders, etc.). Students must not be able to easily view other students’ computer or device screens, passage booklets, worksheets, or work folders. If administering a paper-based test, arrange the room so that each student will have enough workspace for test materials. There must be at least three feet between students. Make sure that students are not facing each other when seated at tables and are not in seating (stadium or staggered) that allows them to easily view other students’ answers. 70 Test Administrator Before Testing CBT PBT Prepare the Room for Testing (cont.) • If administering a computer-based test, – check the configuration of your testing room during the training test to make sure you will be able to provide a secure environment during testing. Make adjustments prior to the test administration. If necessary, use visual blocks (e.g., file folders taped to the sides of computer screens). – when you arrive on the day of testing, open each student workstation in the testing room to the student login screen as indicated in the script, but do not log in for students. Ensure that you have a way to contact the technology coordinator or school assessment coordinator without leaving the room unattended. • Outside each door to the testing room, post a sign that reads TESTING—Please Do Not Disturb. A sign is provided in Appendix D of the Spring 2015 FSA CBT Manual and is also available in the portal. • Display starting and stopping times for students as instructed in the test administration script. 71 Test Administrator Before Testing CBT PBT Required Administration Information You are required to maintain the following information, as directed by your school assessment coordinator: • Students assigned to your room—provide Student Names and Student ID Numbers • Attendance information—P=Present, A=Absent, W=Withdrawn, and P/I=Present but Invalidated • Grade level • Test group code (PBT) or Session ID (CBT, generated in TDS when you create a test session) • Accommodations provided to students • Accommodations used by students • Signatures of test administrator and school assessment coordinator Record this information according to your school assessment coordinator’s instructions. Copy and file all required administration information for future reference. Return the originals to your school assessment coordinator. 72 Test Administrator Before Testing CBT PBT Seating Charts You are required to maintain an accurate seating chart for your testing room. The chart should record the following: • Room name/number • Subject • Student names and their locations in the room during testing • Direction each student is facing • Date • Starting and stopping times • Your name • Names of proctors (if applicable) • Test group code (PBT) or Session ID (generated in TDS when you create a test session for CBT) • Laptop/mobile device assignments (if applicable) 73 Test Administrator Before Testing CBT PBT Seating Charts (cont.) • All seating charts must indicate the front and back of the room. • If students using extra time are moved to a new location or the seating configuration changes during testing, a new seating chart must be created. • Seating charts must be returned to your school assessment coordinator after testing. • If you are conducting computer-based testing on laptops or other mobile devices, identify and record the device on which each student is testing. 74 Test Administrator Before Testing CBT PBT Test Materials Needed (as applicable) • Spring 2015 FSA CBT Manual • Grades 3 & 4 FSA TA Manual (in the portal) • Script for administering accommodated computer-based forms (masking, text-to-speech) and paper-based accommodations (regular print, large print, braille, one-item-per-page) (in the portal) • Watch or clock • Security Log (in the portal) • Do Not Disturb sign (in the portal) • Electronic Devices sign (in the portal) 75 Test Administrator Before Testing CBT PBT Test Materials Needed (as applicable): • For CBT: • For PBT: – Pencils or pens – No. 2 pencils – Calculators – Test and Answer Books – Computer or mobile device – Directions for Completing the Grades 3 – Test Administrator User Guide & 4 FSA ELA Reading Items – Test tickets – Directions for Completing the Grades 3 – Reading Passage Booklets & 4 FSA Mathematics Items – Work Folders – Special document test materials – CBT Worksheets 76 Test Administrator Before Testing CBT PBT Pencils/Pens • For CBT tests, students should have a pen or pencil to sign below the Testing Rules Acknowledgment, take notes, and work the problems on their worksheets/work folders. • For PBT tests, ensure students use No. 2 pencils to complete information on the student grid sheets, sign below the Testing Rules Acknowledgement, and record their responses. Students should bring No. 2 pencils on the day of the test, but a supply of sharpened No. 2 pencils should also be available. 77 Test Administrator Before Testing CBT PBT Watch or Clock • You will need a watch or clock to ensure that students are allowed the correct amount of time indicated for each FSA test session. Special Documents • If you are administering students who require special documents, refer to Appendix A of the Grades 3 & 4 FSA TA Manual (Grades 3 & 4 students) or the Spring 2015 Scripts and Instructions for Administering Paper-Based FSA Assessments (Grades 5-11 students) to verify the materials needed to administer the test to students who require special documents (large print, braille, one-item-per-page). 78 Test Administrator Before Testing CBT PBT Security Log • You are required to maintain an accurate Security Log for your testing room. • Anyone who enters a room for the purpose of monitoring a test MUST sign the log. This applies to test administrators, proctors, and anyone who relieves a test administrator, even for a short break, regardless or how much time he or she spends monitoring a testing room. • Copy the Security Log in Appendix D of the Spring 2015 FSA CBT Manual and use it as required. This document can also be found in the portal. 79 Test Administrator Before Testing CBT Computer or Mobile Device • On the day of testing, CBT test administrators will need a computer or mobile device with access to the Internet to create a test session, approve students for testing, and monitor the session. It is also recommended that test administrators have access to the Test Administrator User Guide, located in the portal and the Test Administrator Interface, to help troubleshoot issues during testing. Test Tickets • The school assessment coordinator will provide test tickets for the students testing in your room. • Each test ticket includes a student’s Username and First Name for logging in to a computer-based test. • Test tickets are generated in TIDE. 80 Test Administrator Before Testing CBT Calculators • A scientific calculator is available in the test platform for Grades 7 and 8 FSA Mathematics and all FSA EOC assessments. Handheld scientific calculators MAY be used by students only if all students are provided with a handheld calculator. • Ensure that any handheld scientific calculators have only the allowable functionality, as indicated in the FSA Mathematics Policies & Materials document (available in the portal). • The calculator feature is only available to students in Sessions 2 and 3 of Grades 7 and 8 Mathematics and Session 2 of EOC assessments. If providing handheld calculators, Ensure that students are ONLY provided handheld calculators in the appropriate test sessions. • Students testing with paper-based accommodations MUST be provided a handheld scientific calculator for the appropriate sessions. 81 Test Administrator Before Testing CBT Reading Passage Booklets • You may receive Reading Passage Booklets for eligible students taking computer-based ELA Reading assessments if this accommodation is indicated in student IEPs or Section 504 plans. • Provide the booklets to students with this accommodation as instructed in the administration scripts. • Supervise while students break the seal at the beginning of each session as instructed in the scripts. • Students may write in these booklets. • Reading Passage Booklets are secure materials. All booklets must be collected immediately after testing and returned to your school assessment coordinator. 82 Test Administrator Before Testing CBT Work Folders and CBT Worksheets • You will receive work folders for all students participating in CBT administrations of FSA Mathematics and FSA EOCs to work the problems during each test session. The Testing Rules Acknowledgment is printed on page two of the work folder. • You will receive CBT worksheets for all students participating in CBT administrations of FSA ELA Reading. The Testing Rules Acknowledgment is printed on the back of the worksheet. • Distribute the work folders and worksheets as instructed in the administration scripts, and collect work folders and worksheets after each test session. Used work folders and worksheets are considered secure materials. 83 Test Administrator Before Testing PBT Test and Answer Books • The school assessment coordinator will provide test and answer books for Grades 3 and 4 students and for Grades 5– 11 students with regular print paper-based accommodations. • Test and answer books are secure materials and should be delivered or picked up immediately before the beginning of a test. • If additional materials are needed, please contact the school assessment coordinator. 84 Test Administrator Before Testing PBT Test Group Code (for PBT only) • The school assessment coordinator will provide you with a unique four-digit test group code for each PBT session. • The test group code is used as a security measure to identify groups of students tested together. • Post the test group code at the beginning of the test and record the code with your required administration information on your seating chart. 85 Test Administrator Before Testing PBT Directions for Completing Test Items • Your school assessment coordinator will provide you with copies of the following, as appropriate for the test(s) you are administering: Directions for Completing the Grades 3 & 4 FSA ELA Reading Items Directions for Completing the Grades 3 & 4 FSA Mathematics Items • The directions for each subject are printed on a single, doublesided page. Copies must be distributed to students before each test session, as indicated in the test administration scripts. Students may refer to these directions at any time during the test sessions. 86 Test Administrator Before Testing CBT PBT Communicate Testing Policies to Parents/Guardians and Students Prior to testing, make sure students and their parents/guardians understand the following policies: • Electronic Devices Policy—If students are found with ANY electronic devices, including, but not limited to, cell phones or smartphones, during testing OR during breaks, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on the day of testing. • Leaving Campus—If students leave campus before completing a test session (for lunch, an appointment, illness, etc.), they WILL NOT be allowed to complete the test. Students and parent/guardians should be aware of this policy. If a student does not feel well on the day of testing, it may be best for the student to wait and be tested on a make-up day. 87 Test Administrator Before Testing CBT PBT Communicate Testing Policies to Parents/Guardians and Students (cont.) • Discussing Test Content after Testing—The last portion of the testing rules read to students before they affirm the Testing Rules Acknowledgment reads, “After the test, you may not reveal details about the test items or passages to anyone. This includes any type of electronic communication, such as texting, emailing, or posting online, for example, on websites like Facebook, Twitter, or Instagram. If you are found sharing information about test items or passages, your test will be invalidated.” Please make sure that students understand this policy prior to testing and remind them that “discussing” test content includes any kind of electronic communication, such as texting, emailing, or posting to blogs or social media websites, etc. 88 Test Administrator During Testing Checklist CBT PBT Keep time. Maintain your seating chart and record of required administration information. Ensure that proctors and anyone who enters your room for the purpose of monitoring the test sign the Security Log for your room. Administer the test according to the directions in the appropriate administration script and read the SAY boxes verbatim to students. After the last session of a computer-based test, assist students with accessing the comment form, located at www.FSAssessments.org/student-comment-form. 89 Test Administrator During Testing CBT PBT Read Script • Read the administration script VERBATIM to students. Note that optional words and phrases appear in italics and parentheses and may be read at your discretion. Please read the important information and adhere to the instructions between the SAY boxes as your read the script to students. • You may make necessary modifications to the script when testing students who are allowed certain accommodations. For example, if a student receives an additional time accommodation, modify references to the amount of time allotted for testing. 90 Test Administrator During Testing CBT PBT Read Script (cont.) • Scripts for administering CBT tests are found in the Spring 2015 FSA CBT Manual. To administer accommodated computer-based forms (masking, text-to-speech) or paper-based accommodations (regular print, large print, braille, one-item-per-page) to grades 5-11 students, locate the appropriate administration scripts in the portal. • Scripts for administering the Grades 3 & 4 paper-based ELA Reading and Mathematics tests are found in the Grades 3 & 4 FSA TA Manual. Instructions for administering large print or one-item-per-page paperbased accommodations of the same tests are found in Appendix A of the Grades 3 & 4 FSA TA Manual. A modified script for students using a braille version of the tests is provided with the braille test materials and is also available in the portal. 91 Test Administrator During Testing CBT PBT Distribute Materials • After students are seated, ensure that each student has a No. 2 pencil; for CBT administrations, students may also use a pen. • For grades 3 & 4 paper-based ELA Reading and Mathematics tests, distribute a copy of the Directions for Completing the Grades 3 & 4 FSA ELA Reading Items or the Directions for Completing the Grades 3 & 4 FSA Mathematics Items, as applicable. • For CBT testing, distribute calculators and work folders or worksheets (as applicable) before testing begins. 92 Test Administrator During Testing CBT PBT Distribute Materials (cont.) • Read the administration script and distribute test and answer books, passage booklets, and test tickets, as applicable, when instructed to do so. • For PBT tests, if you notice that a student was given a preidentified test and answer book not assigned to him or her after testing has already begun, allow the student to complete the test, correct your record of required administration information after testing, and notify your school assessment coordinator. 93 Test Administrator During Testing CBT PBT Testing Rules Acknowledgment • After you read the testing rules in the script, students will sign below the Testing Rules Acknowledgment that is printed on page two of the work folder and on the back of the worksheet (for CBT) or on the inside front cover of the test and answer book (for PBT). • As you read the portion of the script regarding the Testing Rules Acknowledgment, walk around the room and ensure that all students sign below the acknowledgment. • If a student in your testing room does not sign to acknowledge the testing rules, contact your school assessment coordinator. 94 Test Administrator During Testing CBT PBT Keep Time • Keep accurate time when administering a test session. • Record starting and stopping times in the spaces provided in the script and also display these times for students. Remember that failure to provide the correct amount of time will likely result in test invalidation. 95 Test Administrator During Testing CBT PBT Maintain Test Security • Maintain test security at all times, and report violations or concerns to your school assessment coordinator immediately. • Adhere to the Test Security Policies and Procedures section of the Spring 2015 FSA CBT Manual and the Statute and Rule in Appendix C, and abide by the Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement that you signed prior to testing. • Maintain your record of required administration information, Security Log, and seating chart during testing. 96 Test Administrator During Testing CBT Maintain Test Security (cont.) • For CBT testing – – If students leave the room for short breaks (e.g., restroom), it is recommended that visual blocks be applied to students’ computer screens (e.g., monitors turned off, folders taped to screens) instead of pausing students’ tests. If a student test is paused in TDS, that student must log back in and be approved in TDS before he or she can continue testing. – For a longer break, you must secure a student’s computer or device by pausing the student’s test. Students may pause their own tests before leaving their seats. If the student has not paused his or her test, you must pause the test via the Test Administrator Interface. Your school assessment coordinator will provide instructions. 97 Test Administrator During Testing CBT Create, Start, Monitor, and Close the Test Session (for CBT ONLY) • In the TA Interface within TDS, you will create, start, monitor, and close the test session you are administering. Ensure you understand how to complete these steps BEFORE administering a test, and discuss any questions or concerns you have with your school assessment coordinator or technology coordinator. • Ensure that you have test tickets, which contain the following student login information for all students in your testing room: – First Name as it appears in TIDE – Username provided in TIDE 98 Test Administrator During Testing CBT Create the Test Session (for CBT ONLY) To create a test session, complete the following steps: • Go to the FSA Portal, click the “Test Administrator” icon, and then click the “Test Administration” icon. • Log in to the Test Administrator Interface with your Username and Password. • Select the test you will be administering, and then click “Start Session.” • Record the Session ID, which students will need to log in to the test. The Session ID should be displayed where it is visible to all students and should also be recorded with your required administration information on your seating chart. • To log in to the test, students will enter their First Names, their Usernames, and the Session ID. It is important that students enter their Usernames and First Names exactly as they appear on their test tickets. 99 Test Administrator During Testing CBT Approve Students to Test (for CBT ONLY) Once students have logged in to the test, you must approve them by completing the following steps to start the test session: • In the Test Administrator Interface, select the “Approvals (#)” button to review the list of students ready to begin testing. • Ensure that all students have logged in correctly; then, select “Approve All Students.” 100 Test Administrator During Testing CBT Monitor the Test Session (for CBT ONLY) • During testing, monitor student progress by viewing the “Student Status” column in the Test Administrator Interface. • This page automatically refreshes every 60 seconds. When the page refreshes, student statuses are updated. • If students have technical issues, contact your school assessment coordinator or technology coordinator for assistance immediately. Your attention should not be diverted from students at any time during testing. • Note: As a security measure, test administrators are automatically logged out after 90 minutes of test administrator and student inactivity. If you are logged out and there is not student activity, this session will close and all in-progress tests in the session will be paused. You will need to log back in to the TA Interface, create a new session, and approve students as they log in to resume their tests. A sessions will remain active if students are waiting for approval, if students are actively taking the test, or if the test administrator is actively interacting with the TA Interface. 101 Test Administrator During Testing CBT Close the Test Session (for CBT ONLY) • Once all students have paused or submitted their tests, end the test session immediately by clicking “Stop Session” in the Test Administrator Interface. This will pause any remaining tests, so only select “Stop Session” after all students have submitted their tests. • Then log out of the Test Administrator Interface by clicking “Log Out” in the upper right corner of the screen. 102 Test Administrator During Testing CBT PBT Supervise Test Administration Your full attention should be on students at all times during testing. If issues arise during testing, you may need to use your computer or phone to contact your school assessment coordinator; however, it is not appropriate to use the computer or phone for unrelated activities (such as grading or personal communication) during a test session. 103 Test Administrator During Testing CBT PBT Supervise Test Administration (cont.) During testing, ensure that students: • Have cleared their desks or workstations of all materials except for the appropriate test materials (pencils, test and answer books, test tickets, passage booklets, and worksheets or work folders, as applicable). • Do not have books, notes, scratch paper (other than their work folders or worksheets), or electronic devices of any kind other than those used for testing (for CBT only) during testing, even if they do not use them. • Do not talk to other students or make any disturbance. 104 Test Administrator During Testing CBT PBT Supervise Test Administration (cont.) During testing, ensure that students (cont.): • Have signed below the Testing Rules Acknowledgment. • Are working independently. • Are working in the correct session and, for PBT only, are recording their answers in the appropriate area. • For PBT only, are using No. 2 pencils (mechanical pencils, ink pens, highlighters, crayons, colored pencils, markers, correction fluid, etc. are NOT permitted). 105 Test Administrator During Testing CBT PBT Supervise Test Administration (cont.) • Discussing test content: While you may encourage students to continue working, you may NOT talk with them about the items or passages or help them with their responses. If students finish the test before the allotted time has elapsed, you may encourage them to go back and check their work. You may not provide students with any information that would allow them to infer the correct answer. Further, you may not discuss test items, passages, or answers with students, even after testing has been completed. • Student reports a defective test item: If a student reports a test item that he or she thinks is defective, not the student’s name, grade level, form number (for PBT), subject, item number, and basic student concern (e.g., two possible answers); however, do NOT review the item on your own. Most concerns result from a student not reading an item carefully; therefore, encourage the student to reread the item. If the student still thinks that the item is defective, reassure the student that a flawed item will not be used to calculate student scores. The student should answer the item to the best of his or her ability and continue with the test. Once testing has ended, inform your school assessment coordinator of the concern. 106 Test Administrator During Testing CBT Supervise Test Administration (cont.) • For CBT testing – Any desktop-viewing programs or similar software that would enable you to view test items and student responses must be turned off during testing. – If a student’s computer is disconnected from the test, contact the technology coordinator to help diagnose any technical issues. Then assist the student with logging in again. Once a student logs back in to his or her test, you will need to approve the student again in TDS. If a student still has difficulty logging in or gets kicked out of his or her test more than once, do not have the student continue attempting to log in until the issue is diagnosed and resolved. Additional troubleshooting information is available in the portal. 107 Test Administrator During Testing PBT Supervise Test Administration (cont.) • For PBT testing – Students are permitted to use the blank space in their test and answer books as workspace. Students may also underline and/or circle words, phrases, etc. in the passages or items; however, closely monitor students during testing to ensure that they do not make stray marks near the answer choice bubbles. Stray marks may interfere with the scanning of the document. For example, if a student draws a line or an X through an answer that he or she thinks is wrong and the line extends into a bubble, the stray mark could be scored as the student’s answer. 108 Test Administrator During Testing CBT PBT After Testing Is Complete • If permitted by your school assessment coordinator, you may allow students to read after they have finished a session AND, for PBT testing, their test and answer books have been collected. Students are not permitted to have paper or to write or, for CBT testing, use their computer or device after they have finished a session, even after their test materials have been collected. Test materials may not be returned to students once the materials have been collected. 109 Test Administrator After Testing Checklist CBT PBT Verify that you have collected all required administration information, including accommodations used by each student. Make a copy for your files. Report any missing materials (test and answer books, passage booklets, test tickets) to your school assessment coordinator immediately. Verify that your seating chart and Security Log have been completed correctly; make copies for your files. Organize test materials and return them to your school assessment coordinator. Complete the appropriate comment form in the FSA Portal. 110 Test Administrator After Testing CBT PBT Returns Materials to the School Assessment Coordinator Complete the following steps after testing: 1. Verify that you have collected all required administration information. Make a copy for your files. Notify the school assessment coordinator immediately if any materials are missing. 2. Ensure that the accommodations provided to each student and the accommodations used by each student have been recorded with other required administration information. 3. Verify that your Security Log and seating chart have been completed correctly. Make copies for your files. 111 Test Administrator After Testing PBT Returns Materials to the School Assessment Coordinator (cont.) For PBT only: 4. Check for and erase stray marks ONLY on the student grid sheets. Any marks outside the information boxes will adversely affect the scanning of the books. Notify the school assessment coordinator of any concerns. Do NOT open or check through test and answer books. 5. Verify that each student has completed the required information (Student Name, School Name, District Name) in the box on the student grid sheet, even if a PreID or District/School Label has been affixed. 112 Test Administrator After Testing CBT PBT Returns Materials to the School Assessment Coordinator (cont.) 6. • • • • • • • • Return the following materials, as applicable, to your school assessment coordinator: Test administration manual • Security Log Seating chart • Test tickets Required administration information • Used work folders Calculators • Used worksheets Reading Passage Booklets All TO BE SCORED and NOT TO BE SCORED test and answer books Copies of the Directions for Completing the Grades 3 & 4 FSA ELA Reading Items and Directions for Completing the Grades 3 & 4 Mathematics Items Special document test materials (large print, braille, and one-item-per-page) 113 School Assessment Coordinator Before Testing Checklist CBT PBT Carefully read the Spring 2015 FSA CBT Manual, the Test Administrator User Guide, and the TIDE User Guide (all located in the FSA Portal), as well as any local directions you have been given. Resolve any questions you might have with your district assessment coordinator. Read the Test Administrator Policies and Procedures and Appendix C of the Spring 2015 Computer-Based Test Administration Manual, then sign the Test Administration and Security Agreement (located in Appendix D of the Spring 2015 FSA CBT Manual). Train your test administrators and proctors and ensure that they, as well as school administrators, sign a Test Administrator and Security Agreement. Ensure that test administrators sign a Test Administrator Prohibited Activities Agreement (located in Appendix D of the Spring 2015 FSA CBT Manual). 114 School Assessment Coordinator Before Testing Checklist CBT PBT Receive test materials from your district assessment coordinator. Maintain an accurate Test Materials Chain of Custody Form at your school (located in Appendix D of the Spring 2015 FSA CBT Manual). Inventory the materials within 24 hours of receipt and report missing materials or request additional materials immediately. Communicate the process for collecting required administration information to your test administrators. Assign proctors, as needed. Ensure that appropriate test settings are available for all test sessions. If any students who require accommodations are testing at your school, discuss with test administrators how accommodations will be provided (see Appendix A in the Spring 2015 FSA CBT Manual). 115 School Assessment Coordinator Before Testing Checklist CBT For CBT administrations • • • • Work with your district assessment coordinator to ensure that test administrators have active usernames and passwords to log in to TDS. Also ensure that all students are uploaded into TIDE, and verify that student eligibility is correct in TIDE. Ensure test administrators understand how to create, monitor, and close test sessions in the Test Administrator Interface in TDS. Arrange training test sessions to familiarize students and test administrators with the testing platform. Print test tickets to distribute to test administrators. Test tickets contain login information for students, and each student must have a test ticket to log in to a CBT FSA assessment. Refer to the TIDE User Guide for instructions. 116 School Assessment Coordinator Before Testing CBT Prepare for CBT Administration • Work with your district assessment coordinator to ensure that all test administrators have active usernames and passwords to log in to TIDE. Test administrators will need access to the Test Administrator Interface in TIDE in order to administer tests. • Work with your district assessment coordinator to ensure that all students are uploaded into TIDE. Prior to testing, school and district assessment coordinators should verify that student eligibility is correct in TIDE, and that any accommodations or test settings are correct. In order to participate in a computer-based test, students must be listed as eligible for that test in TIDE. • After students have been added to TIDE, you will print test tickets to distribute to test administrators. Test tickets contain login information for students. Each student must have a test ticket to log in to computer-based FSA assessments. Test tickets are generated in TIDE. See the TIDE User Guide for instructions on generating and printing test tickets. 117 School Assessment Coordinator Before Testing CBT PBT Receive Materials • Your district assessment coordinator will provide you with all materials prior to each test administration window. Secure materials should be delivered to or picked up by test administrators immediately before the beginning of each test session. Verify that you have all necessary materials before testing begins. • For CBT administrations, work folders and CBT Worksheets were delivered with test administration manuals. Contact your district assessment coordinator if you need additional work folders or worksheets. • Inventory the contents of boxes within 24 hours of receipt, and maintain an accurate Test Materials Chain of Custody Form at all times. Contact your district assessment coordinator immediately to report missing materials or to request additional materials. 118 School Assessment Coordinator Before Testing CBT PBT Receive Materials School Box contents (as applicable): • School Assessment Coordinator Box (White) School Cover Memo School Packing List School Box Range Sheet School Security Checklist PreID Rosters PreID Labels Blank PreID Labels District/School Labels DO NOT PROCESS Labels Roll of Plastic Return Bags Blue, Orange, or Purple Labels (TO BE SCORED Materials) White Labels (TO BE SCORED Large Print/One-Item-Per-Page Materials) Pink Labels (TO BE SCORED Braille Materials) Yellow Labels (NOT TO BE SCORED Materials) • Test and Answer Books • Reading Passage Booklets (CBT Accommodation) • Directions for Completing the Grades 3 & 4 FSA ELA Reading Items • Directions for Completing the Grades 3 & 4 FSA Mathematics Items 119 School Assessment Coordinator Before Testing CBT PBT Receive Materials (cont.) Special Document Boxes: • Large Print Kits Special Document Cover Memo Special Document Return Envelope Regular Print Test and Answer Book Large Print Test and Answer Book • One-Item-Per-Page Kits Special Document Cover Memo Special Document Return Envelope Regular Print Test and Answer Book One-Item-Per-Page Test and Answer Book 120 • Braille Kits Special Document Cover Memo Special Document Return Envelope Regular Print Test and Answer Book Braille Script Braille Notes Braille Test Book School Assessment Coordinator Before Testing CBT PBT Required Administration Information • As directed by your district assessment coordinator, communicate to test administrators the process for collecting the required administration information. • For paper-based testing, maintain a record of the security numbers of the test and answer books. • File all required administration information for future reference. Assign Proctors • Assign proctors to testing rooms according to the guidelines for proctors on pages 10–11 of the Spring 2015 FSA CBT Manual, make sure that they understand their responsibilities, and explain the Security Log to them. FDOE strongly encourages use of proctors in ALL testing rooms. 121 School Assessment Coordinator Before Testing CBT PBT Seating Charts • Test administrators are required to maintain an accurate seating chart for each group of students in their rooms during testing. Ensure that test administrators record all information indicated on page 19 of the Spring 2015 FSA CBT Manual and that they create a new seating chart if the seating configuration changes during a test session. • After testing, copy all seating charts, file the copies, and package the originals in the District Assessment Coordinator ONLY box. Ensure Implementation of Accommodations • Arrangements for implementing accommodations must be made prior to the administration dates. Make sure that test administrators are aware of and have made provisions for the exact accommodations needed for individual students to avoid test invalidations. 122 School Assessment Coordinator Before Testing CBT PBT Preparation and Training • You are responsible for training all test administrators and proctors, including non-school-based instructors (e.g., itinerant teachers). You must train several employees to act as possible alternates. In the absence of sufficiently trained administrators, postpone testing until trained personnel are available. • Be aware of the policies, procedures, and instructions listed on pages 195–197 of the Spring 2015 FSA CBT Manual, and emphasize the information during training at your school. 123 School Assessment Coordinator Before Testing CBT PBT Manage Student Information in TIDE • Please refer to the TIDE User Guide for information on managing student information in TIDE. • Prior to testing, ensure that all student information listed in TIDE is correct, including any accommodations students will be using to test. • Students to be tested who were not included in your district’s PreID upload will need to have their information added in TIDE, and OnDemand PreID Labels should be printed for these students. For paper-based tests, if documents are hand-gridded for these students and District/School Labels are applied instead, student information must still be added to TIDE to ensure timely reporting of results for these students. See the TIDE User Guide for information on adding student information to TIDE and printing On-Demand PreID Labels. 124 School Assessment Coordinator Before Testing CBT Meet with Technology Coordinator • For CBT administrations, it is important that technology coordinators understand their responsibilities before, during, and after a computerbased test administration. Review the instructions and information for technology coordinators (located in the portal), as well as all test administration and security policies and procedures included in the Spring 2015 FSA CBT Manual, with your technology coordinator and create a plan for handling issues during testing. • Technology coordinators are required to sign the Test Administration and Security Agreement. • The technology coordinator should also be involved in all planning meetings to provide input on logistics and resolve any network issues. 125 School Assessment Coordinator Before Testing CBT Arrange CBT Training Test Sessions • For computer-based administrations, schedule and arrange training tests as described in the Spring 2015 FSA CBT Manual. Before a student can participate in a computer-based administration, the student must complete the appropriate training test to learn how to use the computer-based system. • Instruct school personnel to make students aware that they can access training tests on their own any time prior to testing. • The training tests and scripts for administering the training tests are available in the portal. 126 School Assessment Coordinator Before Testing CBT Provide Appropriate Test Settings and Prepare Computers/Devices • Ensure that the technology coordinator has verified that all computers and devices meet the requirements needed to administer the computer-based tests, as indicated in the System Requirements for Online Testing document available in the portal, and have installed the correct secure browser. • Before each computer-based test session, test administrators should launch the secure browser on each computer or device. 127 School Assessment Coordinator During Testing Checklist CBT PBT Be available to answer questions from test administrators. Provide test administrators with additional materials, as necessary. Monitor each testing room to ensure that test administration and test security policies and procedures are being followed, seating charts and Security Logs are being properly completed, and required administration information is being collected. Monitor student progress and test completion rates in ORS. Arrange for and supervise make-up administrations. 128 School Assessment Coordinator During Testing CBT PBT Supervise Test Administration and Maintain Test Security • Provide test administrators with paper-based test materials (test and answer books, Reading Passage Booklets, special document test materials, as applicable), and with worksheets, work folders, and test tickets for students prior to testing. • Monitor each testing room to ensure that test administration and test security policies and procedures are followed. You and the technology coordinator must be available during testing to answer questions from test administrators and to assist with technology issues. Make sure that Security Logs and seating charts are being completed properly and that all required administration information is being maintained in each testing room. • The test administrator should contact you or the technology coordinator if an error message appears on a student’s computer or device during testing. 129 School Assessment Coordinator During Testing CBT PBT Supervise Test Administration and Maintain Test Security (cont.) • If the Internet connection is interrupted during testing, students will not be able to continue testing. If the Internet connection is not restored in time for students to complete the test, the test administrator should contact you or the technology coordinator for assistance. If a technical issue interrupts testing and is not able to be resolved quickly, you should contact the FSA Help Desk at 866-815-7246 and notify the district assessment office immediately. • Test administrators are instructed to contact you if a student does not sign below the Testing Rules Acknowledgment. Determine the appropriate course of action for handling a student who does not affirm the Test Rules Acknowledgment. Any student who refuses to affirm the Testing Rules Acknowledgment should still be tested, but a record of the student’s refusal should be retained at the school. 130 School Assessment Coordinator During Testing CBT PBT Monitor Student Progress • For computer-based tests, student progress and test completion rates can be monitored via ORS. School assessment coordinators should use the Participation Reports feature of ORS to track completion rates and determine which students still need to be tested. Further information on Participation Reports can be found in the Online Reporting System User Guide. Supervise Make-Up Administrations • Ensure all test security and test administration policies and procedures are followed while conducting make-up tests. Be available to assist test administrators as needed during make-up administrations. 131 School Assessment Coordinator After Testing Checklist CBT PBT Verify that all distributed secure materials have been returned, if applicable. Complete your Test Materials Chain of Custody Form. Report missing materials to your district assessment coordinator and conduct the necessary investigation. Make copies of all collected required administration information, seating charts, and Security Logs, and file the copies. Organize test materials and return them to your district assessment coordinator as indicated in the 2014–2015 FSA PaperBased Materials Return Instructions. Complete the appropriate comment form in the FSA Portal, and encourage test administrators to complete a comment form. 132 School Assessment Coordinator After Testing CBT PBT Invalidate Tests • Review policies regarding test invalidation in the Spring 2015 FSA CBT Manual. • For paper-based tests, grid the DNS bubble on any invalidated tests. If a DNS bubble is gridded by mistake, erase it completely and grid the UNDO bubble. Remember that invalidated paper-based tests should be returned with TO BE SCORED test and answer books in order to be counted for participation purposes. • For computer-based tests, invalidate tests in TIDE. Complete instructions for invalidating tests via TIDE are available in the TIDE User Guide. 133 School Assessment Coordinator After Testing CBT PBT Update Student Information • If student information is discovered to be incorrect during testing, update the corrected information in TIDE immediately following test administration. Instructions on updating student information are available in the TIDE User Guide. Record Accommodations • Ensure all accommodations provided to and used by students are recorded on each record of required administration information, as applicable. This documentation may be necessary in the case of investigations regarding possible test irregularities. 134