Spring 2013 End-of-Course Assessments Training Materials Algebra 1 Biology 1 Geometry U.S. History Civics Field Test 1 Overview These training materials are based on the 2012-2013 End-of-Course Assessments Test Administration Manual and are available at www.FLAssessments.com/EOC. 2 Overview These training materials highlight important information for computer-based test administrations and the use of paper-based accommodations. Not all information from the test administration manual is included in this presentation, so district and school staff must read and familiarize themselves with all information in the manual, in addition to using these training materials. 3 Manual One manual (2012-2013 EOC Manual) is provided for the Winter 2012, Spring 2013, and Summer 2013 EOC administrations. Instructions for computerbased test (CBT), paperbased test (PBT), and accommodated form administrations are included in this manual. 4 EOC Test Administration Schedule Scheduling Test Testing Window U.S. History April 29-May 2, 2013 Biology 1 May 3-May 10, 2013 Algebra 1 May 13-May 17, 2013 Geometry May 20-May 23, 2013 Civics Field Test April 29-May 31, 2013 Statewide Make-up Days (all operational subjects) May 28-May 31, 2013 • Subjects must be tested in the order listed in the schedule above. • This is Broward’s Districtwide schedule. This must be followed! • All testing for a single subject must be completed in a district before testing for the next subject may begin, except for make-ups. 5 EOC Test Administration Schedule Scheduling • Since the testing window allows for multiple test sessions to be scheduled throughout the week, schools may reassign absent students to an existing session scheduled later in the week rather than creating separate make-up sessions. • Any deviation from the test administration schedule requires written approval from the Florida Department of Education (FDOE) prior to implementation. 6 EOC Test Administration Schedule Testing Duration • Each Algebra 1, Biology 1, Geometry, and U.S. History EOC Assessment will be administered in one 160-minute session with a scheduled 10-minute break after 80 minutes. Students are not allowed to talk during the break. Individual restroom breaks are permitted as needed. • Students may be dismissed from the testing room after the 10minute break as they complete testing. However, no special incentives should be given to students to encourage them to finish early. • Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day. • The Civics Field Test will be administered in one 60-minute 7 session. What’s New Testing Rules Acknowledgment • All EOC assessments include a Testing Rules Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” • Prior to testing, students must acknowledge the testing rules that the test administrator reads to them by checking a box (in TestNav) or clicking a circle (in TestHear) next to the statement. Students taking a paper-based test will sign below the acknowledgment. 8 What’s New Electronic Practice Assessment Tools (ePATs) • The computer-based practice tests, also called ePATs, and scripts for administering ePATs are posted separately at www.FLAssessments.com/ePATs. The ePAT scripts are NOT included in the test administration manual. • Students should be made aware that they can access ePATs on their own at this location. • Schools must administer the appropriate practice test(s) to all students to be tested using the ePAT scripts; however, if a student has previously participated in an ePAT for the subject test he or she will take, the student is not required to participate in an ePAT session. 9 What’s New Updates to Student Information • A new process has been established to allow incorrect student profiles that were added to PearsonAccess via the Create New Student Wizard to be updated before or after testing. • Updates can be made to the First Name, Last Name, and Student ID Number. • Updates may not be made to student profiles that were created via the PreID upload. 10 What’s New Technology Coordinator Guide • Information and instructions for technology coordinators to follow before, during, and after testing are now provided in a separate online Technology Coordinator Guide posted at www.FLAssessments.com/EOC. • Technology coordinators must familiarize themselves with all information in this guide prior to the test administration. 11 What’s New CBT Training Resources • A new website has been created to compile several resources for computer-based testing. The site includes information about test setup, best practices, and training resources. • This site is located at www.FLAssessments.com/CBTTrainingResources. 12 What’s New To Be Scored Materials • School staff will transcribe student responses into CBT forms prior to the end of each state administration window and return the test materials with other NOT TO BE SCORED materials. • CBT transcription instructions will be distributed by Student Assessment 13 What’s New TestHear Software Update • A new version of TestHear (2.1.0.7) was released prior to the Fall 2012 Retake administration. • Schools that downloaded this updated version of TestHear do not need to download it again for the Spring EOC administration; however, any schools that did not administer TestHear accommodated forms this school year will need to download and install the newest version of TestHear prior to administering an accommodated form of any EOC assessment. • All ePATs in the previous version must be removed for the updated software to function correctly. • The newest version of TestHear is available at www.FLAssessments.com/downloads. The latest version of the 14 ePATS are available at www.FLAssessments.com/ePATs. What’s New Reference Sheets and Periodic Tables • The reference sheet for the Algebra 1 and Geometry EOC Assessments and the periodic table for the Biology 1 EOC Assessment are provided in an online format only for computer-based testing. • Schools may provide hardcopy reference sheets or periodic tables to students. Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix E of the 2012-2013 EOC Manual (reference sheets and periodic tables are also available at www.FLAssessments.com/EOC). • Each photocopied reference sheet and periodic table must be carefully checked against the original to ensure all content is copied and that it is clear and easy to read. • Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts. 15 What’s New CBT Worksheets • For the computer-based U.S. History EOC Assessment and Civics Field Test, CBT Worksheets may be provided for students if they prefer to make handwritten notes instead of using the notepad tool in the CBT platform. • The worksheet is an 8 ½ × 11 page (available at www.FLAssessments.com/EOC) that may be copied and distributed to students at the beginning of the test session. • Used CBT Worksheets are secure materials. 16 What’s New Handheld Four-Function Calculators (Algebra 1 and Biology 1) • The Algebra 1 and Biology 1 EOC Assessments include a four-function calculator tool in TestNav only. Students may request to use a handheld four-function calculator on the day of testing. Test administrators should have a supply of approved four-function calculators for these students. • TestHear does not have a calculator tool within the CBT platform. Students taking an accommodated CBT form of the Algebra 1 or Biology 1 EOC Assessment using TestHear must be provided a handheld fourfunction calculator to use during the test. 17 What’s New Handheld Scientific Calculators (Geometry) • The Geometry EOC Assessment includes a scientific calculator tool in TestNav only. FDOE does not provide handheld scientific calculators for students testing in TestNav; however, districts may allow students to use handheld scientific calculators, as long as they are included in the approved list of scientific calculators in the 2012-2013 EOC Manual. • Requests for permission to use scientific calculators not included in the approved list must be submitted to the FDOE no later than two weeks prior to the beginning of test administration. • The TestHear Geometry EOC Assessment does not include a scientific calculator tool. Handheld scientific calculators will be provided by FDOE for students taking the Geometry EOC Assessment using TestHear accommodated CBT forms. 18 What’s New Chain of Custody Form • Schools are required to maintain a Test Materials Chain of Custody Form posted at www.FLAssessments.com/EOC and located in Appendix E. – Record accurate information on the form, including the dates activities are completed, the names of the persons performing activities involving the materials, and information about the locked storage room. – Retain electronic or hard copies of completed forms after materials are packaged for pickup, and email or return the originals to the district assessment coordinator. 19 Reminders Test Security Policies and Procedures • Per Florida State Board of Education Rule 6A-10.042, FAC, and Test Security Statute, s. 1008.24, F.S. (see Appendix B), district and school personnel are required to maintain test security before, during, and after testing. • Please remember that inappropriate actions can result in student or classroom invalidations and/or loss of teaching certification. • All school personnel, including itinerant teachers and proctors, must receive thorough training in test administration and security policies and procedures, familiarize themselves with all relevant content of the test administration manual(s), read the Statute and Rule in Appendix B, and then sign a Florida EOC Test Administration and Security Agreement. • All test administrators must be certified educators and must sign the Test Administrator Prohibited Activities Agreement. 20 Reminders Test Administrator Policies • ALL test administrators must be certified educators. • Test administrators are required to sign a Test Administrator Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document. • The Florida EOC Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement may be copied together so that double-sided, single-page copies can be distributed to test administrators. • School assessment coordinators must file the signed forms with their signed security agreements. 21 Reminders Seating Charts • Test administrators are required to maintain an accurate seating chart for each group of students in their rooms during testing. • All seating charts must indicate the front and back of the room, as well as the direction students are facing. • If students are moved to a different location or the seating configuration changes during testing, a new seating chart must be created and maintained. 22 Reminders Electronic Devices • Students may not have any electronic devices except a calculator at their desks, in their pockets, or anywhere they can reach them during testing, even if they are turned off or they do not use them. • If a student is found to be in possession of ANY electronic device(s) during testing OR during a break (e.g., restroom breaks, lunch), his or her test must be invalidated in order to successfully enforce this policy. • Students and parents/guardians must be made aware of this policy prior to testing. 23 Reminders Leaving Campus • If a student begins a session and leaves campus without finishing (due to an appointment, illness, etc.), he or she will NOT be allowed to complete that session. • No exceptions will be made once the student leaves the school’s campus, so parents/guardians and students must be made aware of this policy. • If a test administrator has concerns about a student (e.g., if a student seems ill), that student should be tested in a different test session or on a make-up day. 24 Reminders Marking Tests Complete Student tests should only be Marked Complete in one of the following circumstances: • A student had to leave the test (e.g., cheating, illness) and will not finish the test. (After being marked complete, school personnel will invalidate the test.) • A student finished the test but exited instead of submitting the test and the test should be scored. • As otherwise directed by FDOE or Pearson after a technical difficulty or other extenuating circumstance. 25 Reminders • The following resources for this administration can be found at www.FLAssessments.com/EOC: Test administration manual Technology coordinator guide Student tutorials Forms to report test irregularities/security breaches and missing materials Training materials Comment forms Blank Administration Record/Security Checklist Security Log ̶ ̶ ̶ ̶ ̶ ̶ ̶ ̶ Test Administrator Prohibited Activities Agreement Test Materials Chain of Custody Form Florida EOC Test Administration and Security Agreement ̶ ̶ ̶ ̶ ̶ ̶ ̶ Materials Return List Braille Scripts Reference sheet and periodic table Parent/guardian letters 26 Glossary of Terms PearsonAccess – www.pearsonaccess.com/fl • A website used for almost all test preparation (e.g., PreID), setup, administration, and reporting tasks. • Requires a username and password. • Link to support materials: www.FLAssessments.com/EOC • Verify the correct test administration is selected each time you log in. • PearsonAccess will timeout after 14 minutes of inactivity. 27 Glossary of Terms PearsonAccess Training Center • Accessed from the Training Center tab on PearsonAccess home page. • Provides an opportunity to ̶ ̶ practice PearsonAccess tasks manage the Infrastructure Trial in preparation for testing • Requires a username and password. 28 Glossary of Terms Proctor Caching • A process of locally loading or “caching” test content on a computer at the school level. Broward non charters schools are cached at the district • Does not require a separate caching server and can run on any workstation on the network that meets minimum requirements. • Software is provided by Pearson. • Reduces test delays due to network congestion. • Provides students with a more seamless testing experience. • Required for all FCAT/FCAT 2.0/EOC computer-based testing in Florida. 29 Glossary of Terms TestNav 6.9 (TestNav) • Platform for Florida’s FCAT/FCAT 2.0/EOC computer-based statewide assessments. • Software application installed either on a file server or on each computer that will be used for testing. 30 Glossary of Terms TestHear 2.1.0.7 (TestHear) • Platform used to deliver accommodated forms (e.g., large print, zoom, color contrast, screen reader, assistive devices) for Florida’s FCAT/FCAT 2.0/EOC computer-based statewide assessments. • Software application installed on each computer that will be used to test students who require computer-based accommodated forms. • TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). • TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows. 31 Glossary of Terms ePAT (Electronic Practice Assessment Tool) • Provides students an opportunity to practice using the computer-based platform prior to testing. • Available for download at www.FLAssessments.com/ePATs. • Download ePAT launcher separately from practice test content. • Accommodated ePATs are also available. Launcher is bundled with the practice test content for accommodated forms. • Scripts and instructions for downloading ePATs are under the Resources tab. 32 Pearson Support and PearsonAccess Contacts for Support (in this order) • District ETS department: 754-321-0411 • Student Assessment: 754-321-4250 • Pearson: 1-877-847-3043 Appendix C in the 2012-2013 EOC Manual provides the following information: • PearsonAccess ̶ User accounts (FDOE distributed instructions for setting up user accounts to district assessment coordinators.) ̶ Browser requirements ̶ Logging in for the first time ̶ Resetting passwords 33 Students to be Tested Algebra 1 The following students will take the Spring 2013 Algebra 1 EOC Assessment: • All students who are enrolled in and completing one of the following courses: o Algebra 1 – 1200310 o Algebra 1 Honors – 1200320 o Algebra 1-B – 1200380 o Pre-AICE Mathematics 1 – 1209810 o IB Middle Years Program/Algebra 1 Honors – 1200390 34 Students to be Tested Algebra 1 (cont.) The following students are eligible to participate in the Spring 2013 Algebra 1 EOC Assessment administration: • Students who need to retake the assessment to earn a passing score for course credit, including students enrolled in credit recovery courses • Students who entered 9th grade in the 2010–11 school year – who have not yet taken the assessment to be averaged as 30% of their final course grade – who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit 35 Students to be Tested Biology 1 The following students will take the Spring 2013 Biology 1 EOC Assessment: • All students enrolled in and completing one of the following courses: o Biology 1 – 2000310 o Integrated Science 3 – 2002440 o Biology 1 Honors – 2000320 o Integrated Science 3 Honors – 2002450 o Pre-AICE Biology – 2000322 o AP Biology – 2000340 (if taken to satisfy the high school Biology 1 graduation requirement) This course o Biology Technology – 2000430 o Biology 1 PreIB – 2000800 o IB Middle Years Program Biology Honors – 2000850 was omitted from the list in the manual. 36 Students to be Tested Biology 1 (cont.) The following students are eligible to participate in the Spring 2013 Biology 1 EOC Assessment administration: • Students who need to retake the assessment to earn a passing score for course credit, including students enrolled in credit recovery courses • Students who entered 9th grade in the 2011–12 school year – who have not yet taken the assessment to be averaged as 30% of their final course grade – who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit 37 Students to be Tested Geometry The following students will take the Spring 2013 Geometry EOC Assessment: • All students enrolled in and completing one of the following courses: o o o o Geometry – 1206310 Geometry Honors – 1206320 IB Middle Years Program Geometry Honors – 1206810 Pre-AICE Mathematics 2 – 1209820 38 Students to be Tested Geometry (cont.) The following students are eligible to participate in the Spring 2013 Geometry EOC Assessment administration: • Students who need to earn a passing score for course credit, including students enrolled in credit recovery courses • Students who entered 9th grade in the 2011–12 school year – who have not yet taken the assessment to be averaged as 30% of their final course grade – who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit 39 Students to be Tested U.S. History The following students will take the Spring 2013 U.S. History EOC Assessment: • All students enrolled in and completing one of the following courses: o United States History – 2100310 o United States History Honors – 2100320 • Any student who completed one of the above courses during the 2012-13 school year must participate in the Spring 2013 U.S. History EOC Assessment. 40 Students to be Tested Civics Field Test The following students will take the Civics EOC Assessment Field Test: • All students enrolled in and completing one of the following courses at schools selected in the field test sample: o o o o o o o • • Civics – 2106010 Civics – 2106015 Civics & Career Planning – 2106016 Civics, Advanced – 2106020 Civics, Advanced – 2106025 Civics, Advanced & Career Planning – 2106026 Civics and Digital Technologies – 2106029 Students who completed one of the above courses at the end of semester one should NOT participate in this field test administration. Any students who require paper-based accommodations, accommodated CBT forms, or computer-based assistive devices will not participate. 41 Students to be Tested Special Program Students • Make arrangements to test special program students (Home Education, Virtual School, McKay Scholarship, FTC Scholarship). • Ensure that these students are tested under the correct school number, according to the chart on page 107 of the manual. English Language Learners (ELLs) All ELLs who complete the appropriate courses are expected to participate in EOC assessments no matter how long these students have been receiving services. 42 Students to be Tested Students with Disabilities • All students with disabilities participate in the statewide assessment program by taking one of the following: ̶ EOC assessment without accommodations, ̶ EOC assessment with accommodations, or ̶ Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. • See Appendix A of the manual for information regarding accommodations. 43 Proctors • When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors. 1-25 students Test Administrator* 26-50 students Test Administrator and 1 Proctor 51-75 students Test Administrator and 2 Proctors *It is strongly recommended that a proctor be assigned to rooms with 25 or fewer students whenever possible. 44 Missing Materials • • Schools must investigate ANY report of missing materials and report missing secure materials to the district assessment coordinator immediately. Within 30 calendar days of the incident, a written report must be submitted to the FDOE. The report must include: The nature of the situation The time and place of the occurrence The names of the persons involved A description of the communication between the district assessment coordinator’s office and school personnel − How the incident was resolved − What steps are being implemented to avoid the future losses − − − − • Schools should submit completed reports to the district office, and district assessment coordinators should then submit reports to FDOE. • A form to report missing materials can be found at www.FLAssessments.com/EOC. 45 Test Irregularities/ Security Breaches • • • Test administrators should report any test irregularities (e.g., disruptive students) and possible security breaches to the school assessment coordinator immediately. The school assessment coordinator should communicate with the district assessment coordinator regarding possible test invalidations. Within 10 calendar days of the test irregularity or security breach, a written report must be submitted to the FDOE. The report must include: – – – – – – • • The nature of the situation The time and place of the occurrence The names of the persons involved A description of the communication between the district assessment coordinator’s office and school personnel How the incident was resolved What steps are being taken to avoid future test irregularities or security breaches Schools should submit completed reports to the district office, and district assessment coordinators should then submit reports to FDOE. A form to report test irregularities and security breaches can be found at www.FLAssessments.com/EOC. 46 Test Invalidation • District assessment coordinators should advise schools of the appropriate course of action if invalidation is being considered. Remember that the purpose of invalidation is to identify when the validity of test results has been compromised. • More information about test invalidation and instructions for how to invalidate tests may be found on pages 20-21 and 121-122 of the 2012-2013 EOC Manual. 47 Test Administrator Before Testing Read the test administration manual. Read the Test Administration Policies and Procedures and sign the Florida EOC Test Administration and Security Agreement. Read and sign the Test Administrator Prohibited Activities Agreement. Establish an appropriate setting for test administration and remove or cover any unauthorized aids in the testing room. Prepare and assemble all materials needed for test administration. Ensure that students and their parents/guardians understand the testing policies prior to the first day of testing. If you are administering tests to students who require accommodations, become familiar with the accommodations and discuss with your school coordinator how accommodations will be provided. Ensure that you are familiar with how to open TestNav or TestHear to the login screen for each student computer prior to testing. 48 Test Administrator Before Testing Testing Location • Tests should be administered in a room that has comfortable seating, good lighting, adequate ventilation, and sufficient workspace. • Students must not be able to easily view other students’ computer screens, work folders, worksheets, or test and answer books. During the practice test, check the configuration of your testing room to make sure you will be able to provide a secure environment during testing. If necessary, use visual blocks. • Post the sign that reads TESTING—Please Do Not Disturb on all entrances to the testing room and display starting and stopping times for students as soon as testing begins. • Students may not have access to any unauthorized aids. Discuss any concerns with your school assessment coordinator. 49 Test Administrator Before Testing Testing Location (cont.) • When you arrive on the day of testing, open each student workstation in the testing room to the student login screen as indicated in the script, but do not log in for students. • Display the student comment form URL (www.FLAssessments.com/EOCStudentCommentForm) on the day of testing, or create shortcuts on student workstations to ensure each student is able to complete the form after testing. • Ensure that you have a way to contact the technology coordinator or the school assessment coordinator during testing without leaving the room unattended. 50 Test Administrator Before Testing 2012-13 EOC Manual • You will need the 2012-2013 End-of-Course Assessments Test Administration Manual to read the test administration script(s) to students. • When testing students who are allowed certain accommodations, you may need to modify the scripts. It is especially important that you review the scripts BEFORE testing begins to determine the necessary modifications. Do not interpret this as permission to paraphrase test items. • Scripts and instructions for the administration of accommodated computer-based (TestHear) forms and paper-based forms are provided in Appendix A. 51 Test Administrator Before Testing 2012-13 EOC Manual (cont.) • Appendix D on page 284 is the CBT Test Administrator Quick Reference Guide. • This guide lists possible error messages students may encounter, explanations for each message, and possible solutions. 52 Test Administrator Before Testing Student Authorization Tickets • For each test session, each student needs a Login ID and a 6-character test code (password), which are printed on the Student Authorization Tickets. • Students will need a pen or pencil during testing to sign their tickets. • Provide each student a ticket only AFTER all students have entered the testing room, as instructed in the script, and all tickets must be collected BEFORE students leave the testing room. • Student Authorization Tickets must be handled in a secure manner and returned to the school assessment coordinator immediately after each day of testing is completed. 53 Test Administrator Before Testing Student Authorization Tickets (cont.) 54 Test Administrator Before Testing Session Roster • A Session Roster is a list of all students scheduled in a test session that displays important information including: ̶ ̶ ̶ ̶ ̶ ̶ ̶ ̶ ̶ ̶ Test Administration Session Name Test to be Administered Test Code (password) Student Names Student ID Numbers Student Birth Dates Class Information Login IDs Blank space to record attendance information and accommodations used • The Session Roster may be used to record required administration information. • Session Rosters must be handled in a secure manner and returned to the school assessment coordinator immediately after each test 55 session is completed. Test Administrator Before Testing Session Roster (cont.) • The School Assessment Coordinator sections of the 20122013 EOC Manual provide instructions for creating and printing Session Rosters. 56 Test Administrator Before Testing Test Group Code • A test group code is a unique four-digit number used to identify a group of students testing together. • District assessment coordinators either will create and distribute test group codes to all school assessment coordinators or instruct them to create their own unique four-digit codes. • Each group of students, by testing room, initial and makeup, should receive a unique test group code. • Students will enter the test group code before beginning the test, as indicated in the scripts. 57 Test Administrator Before Testing Test Code Test Group Code A six-character code (password) created by A unique four-digit number created by district PearsonAccess and printed on Student assessment coordinators or by school Authorization Tickets and Session Rosters. assessment coordinators used to identify The Login ID and the test code are required to groups of students tested together. The test log in to TestNav and TestHear. group code is entered after the Testing Rules Acknowledgment and before students see the first question. 58 Test Administrator Before Testing Work Folders • The Florida Computer-Based Testing Work Folder is a blank piece of 11x17 yellow paper folded in half with grid paper on the back cover. Work folders will arrive with your PreID label shipment, or in a separate shipment if you did not identify any paper-based testers. • For the Algebra 1, Biology 1, and Geometry EOC assessments, students are provided with work folders to work the problems. One work folder should be sufficient for each student; however, students may request additional folders. • Work folders must be distributed to students at the beginning of each test session. • Ensure that students have enough desk space to use their folders. • Once students complete the Algebra 1 or Biology 1 test, collect all work folders and return them to the school assessment coordinator. • Used work folders are secure materials. 59 Test Administrator Before Testing CBT Worksheets • If schools have chosen to provide them, students taking the computerbased U.S. History EOC Assessment or Civics Field Test (TestNav or TestHear) may use a CBT Worksheet to make notes rather than using the CBT notepad tool. • The CBT Worksheet is an 8 ½ x 11 page (located in Appendix E) that may be copied and distributed to students at the beginning of a test session. • If your school is providing hard copies of the CBT Worksheet, a sufficient number of copies should be available for all students taking the assessment. • Students must have enough desk space to use their worksheets. • Once students complete the test, collect all worksheets and return them to the school assessment coordinator. • Used worksheets are secure materials. 60 Test Administrator Before Testing Four-Function Calculators – TestNav • The computer-based TestNav Algebra 1 and Biology 1 EOC assessments have a built-in four-function calculator. • Students may use the built-in calculator, or they may use a handheld four-function calculator. • Test administrators should provide handheld calculators at the beginning of a test session to all students who request them, as indicated in the test administration script. • Your district should have an adequate supply of approved fourfunction calculators provided by the FDOE. No other calculators may be used. 61 Test Administrator Before Testing Four-Function Calculators – TestHear • Test Hear does NOT have a built-in four-function calculator. • Students who will test using TestHear accommodated forms of the Algebra 1 and Biology 1 EOC Assessments MUST be provided handheld four-function calculators. • Students with visual impairments may use the approved large key/large display calculators or approved talking calculators supplied by the FDOE. Schools that have not yet accumulated an adequate supply of approved large key/large display or talking calculators may use comparable calculators that are regularly used in their classrooms. Such calculators must be basic four-function models and must not have functions that are unavailable on approved calculators. 62 Test Administrator Before Testing Scientific Calculators – TestNav • The TestNav Geometry EOC Assessment has a built-in scientific calculator. • Students may use handheld scientific calculators, if the school has chosen to provide them. Handheld scientific calculators must be approved models, as shown on page 11 of the 2012-2013 EOC Manual. Requests to use other models must be submitted to FDOE no later than two weeks prior to the test administration. • Handheld scientific calculators will not be provided by the FDOE for students taking the Geometry EOC Assessment using TestNav. 63 Test Administrator Before Testing Scientific Calculators – TestHear • The TestHear Geometry EOC Assessment does not include an online scientific calculator. • Handheld scientific calculators will be provided by FDOE for students taking the Geometry EOC Assessment using TestHear accommodated CBT forms. • Students with visual impairments may use large key/large display scientific calculators that are comparable in function to the approved scientific calculators (on page 11 of the 2012-2013 EOC Manual). The approved talking scientific calculator is the Orion TI-36X or one that is comparable in function to the Orion TI-36X. No other calculators may be used. 64 Test Administrator Before Testing Reference Sheets and Periodic Tables • Reference sheets and periodic tables are provided in an online format only for CBT testers. However, schools may provide hardcopy reference sheets or periodic tables to students. • Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix E of the manual (also available at www.FLAssessments.com/EOC). • If your school will provide hard-copy reference sheets or periodic tables to students, check each copy before distributing to students and follow the instructions in the administration scripts. • Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts. • Once students complete the test session, the test administrator should collect all reference sheets and periodic tables. • Used reference sheets and periodic tables are secure materials. 65 Test Administrator Before Testing Security Log A Security Log must be maintained for each testing room. Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room. 66 Test Administrator Before Testing Seating Chart • An accurate seating chart must be maintained for each testing room for each test session. Seating charts must capture the following information: − − − − − − − − − − The room name/number Student names and their location in the room during testing The front and back of the room Direction students are facing Date Session starting time Test administrator name Names of proctors (if applicable) Test group code Session name in PearsonAccess (CBT) • If students are moved to a new location or the seating configuration changes during testing, a new seating chart must be created. 67 Test Administrator Before Testing Additional items • Pens and/or pencils – Ensure each student has a pen or pencil to sign his or her authorization tickets and make notes or work the problems during testing – Students taking paper-based tests must use No. 2 pencils • Clock or watch – Keep accurate time during testing • Signs (Appendix E) ̶ ̶ Do Not Disturb Sign—display on all entrances Electronic Devices Sign—display where it will be visible to all students in the testing room 68 Test Administrator Before Testing Communicate Testing Policies to Parents/Guardians and Students • Electronic Devices Policy—If students are found with ANY electronic devices during testing OR during breaks, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on the day of testing. • Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test. If a student does not feel well on the day of testing, it may be best for the student to wait and be tested on a make-up day. • Testing Rules Acknowledgment—Students will click a checkbox (TestNav) or circle (TestHear) next to a Testing Rules Acknowledgment that reads: “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” 69 Test Administrator Before Testing Administration Accommodations • Appendix A of the 2012-2013 EOC Manual contains detailed information regarding administration accommodations, TestHear accommodated CBT forms, and paper-based accommodations. • All personnel involved in administering tests to students with allowable accommodations must familiarize themselves with the information in Appendix A. 70 Test Administrator During Testing Maintain the seating chart, Security Log, and record of required administration information for your room. Ensure that each student has a pen or pencil and distribute testing materials as indicated in the scripts. Read the appropriate administration scripts VERBATIM to students. Read the important information and adhere to the instructions between the SAY boxes. Keep accurate time for each test session and display times for students. Maintain test security at all times and report violations or concerns to your school assessment coordinator immediately. 71 Test Administrator During Testing Supervise test administration and ensure the following: • Students have cleared the area around their workstations of all materials except for Student Authorization Tickets, pens or pencils, and, as applicable, calculators, work folders, worksheets, reference sheets, and periodic tables • Students check the Testing Rules Acknowledgment box and enter the correct test group code • Students do not have electronic devices (except for approved calculators) of any kind during testing, even if they do not use them • Students do not talk to other students or make any disturbance • Students are working independently • Students are working in the correct test 72 Test Administrator During Testing • It is not appropriate to use cell or classroom phones, grade papers, or work on the computer during testing. • While you may encourage students to continue working, you may not talk with them about test items or help them with their answers. • If a student’s computer is disconnected from the test, contact the technology coordinator to help diagnose any technical issues, or contact the school assessment coordinator to resume that student’s test in Pearson Access. • If a student has continual difficulty logging in or gets kicked out of the test more than once, do not have the student continue attempting to log in until the issue is diagnosed and resolved. • If students finish the test in the first 80 minutes before the 10-minute break, you may encourage them to go back and check their work. • As students complete the test, assist them with accessing the student comment form, as needed. 73 Test Administrator After Testing Verify that you have collected all required administration information, including accommodations actually used by each student. Verify that your seating chart and Security Log have been completed correctly, and make copies for your files. Report any missing materials (including used work folders, used worksheets, used reference sheets and periodic tables, etc.) and/or test irregularities to your school assessment coordinator. Organize materials and return them to your school assessment coordinator (see page 82 in the 2012-2013 EOC Manual). Complete the Test Administrator Comment Form at 74 www.FLAssessments.com/EOC. School Coordinator Before Testing Read the Florida Test Security Statute and the State Board of Education Test Security Rule (Appendix B) and all applicable information in the test administration manual, then sign the Florida EOC Test Administration and Security Agreement. Ensure that test administrators sign the Test Administrator Prohibited Activities Agreement. Train your test administrators and proctors, including non-school-based instructors (e.g., itinerant teachers). You must train several employees to act as possible alternates. Receive test materials from your district assessment coordinator. 75 School Coordinator Before Testing Inventory the materials within 24 hours of receipt and report missing materials or request additional materials immediately. Communicate the process for collecting required administration information to your test administrators. Distribute test group codes to test administrators. Assign proctors, as needed. Arrange practice test sessions. Ensure that appropriate test settings are available for all test sessions. Verify student information and create test sessions. 76 School Coordinator Before Testing Distribute Session Rosters and Student Authorization Tickets on the day of test administration. Make arrangements to test any special program students (district virtual instruction programs, Home Education Program, etc.) who may be testing at your school. If any students who require accommodations are testing at your school, discuss with test administrators how accommodations will be provided (Appendix A). 77 School Coordinator Before Testing Receive Test Materials • You will receive the following materials, as appropriate for your school: – Work folders – PreID labels and rosters – School Boxes (paper-based test materials—contents listed on pages 84-85 of the 2012-2013 EOC Manual) – Special Document Boxes – Other materials, as indicated in the 2012-2013 EOC Manual • If your school is providing hardcopy CBT Worksheets, reference sheets, or periodic tables, make a sufficient number of copies for all students taking the assessments. Each copy must be carefully checked against the original. 78 School Coordinator Before Testing Receive Materials/Maintain Security • Keep materials secure at all times. • Maintain the Test Materials Chain of Custody Form at all times. • No more than three individuals may have access to the locked storage area. • Do not open shrink-wrapped materials or begin preparing (applying student labels) more than one week prior to testing. • Save the original boxes for returning TO BE SCORED special document materials. • If you need additional materials or if you have questions, contact your district assessment coordinator. 79 School Coordinator Before Testing Arrange ePATs • Schedule and arrange ePAT practice sessions, as described in the 2012-2013 EOC Manual. • Before a student can participate in a computer-based administration, the student must complete the appropriate ePAT(s) to learn how to use the computer-based system. Students who previously participated in an ePAT for the subject test they are scheduled to take are NOT required to participate in an ePAT session for this administration. • To access instructions for downloading and installing the ePAT Launcher, practice test content, and scripts for administering the ePATs, go to www.FLAssessments.com/ePATs. The technology coordinator will need to download and install the software. 80 School Coordinator Before Testing Arrange ePATs (cont.) • Students who require accommodated CBT forms (e.g., large print, color contrast, zoom, screen reader, assistive devices) must complete a practice test using the TestHear ePAT with the specific accommodated form or form combination they will use during testing. • Accommodated practice forms and accommodated ePAT scripts are available at www.FLAssessments.com/ePATs. 81 School Coordinator Before Testing Create Test Sessions • Your district may have created test sessions automatically via the PreID upload. If your district created test sessions through the PreID upload, you will see these sessions when you log in to PearsonAccess. • If your district did not create test sessions during the PreID upload, you will need to create test sessions before you can verify student information. • These can be temporary sessions for the purpose of verifying student information, or they can be test sessions you plan to use for testing. • Detailed instructions on how to create a test session and verify student information are on pages 90-93 of the 2012-2013 EOC manual. 82 School Coordinator During Testing Supervise Test Administration Ensure that test sessions have been started in PearsonAccess (page 114 of the 2012-2013 EOC Manual). Provide test administrators with additional materials, as necessary. Monitor each testing room to ensure that test administration and test security policies and procedures are followed, seating charts and Security Logs are properly completed, and required administration information is collected. Be available during testing to answer questions from test administrators. In PearsonAccess, monitor session status and resume students’ tests, if necessary (pages 114-117 of the 2012-2013 EOC Manual). Arrange for and supervise make-up administrations. 83 School Coordinator After Testing Verify that all distributed secure materials have been returned. Complete the Test Materials Chain of Custody Form. Report any missing materials to your district assessment coordinator and conduct the necessary investigation. In PearsonAccess, stop test sessions, invalidate student tests (if necessary), and record accommodations actually used by students. Organize materials and return them to your district assessment coordinator (refer to pages 124-138 in the 2012-2013 EOC Manual for instructions). Copy the seating charts, required administration information, Chain of Custody forms, and Security Logs, file the copies, and return the originals in the District Assessment Coordinator ONLY boxes. Return used and unused work folders and CBT Worksheets in the District Assessment Coordinator ONLY Box. Securely store or return used reference sheets and used periodic tables according your district assessment coordinator’s instructions. Store handheld calculators according to your district assessment coordinator’s instructions. Store Student Authorization Tickets and Session Rosters until results are reported for this administration, and then destroy them according to your district assessment coordinator’s instructions. 84 Paper-Based Tests (PBT) The following slides relate to the administration of paperbased tests (regular print, large print, or braille), which are available for eligible students who have such accommodations identified in their IEPs or Section 504 plans. Paper-based large print is available as a unique accommodation for eligible students. The upper-left corner of the following slides show an image of a pencil and a paper-based test (see below) to indicate that this information pertains to paper-based tests only. 85 Paper-Based Tests Materials Needed for Testing • Test Documents ̶ ̶ ̶ ̶ Algebra 1 EOC Test and Answer Books Biology 1 EOC Test and Answer Books Geometry EOC Test and Answer Books U.S. History EOC Test and Answer Books • Reference Sheets and Periodic Tables • Calculators (approved four-function and scientific) 86 Paper-Based Tests Chain of Custody Form • The Test Materials Chain of Custody Form is available in Appendix E of the 2012-2013 EOC Manual and in PearsonAccess. • The purpose of this form is to track test materials at all times, including: – their location – the dates and times they are handled – the names of the persons performing various activities involving the materials. • Schools must retain copies (electronic or hardcopy) of completed forms for their files after materials are packaged for pickup and return the originals (via email or in the District Assessment Coordinator ONLY Box) to the district assessment coordinator. • A certified educator must be present at all times that test materials are handled directly. 87 Paper-Based Tests Preidentified (PreID) Student Labels • Four elements must be correct on PreID labels: student name, student ID number, district number, and school number. • If the student name, ID number, district number, OR school number is INCORRECT on a label, the label must not be used, and the correct information must be gridded on the student grid sheet. • If any other information is incorrect (e.g., date of birth), use the label. 88 Paper-Based Tests PreID Labels (cont.) • • • • • • Affix the label in the box in the lower left corner of the student grid sheet. Do not remove labels once they have been affixed. Do not place a label over another label. If the student name, student ID number, district number, or school number is INCORRECT on a USED document, the student must, under the supervision of the test administrator, transfer his or her exact responses into a replacement answer document. – The test administrator must then grid the correct student information on the replacement document. If any student information is missing from a student label that has been affixed to a document, add the information by gridding the appropriate bubbles on the student grid sheet. Incorrect information on a student label CANNOT be corrected in this manner. Do not use a preidentified document for any student other than the student for whom it is preidentified. 89 Paper-Based Tests Security Numbers • Used to account for each test and answer book. • Consists of a nine-digit number followed by a check digit located in the upper right corner of test and answer books. • Packing list shows the number ranges assigned to each school, and written documentation of the number ranges must be maintained at all times during distribution and return of books. • Pre-populated Administration Record/Security Checklists with security numbers for all test and answer books are provided in PearsonAccess. – Blank Administration Record/Security Checklist also provided in PearsonAccess and in Appendix E of the manual. • Test administrator should maintain a list of all secure materials assigned to him or her, including any additional materials assigned throughout the administration. 90 Paper-Based Tests Student Demographic Information • Student grid sheet captures student demographic information. • Blank student grid sheets (non-preidentified) must be gridded using a No. 2 pencil. • For more information about specific demographic fields, see pages 106-109 of the 2012-2013 EOC Manual. 91 Paper-Based Tests Sample Student Grid Sheet 92 Paper-Based Tests Defective Materials, DNS and UNDO Bubbles • • • • If a defective test and answer book is identified before testing begins, the student should be given a replacement document and the defective document should be returned with all other NOT TO BE SCORED materials. If a DNS bubble has been gridded by mistake, erase the DNS bubble and grid the UNDO bubble. Package the document with other TO BE SCORED materials. The DNS bubble MUST be gridded in the follow circumstances: – The document is defective and used. – A student name, ID number, district number, or school number is incorrect on a PreID label affixed to a USED document. – A student label has been placed over another label on a USED document. If a student discovers a document is defective during testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement when the test session is over. – The DNS bubble(s) must be gridded on the defective document and it should be returned with all other NOT TO BE SCORED materials. 93 Paper-Based Tests Student Enrollment Information/Testing History • On the back of the paper-based test and answer book, complete the Student Enrollment Information box to indicate whether the student is taking the EOC assessment for the first time and whether the student is currently enrolled in, was previously enrolled in, or has never been enrolled in one of the courses in the Course List box. • See page 109 of the 2012-2013 EOC Manual for samples of the boxes for the different subjects. 94 Paper-Based Tests Test Administrator After Testing Return Test Materials to School Assessment Coordinator After testing, test administrators should organize paper-based materials according to the list below: • TO BE SCORED – Cover sheet and documents • NOT TO BE SCORED – Cover sheet and documents (includes unused documents and defective documents) • Test administration manuals, Security Log, required administration information, seating chart, used and unused reference sheets and periodic tables 95 Paper-Based Tests School Assessment Coordinator After Testing Return Materials to District Assessment Coordinator After testing, school assessment coordinators should return materials according to the instructions below (and refer to pages 124-138 of the 2012-2013 EOC Manual): 1. Verify that all distributed secure materials have been returned. Complete your Chain of Custody form. Notify your district assessment coordinator immediately if any secure materials are missing. 2. Check for and remove any stray reference sheets or periodic tables from the test and answer books. 3. Copy records of required administration information, Security Logs, and seating charts, and file the copies. 4. If a test has been invalidated, verify that the DNS bubble has been gridded and that the document is placed with TO BE SCORED materials. Verify that the DNS bubble has been gridded on a defective document and that the document is placed with NOT TO BE SCORED materials. Verify that no DNS bubble has been gridded by mistake. If it has, verify that the DNS bubble has been erased and the UNDO bubble has been gridded and place the document with TO BE SCORED materials. 96 5. Use the cover sheets to separate test materials for return. Paper-Based Tests School Assessment Coordinator After Testing Complete Document Count Forms 1. Verify that all documents from make-up sessions are included. 2. Do not copy blank count forms; however, once the count forms are completed, you may copy them for your records. 3. Place each completed form on top of the first stack of corresponding TO BE SCORED test and answer books. 4. Inaccurate information on the Document Count Form may adversely affect the scoring process; therefore, it is vital that all information on this form be accurate. 97 Paper-Based Tests School Assessment Coordinator After Testing Paper Bands • Each document type must be banded separately. You may use more than one paper band per document type, if necessary. • Complete all fields on the paper band. 98 Paper-Based Tests School Assessment Coordinator After Testing Package Materials for Return Prepare the following types of boxes for return to your district assessment coordinator (as appropriate): Algebra 1 TO BE SCORED documents—Transcribed Biology 1 TO BE SCORED documents—Transcribed Geometry TO BE SCORED documents—Transcribed U.S. History TO BE SCORED documents—Transcribed All NOT TO BE SCORED materials—Yellow-labeled boxes. All transcribed books go here. • Large Print TO BE SCORED materials—Transcribed • Braille TO BE SCORED materials—Pink-labeled boxes • District Assessment Coordinator ONLY boxes • • • • • Refer to the packaging diagrams on pages 131, 134, and 137 of the 99 2012-2013 EOC Manual for guidance. Appendices • Appendices in the 2012-2013 EOC Manual include: – Appendix A—Accommodations – Appendix B—Test Security Statute and Rule – Appendix C—Pearson Support and PearsonAccess – Appendix D—CBT Test Administrator Quick Reference Guide – Appendix E—Forms, Cover Sheets, Checklists, Signs 100 Appendix A: Accommodations • Appendix A provides specific information and instructions regarding the following: – Accommodations for Students with Disabilities – Accommodations for English Language Learners – TestHear (Accommodated CBT Forms)—functionality information and administration scripts – Regular Print Paper-Based Accommodations—administration scripts and scripts for gridding or verifying student grid sheets – Special Documents—Braille and Large Print Test Administrator Responsibilities Before, During, and After Testing • School personnel responsible for administering tests to students with accommodations must familiarize themselves with all relevant information in Appendix A before testing. 101 Appendix B: Test Security Statute and Rule • Appendix B of the manual contains the following: – Florida Test Security Statute (1008.24) – Florida State Board of Education Test Security Rule (6A10.042) • All personnel involved in testing activities, including handling and maintenance of test materials, must read and understand the information in Appendix B prior to signing a Security Agreement. 102 Appendix C: Pearson Support and PearsonAccess Refer to Appendix C for the following: • Information needed prior to contacting Pearson Support • Information regarding PearsonAccess (operational site and training center) – Recommended operating system and browser combinations for workstations – Logging in for the first time – Resetting password – Training center Test Setup Exercise 103 Appendix D: CBT Test Administrator Quick Reference Guide Appendix D provides the following information to assist with trouble-shooting during CBT administrations: • TestNav Early Warning System popup and error messages, possible causes, and recommended actions. • TestHear Early Warning System popup and error messages, possible causes, and recommended actions. • Common Error Codes and Solutions in TestNav • Pearson Customer Support Information. 104 Appendix E: Forms, Cover Sheets, Checklists, Signs Appendix E contains the following forms, cover sheets, checklists, and signs to be copied and used before, during, or after testing: • • • • • • • • • • Florida EOC Test Administration and Security Agreement Test Administrator Prohibited Activities Agreement Test Materials Chain of Custody Form Security Log Blank Administration Record/Security Checklist Test Administrator, School Assessment Coordinator, Technology Coordinator, and District Assessment Coordinator Checklists Do Not Disturb Sign and Electronic Devices Sign Algebra 1 End-of-Course and Geometry End-of-Course Assessments Reference Sheet Periodic Table of the Elements Cover Sheets (for organizing paper-based materials after testing) 105 Comment Forms • After testing, test administrators, school coordinators, technology coordinators, and district coordinators are encouraged to complete a CBT comment form located at www.FLAssessments.com/EOC. • FDOE and Pearson appreciate feedback from district and school personnel. 106 Thank you for ensuring a secure and successful Spring 2013 EOC Assessments administration. Questions? 107