Florida Standard Assessment (FSA) and NGSSS Training Summer End of Course Assessments 1 Test Administration Manuals . While test security policies and procedures for FSA administrations are very similar to those in place for FCAT/FCAT 2.0/Next Generation Sunshine State Standards (NGSSS) End-of-Course (EOC) assessments, it is imperative that district and school personnel involved in test administrations familiarize themselves thoroughly with all test administration and security policies and procedures described in these training materials and the FSA and EOC test administration manuals. School personnel should communicate any questions or concerns prior to Student Assessment and Research 2 Two Contractors All NGSSS Aligned tests will be handled by Pearson. CBT administrations will be run through pearsonaccess.com/fl and TestNav 8.0 NGSSS aligned tests include Algebra 1 Retakes, Civics, Biology and US History EOCs All FSA Aligned tests will be handles by AIR and run through fsassessments.org and TDS/TIDE FSA Aligned tests are the FSA aligned EOCs: Algebra 1 & 2 and Geometry 3 FSA Test Administration Manual Scripts and instructions for administering the computer-based FSA Algebra 1, Geometry, and Algebra 2 End-ofCourse (EOC) assessments are included in the Spring FSA CBT Manual. There have been changes to the scripts for the summer administration, posted here: www.FLAssessments.com/EOC You may modify the scripts in the manual per the posted changes. 4 NGSSS EOC Test Administration Manual Scripts and instructions for administering computer-based NGSSS EOC tests (CBT) are included in this manual. Those include Algebra 1 Retakes, Civics, Biology and US History. 5 FSA Test Resources only on the Portal District and school personnel should read and have access to the following materials, available in the FSA Portal only: Summer Scripts for Administrating Computer Based FSA Assessments (for School Assessment Coordinators and Test Administrators) Scripts and Instructions for Administering Paper-Based FSA Assessments (EOCs) (for School Assessment Coordinators and Test Administrators) • Summer Scripts for Administering Computer-Based FSA Accommodations (for School Assessment Coordinators and Test Administrators) • TIDE User Guide (for District and School Assessment Coordinators) • Test Administrator User Guide (for School Assessment Coordinators , Test Administrators, and Technology Coordinators) 6 EOC Summer Session Schedule Aligned NGSSS (Pearson) NGSSS (Pearson) FSA (AIR) Test Test Dates Session Timing Algebra 1 Retake July 20–July 22, 2015 160+ (end of school day) minutes U.S. History, Civics, and Biology 1 Algebra 1, Algebra 2 and Geometry July 22, 2015 July 23 & 24, 2015 160+ (end of school day) minutes (2) 90 minutes over two days, up to 3 hours per session 7 EOC Test Administration at Test Centers Test Centers and Assignments : NGSS ALG July 20-22 NGSS BIO NGSS CIV NGSS USH FSA ALG FSA GEO July 23 & July 23 & 24 24 July 22 July 22 July 22 0 37 20 14 0 52 104 30 18 19 47 40 South Plantation 41 22 13 5 16 23 Taravella, J. P. 66 28 20 6 38 12 Flanagan 37 37 31 12 21 13 Monarch 34 11 15 6 14 55 McArthur Dillard 6-12 8 NGSSS EOC Test Administration at Test Centers -Each class will be dropped into a session in Pearson that corresponds to your center. This allows for multiple schools’ students to show up in your school’s testing sessions. -Test Sessions will be all of your students assigned in a subject for all 5 days of testing. And represent those students who turned in a registration to test -There will be sessions created at your site: 1.) All standard time students assigned and registered to your center 2.) All standard time students Eligible to test but not registered 2.) All ESE students registered and unregistered that may test at your center 3.) All ELL students registered and unregistered that may test at your center 9 NGSSS EOC Test Administration at Test Centers -Preid, Students were assigned to home school but placed in classes according to test center. Algebra Example: Centers Monarch Dillard Flanagan Mcarthur South Plantation Taravella Registered Students Non ESE/ELL MONA ALG STANDARD REG DILL ALG STANDAR D REG FLAN ALG STANDARD REG MCAR ALG STANDARD REG SOPL ALG STANDARD REG TARA ALG STANDARD REG Registered/Not ESE MONA ALG SWD REG DILL ALG SWD REG FLAN ALG SWD REG MCAR ALG SWD REG SOPL ALG SWD REG TARA ALG SWD REG Registered/Not ELL MONA ALG ELL REG DILL ALG ELL REG FLAN ALG ELL REG MCAR ALG ELL REG SOPL ALG ELL REG TARAELL ALG ELL REG Not Registered but eligible MONA ALG STANDARD/SW D/ELL NOT REG DILLALG STANDAR D/SWD/ELL NOT REG FLAN ALG STANDARD/SWD/ ELL NOT REG MCAR ALG STANDARD/SW D/ELL NOT REG SPLAALG STANDARD/S WD/ELL NOT REG TARAALG STANDARD/S WD/ELL NOT REG 10 NGSSS EOC Test Administration at Test Centers Each of these sessions will need to be started and kept open the entire testing window. Authorization tickets will be printed in Alphabetical order from these sessions and will need to be available each morning of testing. As each day’s testing progresses you should store tickets in separate used and unused batches. Or if you wish to print tickets as students show up you may do that as well. 11 FSA EOC Test Adminstration at Test Centers District Test Centers will be given districtwide access to TIDE Site Coordinators will need to filter by class code (next slide) to access students and their tickets. For those students who have registered, it may be best to filter and print tickets in alpha order prior to test day. 12 EOC Class Code Key School # xxxx Subject . Registered NA (NGSS ALG) NC (NGSS CIV) . ELL . SWD R is Reg Y (is ELL) 1 Digit Exceptionality letter ie K (is SWD) U is Unreg F or Z (not ELL) Z (is not SWD) NU (NGSS USH) FA (FSA ALG) F2 (FSA ALG 2) FG (FSA GEO) Examples 2751NA.R.Z.Z 2351FG.U.Z.K Standard student registered for Algebra Retake at Taravella SWD (with K exceptionality) Student eligible but not registered for Geometry at South Plantation 3391FA.R.Y.Z Flanagan ELL student registered for FSA Algebra. *In Pearson and on the rosters you may see a few students with U codes in a registered session. These are late registrants we moved into registered sessions. 13 Must be done prior to test day Print all the tickets for the following sessions in Pearson: Algebra Biology XXXX STANDARD XXXX STANDARD ALG REG BIO REG XXXX SWD ALG REG XXXX SWD BIO REG XXXX ELL ALG REG XXXX ELL BIO REG Civics History XXXX STANDARD CIV XXXX STANDARD HIS REG REG XXXX SWD CIV REG XXXX SWD HIS REG XXXX ELL CIV REG XXXX ELL HIS REG Filter by classcode in FSA and print for the results: Example for Algebra XXXX.FA.R.Z.Z XXXX.FA.R.Y.Z XXXX.FA.R.Z.K (for example) XXXX.FA.R.Z.Z XXXX.FA.R.Y.Z XXXX.FA.R.Z.K (for example) 14 . Rosters- NGSSS and FSA EOC Test Administration at Test Centers Student Assessment will provide you rosters for each day of testing. These are the only way to know who will come and on which day and ESE and ELL accommodations You will use these on test day to check in students and distribute authorization tickets These can also serve as your administration records. 15 Special Groups English Language Learners (ELLs) ALL ELLs are expected to participate in the enrolled EOC. Appropriate accommodations must be provided, see Appendix A of the manual. Student With Disabilities (SWDs) All students with disabilities participate in the statewide assessment program by taking one of the following: EOC without accommodations, EOC with accommodations, or All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. See Appendix A of the manual for information regarding accommodations. 16 Special Groups Contact Information: Home Education: District Guidance at (754) 321-2586 McKay Scholarship: at (754) 321-2553 Hospital/Homebound: at (754) 321-3400 Florida Virtual School Full Time and Florida Virtual Academy : Karl Yeats (754) 321-4250 17 Student Test Materials 18 NGSSS EOC Test Materials Grade and Subject TA Manual(s) Test Materials Work NGSSS Algebra 1 Retake NGSSS Civics Based and EOC Retakes TAM Folder 4 Function FCAT Calculator if requested Reference Sheet if school prints Authorization Tickets Computer CBT -Computer Based and EOC Retakes TAM Worksheet if school prints Authorization Tickets Work NGSSS Biology EOC NGSSS US History EOC -Computer Based and EOC Retakes TAM Computer Based and EOC Retakes TAM Folder Periodic Table of the Elements if school prints 4 Function FCAT Calculator if requested Authorization Tickets CBT Worksheet if school prints Authorization Tickets 19 FSA EOC Test Materials Grade and Subject FSA Algebra 1, Algebra 2 and Geometry EOCs* TA Manual(s) Test Materials FSA -FSA Computer Based TAM Test Administrator User Guide Math Work Folder FSA Approved Calculator if school provides (2nd session only) Test Tickets *Paper based accommodations for this CBT require additional materials 20 Test Materials CBT Worksheets NGSSS Civics and US History students may use CBT worksheets but they must be printed at the school for all students if provided. These will not have the rules on the back CBT Worksheets are not provided for students testing with paperbased accommodations. These students may use the blank space in their test and answer books to take notes. Used worksheets are considered secure materials and must be kept in locked storage and returned in the District Assessment Coordinator ONLY box. 21 Test Materials Work Folders FSA and NGSSS Florida Computer-Based Testing Work Folders, provided for students taking FSA EOCs, are four-page folders that students may use to work the mathematics problems. The Testing Rules Acknowledgment is printed on page two. The last page of the folder (back cover) is printed with graph paper. NGSSS Algebra 1 Retake and Biology students are also provided CBT work folders. These will not have the Testing Rules Acknowledgment on the back. Work folders are not provided for students testing with paperbased accommodations. These students may use the blank space in their test and answer books to work the problems. Used work folders are considered secure materials and must be kept in locked storage and returned in the District Assessment Coordinator ONLY22 box. Test Materials- Calculators FSA Scientific Calculators Algebra 1, Geometry, and Algebra 2 EOC assessments include a scientific calculator in the test delivery system. The scientific calculator is available for Session 2 of the Algebra 1, Geometry, and Algebra 2 EOCs. Handheld scientific calculators MAY be provided to ALL students during the appropriate test sessions. FDOE is not providing a list of approved handheld calculators; instead, a list of required and prohibited functionalities is available in the FSA Portal. MAKE SURE IF YOU GIVE CALCULATORS OUT THAT IT IS IN THE CORRECT SESSION. Providing a calculator in the incorrect test session or with prohibited functionalities is cause for test invalidation. 23 Test Materials- Calculators NGSSS 4 Function Calculators for Algebra 1 Retakes, and Biology Each district should have an adequate supply of fourfunction calculators provided by FDOE. Districts are responsible for establishing policies for the storage, use, and retention of calculators. For the rest of the online tests above, students may be provided a hand-held version of 4 function calculator upon request. 24 Test Materials NGSSS Reference Sheets and Periodic Tables Reference sheets (Algebra 1 Retakes) and periodic tables (Biology) are provided in an online format only for testers; however, schools may provide hardcopy reference sheets or periodic tables to students. Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix D of the manual (also available at www.FLAssessments.com/Spring). If your school will provide hardcopy reference sheets or periodic tables for CBT tests to students, check each copy before distributing to students and follow the instructions in the administration scripts. Once students complete the test session, the test administrator should collect all reference sheets and periodic tables. Used reference sheets and periodic tables are secure materials. 25 Inventory Your Materials Immediately Receive Materials/Maintain Security Box contents are listed in the corresponding manual for the test you are giving All secure materials include a detailed list of test materials that should be received Inventory those materials against the packing lists within 24 hours of receipt Save the original boxes for returning special document materials. If you need additional materials or if you have questions, contact Student Assessment and Research via the Assessment Materials ordering conference: assessment.materials@browardschools.com 26 Test Security 27 Test Security Examples of prohibited activities include the following: Reading or viewing the passages or test items before, during, or after testing Revealing the passages or test items Copying the passages or test items Explaining the passages or test items for students Changing or otherwise interfering with student responses to test items Copying or reading student responses Causing achievement of schools to be inaccurately measured or reported *Per Florida statute, if any staff involved in the test participate in the activities above either intentionally or unintentionally, they may be subject to reprimand, criminal punishment and/or loss of teaching certification. 28 TEST SECURITY Test Security Documentation: Every staff member (including school administrators) involved in testing must receive live training from the School Assessment Coordinator. Every staff member involved in testing must sign a Test Administration and Security Agreement. Keep on file at the school Every Test Administrator must sign the Test Administrator Prohibited Activities Agreement. Keep this on file at the school. Anyone administering the test must put their Florida Educator certification number on the Prohibited Activities Agreement. Seating Charts are mandatory. If a student moves during testing, it must be noted on the Seating Chart. The front and back of the room must also be noted. Required Administration Information is required. Security Numbers must be tracked. Test Security Logs must be completed for every testing room 29 Security Agreement Forms Test administrators and proctors must sign return a Test Administration and Security which indicates that they: − − − − and Agreement, Have received training Have read the Test Security Statute and State Board Rule Have read all applicable portions of the test administration manual Understand and agree to adhere to all test security and administration policies and procedures Test administrators are required to sign a Test Administrator Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document. 30 Proctors • When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors. Paper CBT • It is strongly recommended that a proctor be assigned to rooms with 30 or fewer students whenever possible • CBT Testing requires proctors for 25 or more students. • “Administrative Assistants” used as a second set of eyes. • Use Proctor Training BECON 31 Test Security ● NEVER leave materials unsecured ● Count materials each time they change hands ● Use the Test Material Chain of Custody form to track who is in contact with materials ● Collect materials daily ● Place materials in locked storage ● Record security numbers ● Do not allow staff or students access to materials except during testing. 32 What Are Secure Materials? Test Books with Items in them Test and Answer books with Items in them Work Folders or Work Sheets with student’s work that could be used to infer test content Any material that could potentially give unsupervised access to a test i.e. and Authorization or Test Ticket Any materials with a security number on it CHAIN OF CUSTODY Test Materials Chain of Custody Form Schools are required to maintain a Test Materials Chain of Custody Form (available at fsassessments.org or in the Test Administration Manuals). Record accurate information on the form, including the dates activities are completed, the names of the persons performing activities involving the materials, and information about the locked storage room. ONLY THREE PEOPLE SHOULD HAVE ACCESS TO THE LOCKED STORAGE ROOM. Retain electronic or hard copies of completed forms after materials are packaged for pickup, and email or return the originals to the district assessment coordinator. 34 Placement of Security Numbers All regular test books must be protected from loss, theft, and reproduction in any medium. FOR FSA- A unique identification number and a bar code are printed on the front cover of all secure documents. The eight digit security number is located under the barcode on the right FOR NGSSS- A security number consists of a nine-digit number followed by a check digit (located in upper right corner of secure test books or test and answer books). Written documentation of the number ranges must be maintained at all times during distribution and return of materials. 35 Security Numbers ● ● ● ● ● ● Track materials using security numbers Distribute materials sequentially Maintain complete list and verify each document is returned Document number ranges each time the materials are distributed and collected Note unused materials Record information on the Administration Record/Security Checklist 36 Security Log 37 Administration Record/Security Checklist As directed by the school coordinator, the test administrator may use the pre-populated Administration Record/Security Checklist, a blank copy of the checklist, or may make his/her own comprehensive record of security numbers, accommodations and attendance. Located in Appendix D of the FSA manual or in the back of other TAMs Security number(s) of the document(s) assigned to and returned by each student should be recorded and verified at the completion of each day of testing. Security numbers of secure materials not already listed on the prepopulated checklist (e.g., materials distributed from district overage) MUST be added to the record with the names of the students to whom the test materials are assigned. 38 Seating Chart 39 Testing Location Considerations Use classrooms whenever possible. Make sure that each room is free of distractions and has Comfortable seating Good lighting Sufficient workspace Adequate ventilation Avoid testing in a cafeteria, gymnasium, auditorium, or library whenever possible. Make sure that: students are not facing each other when seated at tables. students are not in seating (stadium or staggered) that allows them to easily view other students’ documents or computer monitor there is at least three feet between students and privacy screens are used for CBT Remove or cover all visual aids on student desks or displayed in the room, such as posters showing mathematical and scientific concepts, organizational strategies, etc. 40 Emphasis on Active Administering and Proctoring Test Administrators and proctors must be actively monitoring students **This means that for the entire test session, the adults in the room are actively walking around, observing students, and proactively addressing the class as to any potential issues.** Ensure that there is adequate space (3 feet) between students that are testing and that privacy boards are used. Make sure that students are working independently and cannot view other students’ tests Ensure the security of the test materials Ensure all electronic devices are not in students’ possession. 41 Invalidations Matrix Student Implications 42 Invalidations Matrix Staff Implications 43 NR8 Invalidations Students flagged with a high degree of similarity Test Administrators must actively proctor their testing rooms to reduce the number of NR8 invalidations. Certain grade levels (8th science, retakes), subjects or test arrangements appear to be conducive to answer sharing. Quality proctoring. Large numbers of NR8s may result in an investigation and affect your school grade. Missing Materials/Security Breach Test administrators should report any test irregularities (e.g., whole classrooms of disruptive students), possible security breaches and ANY report of missing materials to the school assessment coordinator immediately. The school assessment coordinator MUST communicate with Student Assessment and Research regarding possible test invalidations IMMEDIATELY AFTER (Same Day) they occur. Student assessment can be reached at 754-321-4250. 45 Letter of explanation documents: Within 2 calendar days of the incident, a written report must be submitted to Acting Chief School Performance and Accountability Officer , cc Richard Baum Director of Student Assessment & Research The report must include: The nature of the situation The time and place of the occurrence The names of the persons involved A description of the communication between the district assessment coordinator’s office and school personnel How the incident was resolved What steps are being taken to avoid future test irregularities or security breaches 46 Test Invalidation 47 Test Invalidation Remember that the main purpose of invalidation is to identify when the validity of test results has been compromised. A test administrator should discuss any situation involving possible invalidation with the school assessment coordinator, and the situation should be investigated immediately. If a situation described in the Test Invalidation/ Defective Materials Policies and Procedures section of the manual occurs, test administrators should discuss the situation with the school assessment coordinator, and the situation should be investigated immediately. If a misadministration results in invalidation due to staff misconduct or mistake, BCPS may recommend a formal reprimand. In extreme cases this may lead to loss of teaching certification or criminal charges as per the FLDOE’s recommendation. 48 Test Invalidation Please follow the test specific instructions for invalidation in the corresponding test administration manual. A test MUST be invalidated if any of the following circumstances occur: A student has an electronic device during testing or break in testing. A student is cheating during testing. 1. 2. Situations involving possession of electronic devices or possible cheating, should be investigated and discussed with the school assessment coordinator and site administrator before a final invalidation decision is made Return ALL invalidated tests with DNS indicated with all other TO BE SCORED materials. This will ensure that the student’s record is on the electronic file, but the student will not receive a score. 49 Possible Test Invalidation A test MAY be invalidated if any of the following circumstances occur: A student becomes ill and is unable to finish, OR a student is not allowed the correct amount of time. A an error occurs in the administration of an accommodation. An error occurs in test administration or procedures that could compromise the validity of the test results (e.g., students had access to an unauthorized visual aid that gave an unfair advantage, or the wrong reference sheet or calculator was provided). A student is disruptive during testing A student works in the wrong session A disruption occurs during testing 50 Avoidable Test Invalidation Scenarios The Most Avoidable Test Invalidation Scenarios include mistakes made in one of the following areas: Test Timing- The wrong amount of time was given in a test session Test Scheduling- The test was not provided to a student in the prescribed session format (i.e. 2 sessions over 2 days) Materials Provided Incorrectly- Wrong Reference sheet, calculator models or ELL dictionaries were provided (must be direct translation only). Calculators provided in wrong test session. Accommodations provided incorrectly- Not enough time, or accommodation administered incorrectly. You should do all in your power as a School Assessment 51 Coordinator to avoid mistakes to these areas. Do NOT Invalidate 1. 2. 3. 4. Student withdrew before starting a test Student absent for a session or the entire testing window Unused defective answer document Unused incorrect preidentified information Package for return with NOT TO BE SCORED materials and place a do not process label on any book with student information. 52 Test Administrator Responsibilities 53 Test Administrator Responsibilities Before testing: Read all applicable manuals for the grade levels you will be administering Attend the school based training given by the school assessment coordinator If you are giving accommodations, know how to implement the correctly Prepare room for testing Remove or cover all visual aids Ensure space between students and enough room to work Post DO NOT DISTURB and Electronic Devices signs 54 Before Computer Based Testing Before TestingPrepare room for CBT testing During the practice test, check the configuration of your testing room to make sure you will be able to provide a secure environment during testing. Students must not be able to easily view other students’ computer screens or test materials. Check the configuration of your testing room and make adjustments prior to test administration. Use visual blocks (file folders taped to the sides of the computer screens, computers placed back to back, etc). Privacy Boards should be used but not as a replacement for active monitoring during testing. 55 55 Test Administrator Responsibilities Before testing: Sign and return a Test Administration and Security Agreement, which indicates that the test administrator: Has received training Has read the Test Security Statute and State Board Rule Has read all applicable portions of the Test Administration Manual Understands and agrees to adhere to all test security and administration policies and procedures Sign and return a Test Administrator Prohibited Activities Agreement (certification numbers must be recorded on this form). You must be certified 56 Test Administrator Responsibilities Communicate Testing Policies to Parents and Students Electronic Devices Policy—If students are found with ANY electronic devices during testing or breaks their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on the day of testing. Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test. Test Rules Acknowledgement—Students will be asked to read and sign prior to testing indicating that they will not give or receive unauthorized help during the test or share test information on social media. If students are caught cheating or irregular answer patterns are detected during scoring, their tests will be invalidated 57 Before Computer Based Testing Before Testing Ensure that each student taking a CBT has taken the Training Test (FSA) FOR FSA- Understand how to create, monitor and close test sessions in the Test Administrator Interface. FOR FSA: View the Test Administrator Interface Tutorial posted to BECON and complete DOE TA certification FOR BOTH- Ensure you have Test Tickets (FSA) or Authorization Tickets (NGSSS) to provide to students. 58 58 Test Administrator Responsibilities Before testing: Assemble Materials Test Administration Manual is needed on the day of testing to read scripts to students, to ensure accurate timing for test sessions, and as a reference to avoid testing irregularities. Test Group Codes (unique four digit code) will be provided by your School Test Coordinator for FSA PBT or NGSSS CBT. For FSA CBT, you will used Session IDs instead Test Administrator Checklist (located in Appendix C) Test Administrator Interface Username and Password 59 Test Administrator Responsibilities Before testing: Assemble Signs (located in Appendix D) Materials (cont’d) Do Not Disturb (posted on entrances to the testing room) Session (displayed for students) Electronic Devices (displayed for students) Security Log (located in Appendix D) Seating Chart for each test session Record of Required Administration Information (or session roster) Pencils for students, if needed Watch or Clock to keep accurate time during testing 60 Test Administrator Responsibilities Before testing: Assemble Materials (cont’d) Calculators as they apply to the test you are administering. Remember for FSA aligned assessments approved hand held scientific calculators can only be provided in session 2. Reference sheets or periodic tables as they apply to the test you are giving Test Materials will be distributed on the day of testing 61 Test Administrator Responsibilities Before testing: ● ● ● ● ● ● Assemble materials needed for testing Receive appropriate test materials needed (Day of the test) Receive and prepare additional materials (Day of the test) Receive test group codes (PBT) Receive Authorization or Test Tickets (Day of the test) Prepare Seating Chart 62 Before Computer Based Testing Before Testing Ensure that your School Testing Coordinator has provided you with Work Folders/Worksheets, and Student Authorization or Test Tickets to provide to the students. Remind students how to submit and or pause tests. When you arrive on the day of testing, open each student workstation in the testing room to the student login screen as indicated in the script, but do not log in for students. Ensure that you have a way to contact the technology coordinator or the school assessment coordinator without leaving the room unattended. 63 63 Before FSA Computer Based Testing If you are administering a computer based FSA test: Create, Start, and Monitor the Test session by going to the fsassessments.org and clicking the Test Administrator and then Test Administration Icons. Login using your username and password Start the session Record the Session ID on Security Checklist 64 Before FSA Computer Based Testing If you are administering a computer based test (cont’d): Students will use their ticket information with the session ID to log in. Approve students as they log in Monitor the session in the TA interface (do not log out) and close when students complete. If students leave for a short break cover their computer monitor For a longer break, have the student pause their test. If they do not do it on their own you must pause it for them from within the Test Administrator Interface 65 15 minute Rule During Computer Based Testing If you are administering a computer based test (cont’d): If a student’s computer is disconnected from the test, contact the technology coordinator to help diagnose any technical issues or resume the student’s test in TA Interface. Then assist the student with logging in again. Once a student logs back in to his or her test, you will need to approve the student again in TA Interface. If a student still has difficulty logging in or gets kicked out of his or her test more than once (taking longer than 15 minutes), the student should not continue to attempt to log in until the issue is diagnosed and resolved. Additional troubleshooting information is available at fsassessments.org or Pearsonaccess.com/fl 66 Test Administrator Responsibilities During testing DO: ● ● ● ● ● ● Use #2 pencils ONLY Have students clear their desk of all scratch paper, books, notes. Students should not be in possession of any electronic devices. Distribute the correct test materials (calculators, ref sheets, worksheets/folder etc) per the test being given. Distribute test and answer books, pre-identified & blank Read appropriate scripts VERBATIM Make sure students: ● ● ● have read and signed the Testing Rules Acknowledgment are working in the correct session/area of the test are working independently and are not talking or disturbing other students 67 Test Administrator Responsibilities During testing DO: ● ● ● ● ● ● Keep time accurately per the Test Administration Manual Complete the Test Administration Security Log, Required Administration Information and Seating Chart Maintain test security during testing. Walk around the room and actively monitor the students while they are testing. Encourage the class to continue working, however, you may not talk with them about test items or help them with their answers. It is appropriate to address the entire class when doing this. Encourage the class to go back and check their work, if they finish early. It is appropriate to address the entire class when doing this. Ensure students are working in the correct test session 68 Test Administrator Responsibilities During testing DO NOT: ● ● ● ● ● ● ● ● Talk with students about test items. Help students with their answers. Use non-verbal queues in any way. Check through test books. Discuss test items or answers with students even after all test materials have been returned and testing has been completed. Talk on your cell phone, grade papers, work on the computer etc. You must be actively supervising the test administration. Return test materials to students once they have finished and submitted their assessment to you. Allow students to go into session 2 before it starts. DO NOT approve a student to work in a incorrect session. 69 During Computer Based Testing During CBT Testing, in addition to what is required for Paper based testing, you must: Ensure that no student is looking at another student’s computer monitor Note the accommodations provided and used on the Administration Record and Security Checklist or Session Roster If a student logs out (NGSSS) or pauses (FSA) out for any reason (lunch, break, etc...) a staff member must resume (NGSSS) or approve (FSA). Then the student may resume testing. 70 70 Warning DO NOT approve for the wrong FSA test session • All Test Administrators will need to approve students to access the test once they log in via the Student Test Interface. • Test Administrators should be very careful to only approve students that are logging in at the beginning of a session or need back in because of a break. • Accidentally approving a student who has completed session 1, will provide them with access to the 2nd session 71 71 New Feature - Session Exit Approval • If students requests to move on to Session 2, TAs will approve the Session Exit request for students who are ready to continue. If the student is not supposed to move on (most likely), the TA will DENY the student’s Session Exit request. This new functionality allows the student to immediately sign back in to Session 1 without a test segment re-open request. If a student is denied permission to exit Session 1, they will be logged out and can sign back into Session 1 on the same day. This is reflected in a script addition that should be provided from your School Testing Coordinator. 72 72 Test Administrator Responsibilities After Testing ● ● ● ● ● Collect all test and answer books from the students For CBT collect Math work folders, CBT Worksheets, Session Rosters and Student Authorization or Test Tickets Notify School Test Coordinator of any missing materials Check DNS and UNDO bubbles, Pre-id info, student signature, Complete the: Security Log Seating Chart Administration Record/Security Checklists Comment Form for the test you are giving 73 After Computer Based Testing After Testing● Collect and return: 1. Test Administration Security Log 2. Completed Administration Record/Security Checklist or session roster and FCAT/FSA Seating Chart 3. CBT Worksheets, Paper Reference Sheets, Math work folders, Session Rosters and Student Authorization or Test Tickets 74 74 Test Administrator Material Return Stack materials: 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. Absent students’ materials Students’ TO BE SCORED materials Home Education, McKay, FTC Scholarship, and District then Florida K-8 Virtual School TO BE SCORED NOT TO BE SCORED materials Test Administration Manual/Manuals Test Administration Security Log Administration Record/Security Checklist/Session Roster FCAT Reference Sheets Calculators FCAT Seating Chart Return the above items to your School Test Coordinator soon after testing is over each day. Test Administrators must not keep any secure test materials in their classroom. 75 School Coordinator Responsibilities 76 School Coordinator Responsibilities Before testing: ● ● ● ● ● Carefully read the Spring FSA CBT Manual, the Test Administrator User Guide, and the TIDE User Guide (all located in the FSA Portal), as well as any local directions you have been given. Resolve any questions you might have with Student Assessment and Research Carefully read NGSSS EOC manual as it pertains to your school’s test administrations. Read the Test Administrator Policies and Procedures and Appendix C of the Test Administration Manual then sign the Test Administration and Security Agreement (located in Appendix D or the back of any of the manuals). Train your test administrators and proctors and ensure that they, as well as school administrators and technology coordinators, sign a Test Administrator and Security Agreement. Ensure that test administrators sign a Test Administrator Prohibited Activities Agreement (located in Appendix D of any FSA or NGSSS or EOC Manual). 77 School Coordinator Responsibilities Before testing: FOR FSA: ● ● ● ● Your students need to be verified and matched to what is in TIDE: Any student not in TIDE (PBT or CBT) will not receive a score until late reporting closes. View the TIDE Online training module. Or Managing students in TIDE presentation for specific information. Additionally, matching TIDE to your student population will provide you the following advantages: ● ● ● The ability to sort, filter and view student information The ability to export student lists for use in creating test documentation The ability to print test tickets and labels for all students. FOR EOC and RETAKES: Refer to page 106-129 of the CBT End of Course and Retakes Test Administration Manual for how to manage sessions in Pearson Access 78 School Coordinator Responsibilities Before testing: ● ● ● ● ● ● ● Receive and inventory test materials. Use the enclosed Packing Lists to inventory your materials soon after they arrive to your school. Keep test materials secure at all times in locked storage with limited access (no more than 3 people). Use Chain of Custody form to keep track of test materials every time they are in and out of locked storage and to list authorized school personnel who come in contact with the test materials. Track security numbers. Do not open shrink-wrapped materials or begin preparing (applying student labels) more than one week prior to testing. Save the original boxes for returning special document materials. If you need additional materials email assessment.materials@browardschools.com. Inventory your materials early – Order additional test materials needed early. 79 School Coordinator Responsibilities Before CBT For computer based tests: ● ● ● FOR CBT ALL TESTS● Ensure the secure browser (FSA) or TestNav 8 (NGSSS tests) have been installed on the computers to be used for testing. ● Print Test or Authorization Tickets ● Make sure students have taken the Epat (NGSSS) or Training Test (FSA) that corresponds to their assessment(s) FOR FSA● Assign and communicate accounts in FSA and how to create, manage and stop a CBT session. ● Warn Test Administrators to not approve sessions on the wrong day for FSA. ● Ensure Test Administrators know how to monitor the session in the TA interface (do not log out), approve students correctly and close when students complete. FOR NGSSS assessments● Manage Sesssion Pearson Access 80 School Coordinator Responsibilities Before testing: Train Test Administrators and Proctors Distribute Test Administration Manuals and instruct Test Administrators to read all appropriate sections. Make sure Test Administrators know what test will be administered each day and what script to read from the manual on each day of testing. Make sure Test Administrators receive and provide Worksheets and Workfolders per the test subject they will be taking. Ensure all Test Administrators maintain the following according to the requirements in the manual: Records of Required Administration Information & or Session Rosters Seating Charts Security Logs (The Test Administrator’s name must be the first name on the Security Log) Review test security policy and procedures and collect the following: Signed Test Security Agreements Signed Test Administrator Prohibited Activities Agreement (with certification numbers) 81 School Coordinator Responsibilities Before testing: ● ● ● ● ● Make arrangements for accommodations Ensure Test Administrators are aware of which option will be used to collect materials Provide appropriate test settings ● Ensure visual aids are covered or removed ● There must be at least 3 feet between students ● Test in classrooms whenever possible Ensure Test Administrators have the correct materials for the subject and grade they are administering (reference sheets, calculators, etc) Distribute Test Group Codes (PBT NGSSS only) 82 School Coordinator Responsibilities Before testing: ● Assign Proctors to test sessions ● Proctors are required for rooms where 30 or more students are tested or for CBT for rooms where 25 or more students are tested ● It is strongly encouraged to assign proctors to rooms where fewer than 30 (25 for CBT) students are tested ● Make arrangements to test special program students not enrolled in your school, if any ● On test day distribute all materials necessary for 83 testing. School Coordinator Responsibilities During Testing: ● ● ● ● Provide test administrators with additional materials during testing, as necessary. Monitor each testing room to ensure that test administration and test security policies and procedures are being followed. Be available during testing to answer questions from test administrators. Make sure that Security Logs, Seating Charts, and Administration Records/Security Checklists are being maintained in each testing room. 84 School Coordinator Responsibilities Maintain Security ● ● ● ● ● After ANY administration, initial OR make-up, materials must be returned to you immediately. Materials must be placed in locked storage between test sessions and noted on the Chain of Custody. Secure materials should never remain in classrooms or be taken from the school’s campus overnight. Report any testing irregularities or test security breaches to the Student Assessment & Research Department immediately. Use the Chain of Custody form to record all contact with test materials 85 School Coordinator Responsibilities After Testing •Verify Test Administrators have returned all test materials to you. •Notify Student Assessment and Research of any missing materials •Photocopy and file for your records: • Administration Record/Security Checklists and/or Session Rosters • Seating Charts • Test Administration Security Logs • Chain of Custody Form The original documents of the forms listed above are to be returned in District Coordinator Only Box. •Keep Student Authorization or Test Tickets until scores are reported (CBT) •Used Planning Sheets, Work Folders, and CBT Worksheets come back with the DCO box 86 •Complete Comment Forms Materials Return 87 School Coordinator Material Return FSA or FCAT = Different Return Instructions For FSA read and follow the instructions in the email regarding FSA Paper Based Materials Return For NGSSS EOC read and follow the instructions in the email regarding NGSSS Paper based materials 88 School Assessment Coordinator FSA Material Return Overview of Materials Return Process The descriptions and steps below and on the following slides provide a general overview of the materials return process. Detailed instructions are included in the 2014– FSA Paper-Based Materials Return Instructions. School assessment coordinators will complete the following steps before returning materials to district assessment coordinators: 1. Receive all secure materials from test administrators. 2. Ensure all test and answer books have the appropriate labels applied: PreID Labels should be used on TO BE SCORED test materials whenever possible. On-Demand PreID Labels may be printed for any students for whom PreID Labels were not included in the shipment of test materials (e.g., students who enrolled after the PreID upload.) 89 School Assessment Coordinator FSA Material Return Overview of Materials Return Process (cont.) District/School Labels should be used on TO BE SCORED test materials if PreID Labels are not available and cannot be printed. Student demographic information must also be gridded on documents with District/School Labels applied, and student information must be entered in TIDE. Separate TO BE SCORED and NOT TO BE SCORED materials. 3. 90 School Assessment Coordinator FSA Material Return Overview of Materials Return Process (cont.) 4. Place all TO BE SCORED materials in the plastic return bags included in your test materials. Separate TO BE SCORED regular print materials from TO BE SCORED special documents (large print, braille, one-item-perpage). It is not necessary to separate materials by grade level, subject, special program, etc.; however, if your district assessment coordinator provides instructions for sorting materials, please follow those directions. Document Count Forms are NOT provided, and therefore are not required for processing FSA TO BE SCORED materials. 91 School Assessment Coordinator FSA Material Return Overview of Materials Return Process (cont.) 5. Place filled return bags in boxes, and apply the appropriate TO BE SCORED return labels to the boxes. Note: You will receive zip ties with your shipment of test materials. Use the zip ties to close the return bags prior to placing them in boxes. 92 School Assessment Coordinator FSA Material Return Overview of Materials Return Process (cont.) 6. 7. 8. Package all NOT TO BE SCORED materials, including NOT TO BE SCORED special documents, passage booklets, in boxes. Apply yellow NOT TO BE SCORED return labels. Return all boxes to your on Monday July, 27th, 2015. Ensure that materials are packaged in your District Assessment Coordinator ONLY Box according to the instructions on page 14 of the Materials Return Instructions. Follow your district assessment coordinator’s instructions for including any other materials and for securely storing or returning this box. 93 Package FSA Materials for Return Place TO BE SCORED FSA materials in the boxes according to the manual Refer to the Material Return Instructions Documents for FSA material return Place the appropriate color To-Be-Scored return label on the top of each box: All FSA EOC Large Print Braille Purple Label White Label Pink Label Labels may be placed over any existing shipping labels (e.g., vendor or carrier labels). Do not copy labels. Email Assessment Materials (assessment.materials@browardschools.com) to order additional return labels or if you need more test materials. 94 Package NGSSS FCAT/EOC Materials for Return Place TO BE SCORED EOC or RETAKEs in the boxes according to pages 152–153 of the Spring CBT Manual for guidance. You may place materials for more than one grade level in the same a box. Place the appropriate color To-Be-Scored return label on the top of each box: EOC Civics/Bio/History Large Print Braille Brown Label White Label Pink Label Labels may be placed over any existing shipping labels (e.g., vendor or carrier labels) on the boxes. Do not copy labels. Email Assessment Materials (assessment.materials@browardschools.com) to order additional return labels or if you need more test materials. 95 FSA EOC To-Be-Scored Materials Drop Off: • • • FSA aligned Algebra 1, Algebra 2 and Geometry EOC (Purple Label) Braille (Pink label) Large Print (White label) All schools must hand deliver on Monday, July 27th, 2015 Please deliver to: Student Assessment, 4200 NW 10th Ave, Oakland Park, FL 33309 96 NGSSS EOC (ALG/BIO/CIV/USH) To-Be-Scored Materials Drop Off: • • • NGSSS Aligned Civics, Biology or US History (Brown Label) Braille (Pink label) Large Print (White label) All schools must hand deliver on Monday, July 27th, 2015 Please deliver to: Student Assessment, 4200 NW 10th Ave, Oakland Park, FL 33309 97 Not-To-Be-Scored materials drop off for the following: • NGSSS ALG Retakes & EOCs and FSA Aligned EOC – July 27th, 2015 • • Not-To-Be-Scored documents include: unused test books, unused non-preidentified and pre-identified documents,, defective documents, unused large print, unused Braille. District Coordinator Only Box • • All test documentation Used and unused Work Folders and Work Sheets 98 Contact Information Student Assessment and Research Phone – 754-321-4250 or 754-321-2500 Email for additional materials – assessment.materials@browardschools.com Karl Yeats or Adrienne C. Reynolds, Testing Specialists available at: karl.yeats@browardschools.com adrienne.c.reynolds@browardschools.com