Spring 2013 FCAT 2.0 Writing Training Materials Overview • These training materials are based on the 2012-2013 Writing Test Administration Manual. – These training materials are designed to highlight important information regarding test administration policies and procedures. – Note: Not all information from the test administration manual is included in this presentation, so it is imperative that school staff read and familiarize themselves with all information in the manual. 2 Daily Administration Schedule* Day 1 – Tuesday, February 26 Grades 4, 8, 10 Writing Test 60 minutes Day 2 – Wednesday, February 27 Grades 4, 8, 10 Writing Make-Up Test 60 minutes *The 2013 FCAT 2.0 Writing extended testing window for the Visually Impaired (VI) and Hospital/Homebound Program students is February 26 – March 4, 2013. Any deviation from this schedule requires written approval from the FLDOE prior to implementation. TAM 2 3 What’s New TEST MATERIALS CHAIN OF CUSTODY FORM • Schools are required to maintain a Test Materials Chain of Custody Form, posted at www.FLAssessments.com/Writing and located in Appendix C. • Schools must retain hard copies of completed forms and return the originals in the District Assessment Coordinator Only Box. TAM 47; 103 4 What’s New NON-CERTIFIED SCHOOL PERSONNEL DISTRICTLEVEL CERTIFICATION FORM • Non-certified school personnel designated by the school administrator to assist the school test coordinator in handling secure materials for statewide assessments must be granted approval by the FLDOE. – Submit completed form to SAET for approval by February 19, 2013. – The approval will be valid for one school year. 5 What’s New TESTING RULES ACKNOWLEDGMENT • Prior to testing, students must listen to the testing rules read by the test administrator and then sign below a Testing Rules Acknowledgment. • The Testing Rules Acknowledgment is located on the back page of the student planning sheet. TAM 25 6 Students to be Tested • In general, all Florida public school students enrolled in the tested grade levels (Grades 4, 8, and 10), including retained students, are required to participate in FCAT 2.0 Writing, per s. 1008.22(3)(c)8, F.S. TAM 2 7 Students to be Tested Special Program Students Program District Number School Number Full-Time K-8 71 0300 Full-Time 9-12 71 0400 FL Virtual Academy 50 7079 Miami-Dade Online Academy 13 7001 MUST Florida Home Education 13 9998 MAY McKay Scholarship 13 3518 Private-MAY Public-MUST Florida Tax Credit Scholarship 97 9999 MAY Merrick Hospital/Homebound* 13 9732 MUST FLVS Participation Registration/ Status Reports MUST Florida Virtual School Program Miami-Dade Online Academy Home Education Office ESE Office Registration - Region Reports - FLDOE Merrick HHIP 8 *District program not in the Test Administration Manuals. TAM 2-3; 6 and Training Packet 9-21 Students to be Tested STUDENTS WITH DISABILITIES • All students with disabilities participate in the statewide assessment program by taking one of the following: – FCAT 2.0 without accommodations, – FCAT 2.0 with accommodations, or – Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. – See Appendix A of the manual for information regarding accommodations. TAM 4; 8; 76-91 9 Students to be Tested ENGLISH LANGUAGE LEARNERS (ELLs) • Per the Department’s Office of Student Achievement through Language Acquisition, all ELLs are expected to participate in FCAT 2.0 Writing. – See Appendix A of the manual for information regarding accommodations. TAM 3-4; 8; 75 10 Administration Accommodations STUDENTS WITH DISABILITIES • Accommodations stated in the student’s current IEP or 504 plan − Flexible Presentation − Flexible Responding − Flexible Scheduling − Flexible Setting − Assistive Devices and Tools • Emergency 504 Plan − Contact Staff Specialist in Region TAM 69-74 11 Special Documents • Special documents (large print and Braille) are available for the Spring FCAT 2.0 Writing Test. • Appropriate personnel must familiarize themselves with the information Appendix A, including: – Test configurations and materials needed for testing – Special scripts/instructions for students who test using special documents – Student responses – Providing accommodations – Preparing special documents for return TAM 76-87 12 Administration Accommodations ENGLISH LANGUAGE LEARNERS (ELLs) • Students who are currently receiving services in a program operated in accordance with an approved district LEP plan: − Flexible Setting − Flexible Scheduling Additional Time − Assistance in Heritage Language − Approved Dictionary • ELL students in levels 1-4 only TAM 75 13 Test Materials • School personnel must adhere to the following policies as they prepare student materials: – The Chain of Custody Form must be maintained at all times. – Shrink-wrapped packages of secure materials may be opened no sooner than three (3) days prior to the FCAT 2.0 Writing. – Only the school assessment coordinator and school personnel designated by the building/site administrator may open the shrinkwrapped packages and affix labels. Non-certified personnel assisting the school assessment coordinator in handling secure materials must have approval from the FLDOE. – Students are not permitted to assist in preparing secure materials before testing or in organizing and returning materials after testing. – All secure materials must be returned to locked storage and remain there until testing. 14 TAM 9 and Training Packet 7 Test Materials • Writing Folders – Grade 4 – Grade 8 – Grade 10 • Planning Sheets 15 TAM 23 PreID Labels • The Writing PreID file is based on students enrolled at your school as of November 30, 2012. • The PreID roster should be verified against the school’s student information database. • FIVE elements MUST be correct on a student PreID label: – Student name – Florida ID number – District number – School number – Grade level Destroy labels in a secure manner if ANY of this information is incorrect. • If any other preidentified information (e.g., date of birth) is incorrect, use the label. • Do not use PreID labels from previous administrations. 16 TAM 9 PreID Labels • Affix the label in the box in the lower left corner of the student grid sheet. • Do not remove labels once they have been affixed. • Do not place a label over another label. TAM 10 17 PreID Labels • If the student name, Florida ID number, district number, school number, or grade level is INCORRECT on a USED Writing folder, the student must, under the supervision of the test administrator, transfer his or her exact response into a replacement folder. • The student grid sheet of the replacement folder MUST be gridded. • Grid the DNS bubble on the folder with the incorrect label affixed and set it aside to be returned with all other NOT TO BE SCORED materials. TAM 10 18 Student Grid Sheet • • TAM 11 The box in the upper left corner of the student grid sheet must be completed by each student. Do not write or mark outside the student demographic information boxes. It will adversely affect the scanning of the folders. 19 Security Numbers WRITING FOLDERS • Writing folders include security numbers to assist in the tracking of these secure documents. • School assessment coordinators and test administrators must maintain records of required administration information that include the security numbers of Writing folders assigned to them. • A security number consists of a nine-digit number followed by a check digit (located in upper right corner of Writing folders). 20 TAM 11 Administration Record/ Security Checklist Pre-populated lists with security numbers for all secure folders assigned to each school are available for schools at www.pearsonaccess.com/fl − Go to Test Setup > Order Additional Materials and Tracking > Reports, and select Security Checklist Detail from the drop-down list. TAM 14; 111 21 Proctors • • • • School Personnel may − Prepare, distribute, and collect materials under direct supervision of the test administrator − Complete student grid sheets Non-school Personnel may − Assist in monitoring test administration only − Only be used as an “extra” pair of eyes M-DCPS students may NOT serve as proctors. It is strongly recommended that a proctor be assigned to rooms with 22 30 or fewer students whenever possible. TAM 13 Test Administration and Security Procedures STATE AND DISTRICT REQUIREMENTS • Standards, Guidelines, and Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/Test ChairInfo/InfoForTestChair.asp. – Adopted by School Board – General Guidelines • Florida Test Security Statute and Rule • School Procedural Checklist (FM-6927) TAM 93-96 and Training Packet 24-30 23 Prohibited Activities • Reading the passages, test items, or performance tasks. • Revealing the passages, test items, or performance tasks. • Copying the passages, test items, or performance tasks. • Explaining or reading test items or passages for students. • Changing or otherwise interfering with student responses to test items. • Causing achievement of schools to be inaccurately measured or reported. • Copying or reading student responses. TAM 99; 101 24 Electronic Devices • Possession of any electronic device that reproduces, transmits, calculates, or records IS prohibited and a cause for invalidation. − “Possession” is defined as “within arm’s reach,” even if the electronic device is not visible. − Students should not have cell phones in their pockets, clipped to their belts, at their desks, or anywhere they can be easily accessed during testing or breaks. • Test administrators and proctors should also turn-off their electronic devices during testing. TAM iv; 17; 24; 119 25 Reporting Testing Irregularities • All school staff are professionally responsible for ensuring appropriate administration procedures and reporting any irregularities. – Specified in Standards, Guidelines, and Procedures for Test Administration and Test Security School Assessment Coordinator/Principal Student Assessment and Educational Testing Region Center and/or appropriate District Administrative Office Appropriate investigative unit, if applicable • Note: School personnel must be prepared to provide documentation and information in support of investigations of any testing irregularity. 26 TAM 15-16 Caveon Forensic Analyses • Caveon will analyze data to identify highly unusual test results for two primary groups: – Students with extremely similar test responses; and – Schools with improbable levels of similarity, gains and/or erasures. • Flagging only the most extreme results www. 27 Test Administrator Responsibilities Before, During, and After Testing TAM 20-44; 113 28 Test Administrator before testing • Sign and return an FCAT 2.0 Test Administration and Security Agreement, which indicates that the test administrator: – Has received training – Has read the test security statute and state board rule (located in Appendix B) – Understands and agrees to adhere to all test security and administration policies and procedures • Sign and return a Test Administrator Prohibited Activities Agreement TAM 20; 99; 111 29 Test Administrator before testing COMMUNICATE TESTING POLICIES TO PARENTS/GUARDIANS AND STUDENTS • Electronic Devices Policy—If students are found with ANY electronic devices during testing OR during breaks, their tests will be invalidated. • Leaving Campus—If students leave campus before completing the test (for an appointment, illness, etc.), they WILL NOT be allowed to complete the test. • Testing Rules Acknowledgment—Students will sign below a Testing Rules Acknowledgment on the back of the planning sheet. TAM 24 30 Test Administrator before testing TESTING LOCATION • The test should be administered in a room that has comfortable seating, good lighting, and sufficient workspace. • There must be at least three feet between students. • Make sure that students are not facing each other when seated at tables and are not in seating (stadium or staggered) that allows them to easily view other students’ test materials. • Students must not have access to any unauthorized aids, including visual aids on classroom walls or desktops (e.g., word lists, punctuation charts). 31 TAM 20 Test Administrator before testing REQUIRED ADMINISTRATION INFORMATION • Test Administrators must record and maintain the following Required Administration Information: – – – – – – – – Students assigned to the room Attendance information Test group code Unique security number of secure documents assigned to each student Grade level Signatures of test administrator and school assessment coordinator Dates for when documents are received and returned 32 TAM 20 Accommodations provided Test Administrator before testing SEATING CHARTS • An accurate seating chart must be maintained for each testing room for each test session. Seating charts must record the following information: – – – – – – – the room name/number student names and their location in the room during testing date test start time test administrator name names of proctors (if applicable) test group code • All seating charts must indicate the front and back of the room, as well as the direction the students are facing. • If the seating configuration changes during testing, a new seating 33 chart must be created. TAM 21 Test Administrator before testing • A Security Log must be maintained for each testing room. TAM 22; 105 • Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room. 34 Test Administrator before testing ASSEMBLE MATERIALS • • • • • • • • • Test Administration Manual Test Group Codes Test Administrator Checklist (located in Appendix C) Signs (located in Appendix C) − Do Not Disturb (posted on entrances to the testing room) − Electronic Devices (displayed for students) Security Log (located in Appendix C) Seating Chart Record of Required Administration Information Pencils for students, if needed Watch or Clock to keep accurate time during testing TAM 21-23 35 Test Administrator during testing • Maintain your Security Log, seating chart, and a record of required administration information for your room during testing. • Read the administration script VERBATIM to students. Please read the important information and adhere to the instructions between the SAY boxes. • FCAT 2.0 Writing is administered in one 60-minute session – failure to provide the correct amount of time will likely result in test invalidation. – Keep accurate time and display times for students as instructed in the script. TAM 25-26 36 Test Administrator during testing • Supervise test administration and ensure the following: – Students are using No. 2 pencils – Students do not have books, notes, scratch paper, or electronic devices of any kind during testing, even if they do not use them – Students have signed the Testing Rules Acknowledgment – Students do not talk or make any disturbance – Students are working independently – Students who use their planning sheets allow themselves enough time to write complete responses in their writing folders – Students are recording their responses in the appropriate area TAM 26 37 Test Administrator during testing • It is not appropriate to use cell or classroom phones, grade papers, or work on the computer during testing. • While you may encourage students to continue working, you may not talk with them about the prompt or help them with their responses. • If students finish the test before the allotted time for the session has elapsed, you may encourage them to go back and check their work. – You may NOT collect test materials prior to the end of the 60-minute session. TAM 26 38 Test Administrator after testing • Make sure that each student returns his or her Writing folder and planning sheet, and indicate on your record of required administration information that each folder is returned. – You may not look through writing folders or read student responses. • Report any missing test materials and/or test security irregularities to your school assessment coordinator immediately. • Ensure that the box in the top left corner of the student grid sheet has been completed by each student and that the gridded or preidentified information is accurate and complete. • Return all materials to your school assessment coordinator, as described on pages 43-44 of the manual. TAM 43-44 39 School Assessment Coordinator Responsibilities Before, During, and After Testing TAM 45-68; 115 40 School Coordinator before testing RECEIVE MATERIALS/MAINTAIN SECURITY • • • • Box contents are listed on pages 45-46 of the manual. Keep materials secure at all times. Maintain an accurate Test Materials Chain of Custody Form. No more than three individuals may have access to the locked storage area. • Do not open shrink-wrapped materials or begin preparing materials (e.g., apply student labels) more than three days prior to testing. • Save the original boxes for returning special document materials. • If you need additional materials, contact the Test Distribution Center at 305-995-3743. 41 TAM 45-46 and Training Packet 7 School Coordinator before testing TRAIN TEST ADMINISTRATORS AND PROCTORS • Train all test administrators and proctors, including non-schoolbased instructors (e.g., itinerant teachers). – You must train several employees to act as possible alternates. • Test Administrators must be certified educators. • Test administrators must NOT administer the FCAT 2.0 to their family members. – Students related to their assigned test administrator should be reassigned to an alternate test administrator. • Under no circumstances may a student’s parent/guardian be present in that student’s testing room. • Test administrators who will be administering the test to students using large print or Braille materials must be trained in the use of these test materials. – Make sure that test administrators are aware of and have made 42 provisions for the exact accommodations needed for individual students.TAM 47-48 School Coordinator before testing TRAIN TEST ADMINISTRATORS AND PROCTORS • Distribute Test Administration Manuals and instruct administrators to read all appropriate sections. • Ensure that all test administrators maintain the following according to the requirements in the manual: − Records of Required Administration Information − Seating Charts − Security Logs • Review test security policy and procedures and collect the following: − Signed FCAT 2.0 Test Administration and Security Agreements − Signed Test Administrator Prohibited Activities Agreements • Keep copies of all signed agreements, including your signed agreement for one calendar school year • Encourage test administrators to use the checklist found in Appendix C 43 TAM 47-48 School Coordinator before testing TEST GROUP CODE • A test group code is a security measure to identify groups of students tested together. − Generate a four-digit numeric code to assign to each testing room. • Writing folders do not contain a field for a test group code; however, test group codes must still be used to identify groups of students tested together. – Test group codes must be recorded with required administration information and on seating charts. TAM 46 44 School Coordinator before testing PREPARE FOR TESTING • Distribute Test Group Codes to Test Administrators • Assign Proctors to test sessions − Proctors are required for rooms where 31 or more students are tested − It is recommended that proctors be assigned to rooms where fewer than 31 students are tested • Provide appropriate test settings − Test in classrooms only, whenever possible • Make arrangements to test special program students not enrolled in your school, if any • Review spreadsheet with student demographic information for accuracy TAM 46; 48 45 School Coordinator during testing SUPERVISE TEST ADMINISTRATION • Provide test administrators with additional materials during testing, as necessary. • Monitor each testing room to ensure that test administration and test security policies and procedures are followed. • Be available during testing to answer questions from test administrators. • Make sure that security logs, seating charts, and records of required administration information are being maintained in each testing room. 46 TAM 49 School Coordinator during testing MAINTAIN SECURITY • After ANY administration, initial OR make-up, materials must be returned to you immediately. • Materials must be placed in locked storage until they are packaged for return. • Secure materials should never remain in classrooms or be taken from the school’s campus overnight. • Report any testing irregularities or security breaches to SAET immediately at 305-995-7520. TAM 49 47 School Coordinator after testing TEST INVALIDATION • A test MUST be invalidated if either of the following circumstances occurs: – A student has an electronic device during testing. – A student is cheating during testing. • A test MAY be invalidated if one of the following circumstances occurs: – – – – – – A student becomes ill and is unable to finish. A student is not allowed the correct amount of time. An error occurs in the administration of an accommodation. An error occurs in test administration or procedures. A student is disruptive during testing. A student works in the wrong session. TAM 17-19 48 School Coordinator after testing • Verify that all distributed secure materials have been returned. Notify your SAET immediately if any secure materials are missing and complete the necessary investigation. • Check for and remove any stray planning sheets from the Writing folders. • Make copies of the records of required administration information collected by test administrators and file the copies. • Make copies of all security logs and seating charts and file the copies. • Ensure that the DNS bubble has been gridded on invalidated tests and place the tests with TO BE SCORED materials. • Verify that the DNS bubble has been gridded on any defective folders and return defective materials with NOT TO BE SCORED materials. TAM 50-52 49 School Coordinator after testing DOCUMENT COUNT FORMS • Do not copy blank count forms; however, once the count forms are completed, you may copy them for your records. – If you need additional count forms, contact the Test Distribution Center at 305-995-3743. • Place each completed form on top of the first stack of corresponding TO BE SCORED answer documents. • Separate Document Count Forms must be completed for any special program student documents (Home Ed, Virtual School, etc.). TAM 51-52 50 Ensure that the correct district and school numbers are gridded (refer to the chart on page 6 for special program district/school numbers). Grid the correct grade level/document type, number of documents under the form, and special document type, if applicable. TAM 54 51 School Coordinator after testing PAPER BANDS • Documents for each grade level and special program must be banded separately. – You may use more than one paper band per grade level, if necessary. • Under Number of Banded Stacks per Document Count Form, number the paper bands 1 of n, 2 of n, etc., where n is the total number of banded stacks per Document Count Form. • Place a paper band around each stack of TO BE SCORED writing folders. – The Document Count Form must be under the paper band on top of the stack labeled 1 of n. • Seal the paper band and be sure that it securely holds the 52 documents. Do not use staples, paper clips, or tape. TAM 55 School Coordinator after testing • Prepare the following types of boxes for return: – All “TO BE SCORED” Writing folders—Red-labeled boxes – All “TO BE SCORED” large print materials, if applicable— White-labeled boxes – All “TO BE SCORED” Braille materials, if applicable—Pinklabeled boxes – All “NOT TO BE SCORED” materials (including “NOT TO BE SCORED” special documents)—Yellow-labeled boxes – District Assessment Coordinator ONLY box • It is your responsibility to package all materials correctly. Mispackaged materials will delay reporting of student 53 TAM 55-56 results. School Coordinator after testing • PACKAGING DIAGRAM Miami Dade Online Academy (13/7001) Merrick Hospital/ Homebound (13/9732) Note: Place invalidated documents marked DNS below the Document Count Form and include in count. TAM 57 54 School Coordinator after testing DISTRICT ASSESSMENT COORDINATOR ONLY BOX • All Planning Sheets (used and unused). • Original Administration Record/Security Checklist or school’s developed form with all required administration information • Original Security Logs • Original Seating Charts • Original Test Materials Chain of Custody Form • Original Accounting for All Secure Documents • Original School Procedural Checklist (FM-6927) Write District Assessment Coordinator ONLY on the side of the box. Note: Please retain copies of all of the above documents for your records for one calendar school year. TAM 58 55 Return Schedule: FCAT 2.0 Writing ALL WRITING MATERIALS • RED - “TO BE SCORED” GRADES 4, 8, AND 10 • WHITE – “TO BE SCORED” large print materials, if applicable • PINK - “TO BE SCORED” Braille materials, if applicable • YELLOW – All “NOT TO BE SCORED” materials (including NOT TO BE SCORED special documents) • DISTRICT ASSESSMENT COORDINATOR ONLY BOX RETURN DATES Elementary, K-8 Centers, Middle Schools, Senior High Schools and Alternative Centers: March 1 – 5, 2013 Note: Schools must hand-deliver all FCAT 2.0 Writing materials to TDC by 3:30 p.m. 56 TAM 55-58 and Training Packet 2; 33 Comment Forms • After testing, test administrators and school assessment coordinators are encouraged to complete a Writing comment form located at www.FLAssessments.com/Writing • FLDOE and Pearson appreciate valuable feedback from school personnel. TAM 59 57 Reminders • Inappropriate actions before, during, or after test administration may result in consequences such as test invalidations and/or loss of teaching certification. • All personnel involved in test administration must read and sign an FCAT 2.0 Administration and Security Agreement, provided in Appendix C. • ALL test administrators must be certified educators. • In addition to signing a security agreement, test administrators are required to sign a Test Administrator Prohibited Activities Agreement. TAM v 58 PearsonAccess Resources • The following materials may be found on the PearsonAccess website under the Support tab: – Test administration manual – Forms to report missing materials and test irregularities/security breaches – Training materials – Comment forms – Blank Administration Record/Security Checklist – Security Log – Materials Return List – Braille Script 59 Contact Information Student Assessment and Educational Testing Maria C. Bruguera, Director Email: mbruguera@dadeschools.net or Mara Ugando, Staff Specialist Email: mugando@dadeschools.net Phone: 305-995-7520 Fax: 305-995-7522 60 Thank you for ensuring a secure and successful FCAT 2.0 Writing administration. Questions? 61