PARCC Pilot: SAL Training Overview of PARCC Assessments Why CMAS PARCC? • Common Core State Standards (CCSS) and the Colorado Academic Standards (CAS) • The expectations of what students need to know. • Measures critical skills and knowledge our students need PARCC Consortia Overview of PARCC Assessments • PARCC replaces TCAP in spring 2015 • English Language Arts: – Grades 3-11 • Math: – Grades 3-11 – Algebra 1, Geometry, Algebra II • Will provide evidence of college and career readiness based on the assessments in 11th grade Test Structure • Performance-Based Assessment (PBA): – Administered in March – English language arts/Literacy: Writing effectively when analyzing text – Math: Problem solving and application AND • End-of-Year Assessment (EOY): – Administered April/May – Acquired skills and knowledge by answering machine-scorable questions 6 What is a “Standardized” Assessment? • All students have the same test content, resources, directions, testing conditions, and scoring procedures. • A score obtained by one student in one part of Colorado (in the case with PARCC – across the consortia) will mean the same as the same score obtained by another student in a different part of the state and consortia. 7 Timeline and Pilot PARCC Assessments: Timeline • Spring 2014: – March: TCAP reading, writing and math in all schools grades 3-10 – March/May: PARCC pilot (selected schools) for English language arts and/or math • Spring 2015 – March/April: Performance-based o Grades 3 – 11: English language arts o Grades 3 – 11: Math – April/May: End-of-Year o Grades 3 – 11: English language arts o Grades 3 – 11: Math Purpose of the Pilot • Main Purposes: 1) Examine the quality of items so that PARCC can build assessment forms for the 14-15 school year; 2) Pilot assessment administration procedures, including technology readiness; and 3) Give schools and districts the opportunity to experience the administration of PARCC assessments • Purpose is NOT to assess student achievement. Schools will NOT receive student scores. • Take it SERIOUSLY. PARCC Pilot Schools: PBA School Cesar Chavez Denver Green DSST: GVR East Garden Place Noel Community Arts School South University Park West Leadership Grade(s) 6 6 9 10 3 6 Subject ELA Math ELA ELA Math ELA Component PBA PBA & EOY PBA & EOY PBA PBA PBA # of Sessions 3 4 5 3 2 3 11 3 9 ELA ELA ELA PBA PBA PBA 3 3 3 PARCC Pilot Schools: EOY School Bryant Webster Centennial Colfax Elementary Denver Green Denver School of the Arts DSST: GVR Force Gust Highline Hill Campus Johnson Odyssey Park Hill Skinner STRIVE Prep – Westwood Teller Whittier Grade(s) 7 4 4, 5 6 8 9 5 5 7, 8 6 5 7 3 6 8 3 5 Subject ELA ELA Math, ELA Math ELA ELA ELA Math ELA, Math Math Math ELA Math ELA Math Math Math Component EOY EOY EOY PBA & EOY EOY PBA & EOY EOY EOY EOY EOY EOY EOY EOY EOY EOY EOY EOY # of Sessions 2 2 2, 2 4 2 5 2 2 2, 2 2 2 2 2 2 2 2 2 PARCC Pilot Schedule and Key Dates Component 13 Dates Student Data Upload Available Now Complete Infrastructure Trial March 14, 2014 Performance-Based trainings must be completed by March 14, 2014 Performance-Based Assessment (PBA) March 24 to April 11, 2014 Student Data Upload Available Mid-March, 2014 Complete Infrastructure Trial April 25, 2014 End-of-Year trainings must be completed by April 25, 2014 End-of-Year (EOY) May 5 to June 6, 2014 Performance-Based Schedule • March 24 – 28 – – – – East (ELA – 10th grade) 3/26 Noel Community Arts (ELA – 6th grade) South (ELA – 11th grade) West Leadership (ELA – 9th grade) • March 31 – April 4: Spring Break! No Testing! • April 7 – 11 – – – – – 14 Cesar Chavez (ELA – 6th grade) Denver Green (Math – 6th grade) DSST: GVR (ELA – 9th grade) Garden Place (Math – 3rd grade) University Park (ELA – 3rd grade) PearsonAccess (Test Management App) PearsonAccess: Overview • PearsonAccess is the test management system for PARCC pilot. • You can perform the following test-related duties: – Create, View, and Edit Individual User Accounts – Test set-up, including proctor caching (only for charter schools) – Add, delete, and change student data, including requesting accommodations – Viewing and adding test class test assignments – Manage test sessions – Training modules and other resources • ALL SALS required to review the PearsonAccess training modules. PARCC Field Test and Infrastructure Trial training modules are highly recommended. To document training completion, please complete the Google Form after doing so. PearsonAccess www.pearsonaccess.com Select: PARCC 17 Accessing: Practice Items and Tutorials Access Sample Items 18 PARCC Sample Items 19 Accessing Pearson Training Modules Step 1: From PARCC Home Screen, click on “Support” tab Step 2: Click on “Training” Step 3: Click on “Training Modules”. Step 4: It will take you to a different site, where you have to enter your e-mail address. Step 5: Click on “Test Administration” Step 6: Click on “Computer-based Testing Test Administration” OR Go directly to the website and skip steps 14. https://parcc.tms.pearson.com/Account/Lo gin?ReturnUrl=%2f 20 Management System 21 TestNav8 (Test Delivery App) TestNav8: Overview • TestNav 8 is Pearson’s newest test delivery platform for online testing. • It can be run on Macs, PCs, Chromebooks and iPads. • Java requirements (consult with your STR) 24 Accommodations Types of Accessibility Features and Accommodations 26 Accessibility Features for ALL Students Support Description Audio Amplification The student raises or lowers the volume control, as needed, using headphones. Student must be tested in a separate setting if unable to wear headphones Background/Font Color* The student changes the onscreen background and/or font color based on need or preference. Blank Paper (provided by test administrator) The student may be provided with one blank sheet of paper on which to plan or organize item responses. An additional sheet may be offered if the student raises his/her hand during testing. Eliminate Answer Choices The student “crosses out” possible answer choices (for multiple choice items only). Flag Items for Review The student highlights items to review later. General Administration Directions Clarified (by test administrator) The test administrator repeats general administration instructions only. No part of the test may be clarified, nor may any assistance be provided to the student during testing. 27 Accessibility Features for ALL Students: Cont … Support Description General Administrations Read Aloud and Repeated as Needed (by test administrator) The student clicks a button to read aloud or repeat instructions. Student must be tested in separate setting, if unable to wear headphones. General Masking* The student creates a custom “mask” to electronically cover portions of the test items, including passages, as needed Text Highlighter Tool The student highlights text as needed to recall and/or emphasize. Headphones or Noise Buffers The student uses headphones or noise buffers to minimize distractions, access embedded text-to-speech, or filter external noise during testing (in addition to required headphone for use of English Language Arts/Literacy assessment). Line Reader Tool The students use onscreen tool to assist in reading by raising and lowering the tool for each line of text onscreen. Magnification/Enlargement The student enlarges text and graphics onscreen, up to 400% Device (while preserving clarity, contrast, and color). 28 Accessibility Features for ALL Students: Cont … Support Description Pop-Up Glossary The student is able to view definitions of pre-selected, constructirrelevant words by selecting a hyperlink onscreen via a pop-up text box. Redirect Student to the Test (by test administrator) The test administrator redirects the student’s attention to the test without coaching or assisting the student in any way. Writing Tools The student uses writing process tools for written responses, including cut and paste, copy, underline, bold, and insert bullets. 29 Additional Accessibility Considerations for ALL Students: • Small group testing • Frequent breaks (Test session must be completed in one day!) • Time of day • Separate or alternate location • Specified area or seating • Adaptive and specialized equipment or furniture 30 Accommodations • Must be based on an individual need documented in the student’s approved IEP, 504, or English learner plan • A master list of all students and their accommodations must be maintained by the SAL. These will need to be recorded in PearsonAccess. Please include students using text-to-speech. • Accommodations are available for computer-based and paper-based administration. – Paper-based form is itself intended to be an accommodated form Accommodations that Must be Selected during the Test Registration Process for Students with Disabilities Accommodations Content Area and Grades Available Scribing or Speech-to-Text All Content Areas All Grades Word prediction on the English language arts/Literacy PBA PBA Only All Grades Extended Time All Content Areas All Grades External Assistive Technology All Content Areas All Grades Calculation Device and Mathematical Tools (on Non-calculator Sessions of Mathematics Assessments) Mathematics Only Paper and Pencil Edition All Content Areas All Grades 32 Accommodations that Must be Selected during the Test Registration Process for English language learners Accommodations Content Area and Grades Available Extended Time All Content Areas All Grades General Administration Directions Clarified in Student’s Native Language All Content Areas All Grades General Administration Directions Read Aloud and Repeated as Needed in Student’s Native Language All Content Areas All Grades Scribing or Speech-to-Text: Responses Dictated for the Mathematics assessments in English Mathematics Only All Grades Word to Word Dictionary (English/Native Language) All Content Areas All Grades 33 Paper-Pencil vs Computer-Based • Use of paper-based assessments are expected only to be available to students who: – Have a neurological disorder, a condition that causes seizures, or another health condition that prevents the student from accessing the computer – Need a braille form with tactile graphs – Have an IEP or 504 plan that requires assistive technology, such as speech-to-text or 504 plan that may not be compatible with TestNav8 – Will provide oral or written responses in a language other than English or Spanish 34 Modifications = Misadministration • Requiring a student to be assessed on less content matter than other students because he has been taught less material • Reducing the scope of assessments so a student needs to complete only a limited number of problems or items • Modifying the complexity of assessments to make them easier • Giving hints, clues, or other coaching that directs the student to correct responses on assignments and tests • Adults defining vocabulary on the test or explaining test items • Allowing the student to complete an assessment of English language arts in a language other than English • Using dictionaries that provide definitions (rather than acceptable word-to-word dual-language dictionary) 35 BEFORE testing Tasks Before Testing: PearsonAccess 1. REVIEW PEARSONACCESS (TEST MANAGEMENT SYSTEM) TRAINING MODULES AND PRACTICE ITEMS Review PearsonAccess (required) Review Practice Items (recommended) Review Infrastructure Trial (recommended) Review TestNav module (recommended for STRs) 37 Before Testing: Test Scheduling 2. ESTABLISH THE SCHOOL-SPECIFIC TESTING SCHEDULE Using district guidelines, set your school’s specific testing schedule, including make-ups. See slide 13 for school-specific PBA testing timeframe. Policies on scheduling and testing time: Each session for a subject and grade must be completed in a single school day to avoid compromising item validity Schools should take into account breaks between sessions (for make-ups) Guidelines for Scheduling Sessions Task Time Allotted Preparation after students arrive, including ensuring students are logged in to computer work stations, reading instructions to students, answering questions 10 minutes Distribute test materials to students 5 minutes Administer pilot test sessions 40-80 minutes depending on session and grade level (see next slides) Additional time allowed for ALL students if students are proactively engaged 20-40 minutes depending on session and grade level (see next slides) End-of-session activities, including closing testing sessions and collecting test materials Total Time: 10 minutes 85 – 145 minutes For each test session, plan for a MINIMUM of 85-145 minutes. Recommendation: Given that this is the first year, plan for extra time. 39 Grade 3: English Language Arts/Literacy PBA Administration Time (in min) EOY Literary Analysis Research Simulation Narrative Writing Session 1 Session 2 Session Time 60 60 40 70 50 Additional Time 30 30 20 35 25 Total Time 90 90 60 105 75 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 40 Before Testing: Test Scheduling Cont … Guidelines for Testing Time • • • • • In planning schedule, include Total Field Test Administration Times for each session (See Appendix 1) Session Time is the amount of time it should take a student to complete a session Additional Time Allowed is approximately 50% of Session Time Schools must provide all students with the entire amount of field test administration time listed for the Session Time and must schedule accordingly Students who are productively engaged in testing must also be provided the Additional Time Allowed to complete session. Schools should plan schedule to include the additional time allowed. Before Testing: Test Scheduling Cont … Guidelines for Testing Time Cont … Test sections can only be administered to students in consecutive order • One grade level and one content area at a time • A new session cannot be started until ALL students in session are finished • Before Testing: Logistics Plan 3. DEVELOP A TEST ADMINISTRATION LOGISTICS PLAN To ensure successful and secure administration of the PARCC Field Test, make sure that your Logistics Plan includes the following tasks: Identify an alternate SAL Develop a plan in case your STR is not available on testing day(s) Identify all students participating Authorize individuals to serve as Test Administrators (Must be a certified teacher or licensed profiessional) Train all relevant staff Inform students and parents about the PARCC Field Test Meet with students to review testing day policies and expectations Work with Test Administrators to schedule Sample Tests for their assigned students prior to the Field Test Designate appropriate testing spaces Before Testing: Room Configuration • Student-to-Test Administrator ratio must not exceed 25 to 1 (+ 1 extra and 1 for test administrator) • Students should not be able to see each other’s work from a normal testing position. • Consider the following seating configurations to maintain test security: – – – – – Seat students in every other seat (useful in a computer lab setup) Arrange monitors back-to-back Seat students back-to-back Seat students in a semicircle (useful for schools using laptops) Seat students in a widely spaced rows or in every other row (appropriate for a classroom setup) • Dividing screens or other privacy materials may be used if students cannot be placed far enough away from each other. Before Testing: Room Configuration Cont… • Test Administrator must be able to actively monitor the space within the testing environment. • Test Administrators should be in a position to see students’ eyes, not screens Recommendations: – Group students separately who will use Session Time vs those who will need extended time. Before Testing: Logistics Plan Cont … TEST ADMINISTRATION LOGISTICS PLAN Plan ahead to provide “accessibility features” for all students and accommodations for ELL/LEP students and students with disabilities on test day by: Reviewing each student’s approved IEP or 504 Plan ahead of time Preparing a list showing each student and his/her specific accommodation(s) Indicating whether a specific test setting or Test Administrator will be required Training all Test Administrators (including substitutes) on accommodations and Computer-Based Test accessibility features Ensuring required accessibility features and accommodations are selected during registration process (e.g., read-aloud/text-to-speech) and ensuring each student knows how to use accessibility features and accommodations prior to testing Before Testing: Logistics Plan Cont … TEST ADMINISTRATION LOGISTICS PLAN Schedule test administration sessions and locations (PearsonAccess) • Testing Group Naming Convention (30 characters): TestAdministratorLastNameFirstInitial_TestSession_Rm# • Example: SmithJ_G5Sci1_300 Prepare a record of Test Administrators and their students for each testing session Assign students and testing locations to Test Administrators (PearsonAccess) Establish school policy for allowing students to read a recreational book after completing individual tests Materials Allowed ONLY After Testing Completed Subject matter must be unrelated to content being assessed!! • • • • • 48 Recreational books Textbooks for subjects other than the one being tested Pamphlets, magazines, or periodicals Notebooks or papers of any kind Pens or colored pencils Before Testing: Logistics Plan Cont … TEST ADMINISTRATION LOGISTICS PLAN Develop a plan to store Secure materials and Test Administration Manuals between administrations if your school is administering both the PBA and EOY components of the Field Test Consult with STR to confirm that all computers used for testing meet minimum requirements for computer-based testing (refer to the PearsonAccess User Guide for details on infrastructure and system requirements) Before Testing: Computer Readiness The STR must complete the following before the first day of testing: Prepare Student Computers and Test Administrators’ Computers for Testing (~45 min/computer lab/classroom) Develop a plan to charge devices and/or keep them charged during testing Plan for easy access to extra device, keyboard, mice, microphone (if applicable). • Recommendation: Have one extra set per classroom. Before Testing: Test Security 4. DEVELOP AND IMPLEMENT TEST SECURITY PLAN A successful Security Plan will: Inform individuals authorized to be involved in test administration to review security protocols, prohibited activities, testing irregularities, and security breaches and sign Security Agreement Form Establish a documented chain of custody Designate central locked storage area for securing test materials Document that SAL, STR, Test Administrators, and Proctors have received necessary documentation and training for successful, secure administration of the PARCC Field Test Before Testing: Chain of Custody Chain of Custody: • Document before, during, and after testing • Deliver materials to schools no more than 1 week in advance • Complete school security checklist • Deliver paper-based forms and materials (oral scripts) on the day of testing • Distribute only the content area being assessed • Return materials to a designated secure location (Not stored in classrooms!) • Return materials to Pearson 52 Before Testing: Test Security Cont … Security Checklist: Test Coordinators must maintain a log of secure materials. You may use the Optional Secure Materials Tracking Form or your own equivalent log to track secure materials. Schools also need a log to account for collection and destruction of Mathematics Reference Sheets written on by students as well as for scratch paper written on by students. Test Administrators are not to have extended access (>15 minutes) to test materials before or after administration. Test Administrators must document the return of all secure test materials to the SAL immediately after testing. Before Testing: Secure Materials Handling Schools will not receive a shipment from the vendor as there will be no test booklets or answer documents. Test Coordinators must print the following secure materials through PearsonAccess, which can be printed up to one week prior to testing: Student Authorization Tickets. Each test session will have a unique Test Code for each student that will be printed on Student Authorization Tickets. Students will be prompted to enter the Test Code to access the test via TestNav (the browser-based application used to administer PARCC tests). Seal Codes. Seal Codes are four-digit codes used to lock test sessions so that students cannot go ahead to the next session or go back to a previous session that has already been completed. Seal codes are the electronic equivalents of the adhesive tabs that are used to seal sections of paper test booklets. Before Testing: Student Authorization Ticket https://co.testnav.com Username: Test Code: 55 Before Testing: Seal Codes 56 Before Testing: Test Security Cont … The SAL must distribute test materials to and from Test Administrators each test administration day. Test materials must not be stored in classrooms prior to or following the administration. Test materials that will be distributed by SAL to each Test Administrator include: Student Authorization Tickets Seal Codes Headphones (ELA PBA and accommodations) Scratch Paper Schedule of students Before Testing: PARCC Pilot Security Form • Signed by everyone who will be in the testing environment • Keep at school for 3 years • Keep copy for own individual records • Do NOT send to: – – – – – 58 ARE DoTS PARCC Pearson Colorado Dept of Education Before Testing: Training Plan 4. DEVELOP A TRAINING PLAN Make sure that you: Designate a fully-trained alternate SAL Ensure all school staff involved in administering PARCC tests are trained and understand their responsibilities and security protocols Ensure Test Administrators understand the expectation of “active proctoring” while students are testing Review roles and role-specific checklist Ensure Test Administrators and Proctors sign the Security Agreement Before Testing: SAL Training Due Dates • Performance-Based Assessment: March 14, 2014 PearsonAccess Training Module (SAL) Infrastructure Training Module (recommended) PARCC Field Test Training Module (recommended) School Face-to-Face Test Administrator Training Complete and Have Each Person Involved in Testing to Complete Testing Security Form (keep at school) Complete Training Google form • End-of-Year: April 25, 2014 60 PearsonAccess Training Module Infrastructure Training Module (recommended) PARCC Field Test Training Module (recommended) School Face-to-Face Test Administrator Training Complete and Have Each Person Involved in Testing to Complete Testing Security Form (keep at school) Complete Training Google form Before Testing: PARCC Training Google Form COMING SOON!!! Acknowledges that you have completed and provided all the necessary trainings. 61 Before Testing: Materials 6. RECEIVE, CHECK, AND SECURE PARCC PILOT TEST MATERIALS Review Coordinator Kit Check to make sure you have received all and sufficient materials 62 Before Testing: Final Preparations 7. FINAL PREPARATION BEFORE the day of testing, SALs must: Verify testing rooms are set up so students are separated by a reasonable distance to encourage independent work and prevent collaboration Ensure testing rooms are clear of any and all instructional displays Make sure there is a working clock in the room Create computer-based test sessions online Print student Authorization Tickets Print Seal Codes Print master list of sessions, with assigned test administrators and students BEFORE the day of testing, STRs must: Confirm all computers meet requirements needed to administer tests Confirm headphones are available for student use during PBA ELA/Literacy test (may also be used for text-to-speech accommodation on Math test) Confirm that proctor caching activities are complete (charters only) Materials Prohibited During All Sessions Classroom resources that may provide unauthorized assistance, or explain, define, illustrate concepts that are part of the subject areas being tested, must be covered up or removed. Include (not exhaustive list): • Posters, maps, or charts • Mathematical formulas/theorems • Graphic organizers • Number lines • Multiplication tables • 100s charts • Word lists • Definitions • Writing formulas • 64 Any manipulative not approved for use prior to testing Materials Prohibited During All Sessions Cont … • All cellular phones • Other non-tested related personal electronic equipment, e.g., scanners, eBooks, electronic pens • Any electronic equipment capable of performing computations or providing other assistance in either content area (other than approved calculators) • Instructional aids related to the content being assessed • Reference books 65 Before Testing: Final Preparations 7. FINAL PREPARATION (continued) On the day of testing, immediately prior to the beginning of the test session (NOT in advance), Start the Test session (the morning of) Distribute the following materials to Test Administrators (15 minutes): Student Materials (See next slides) Seal codes (must be written on the board by the Test Administrator) “Testing—Do Not Disturb” signs to post on testing room doors Other allowable materials During Testing: Starting a Test Session • To start a session click Start • 67 Test sessions status shows as either Started or Not Started Student Materials to be Provided Student Authorization Tickets Headphones (if administering an English language arts/Literacy session or needed for accommodations or accessibility purposes) Pencil(s) with eraser(s) Blank scratch paper – Two pages total per student (one first and second one upon request but student can only have one at a time), per session; new paper must be provided for each session. – Paper must be provided by Test Administrator – Paper must be blank, lined, or graph paper (no writing of any kind) Test Booklets (for students taking paper-based) Content or Grade-specific allowable materials 68 Student Materials to be Provided Cont … Grade/Content-Specific Material Allowed 8th Grade Math Geometry Integrated Math Tracing paper, Reflection tools, straight edge and compass Any math assessment Rulers and protractors Grades 6 and 7 Four-function calculator Grade 8 Scientific calculator High school Graphing calculators (with functionalities consistent with TI-84 or similar models) 69 Student Materials Prohibited During Specific Sessions Writing journals and other personal reference or resource materials English Language Arts/Literacy Dictionary or thesaurus (unless word-to-word dictionaries without definitions or pictures – allowable accommodation for ELLs) Any resource or reference material Grades 3-5: Calculators Mathematics Grades 6-8 and High School: Non-approved calculators Any resource or reference material Mathematical formulas and conversion tables other than the grade-specific, PARCC-approved Mathematics Reference Sheet 70 DURING testing Tasks During Testing: Test Environment 1. THE TESTING ENVIRONMENT MUST: Be adequately lit, quiet, free of distractions and heated or cooled Provide an adequate writing surface for scratch paper Be free of cell phones, music or other distracting devices “Do Not Disturb/Only Authorized Personnel Allowed” and “NO Electronic Devices” signs must be placed on the door during test sessions No food or drinks allowed on desks or near test materials Free of any content related posters or aids that suggest possible answers to students • Word walls • Steps for solving math equations • Any content related materials During Testing: Administer the Test 2. ADMINISTER THE TEST (TEST ADMINISTRATOR) Write Session Name, Session Time, and Additional Time Provide each student with individual authorization tickets and one sheet of scratch paper (students will need to write name on top of paper) Students Log In to TestNav Write Seal code on board (Erase after students have entered in code) Write start and end time on board Note: Read and follow the instructions and script as provided in the Test Administrators Manual. During Testing: Students Log In to TestNav • Once the test session has started, students launch a browser and enter the TestNav address provided in the Student Authorization Ticket • When TestNav loads student enter the Username and Test Code provided in the Student Authorization Ticket 74 During Testing: TestNav Testing Engine TestNav Welcome page 75 During Testing: TestNav Testing Engine Cont … Section 1 Seal Code Entry 76 During Testing: Monitor Test Activity 3. MONITOR TEST ACTIVITY Ensure that Test Administrators are actively monitoring students during testing During Testing: Student Status Each student has their own status indicator 78 During Testing: View Student Progress The table below gives an explanation of the possible statuses for students as they test. Status 79 Meaning Ready The student has not yet started the test. Active The student has logged in and started the test. Exited The student has exited TestNav but has not submitted test responses, e.g., finished Section 1, took a break. (Student must be resumed by the SAL to continue testing.) Resumed The student has been authorized by the SAL to resume the test. Resumed-Upload The student has ben authorized to resume the test, and any responses saved locally can be uploaded when the student is ready to continue testing. Completed The test has been completed by the student through TestNav and the data has been processed. Marked Complete The student has exited TestNav and will not resume the same test, e.g., left due to illness. During Testing: View Student Progress • A Test Administrator can view a student’s progress to determine if all questions have been answered. • Click on View Progress to view the student’s progress in the test. 80 During Testing: Active Proctoring Active Proctoring: Dos Active Proctoring: Don’ts Ensure they have all necessary materials for each session Provide feedback Ensure a standardized testing environment Clarify test questions Follow scripts exactly as written Answer content related questions Move throughout the room during testing Interfere with the student’s demonstration of skills Read directions to students when asked Interact with students in any way that would impact student responses Use proximity to keep students on task Engage in other tasks during test sections Read sources, items, or student responses During Testing: Clarifying Directions What Clarifying Directions means: • No part of the test may be read to the student (unless accommodations) • NOT directions for specific test items • Test Administrator may clarify any word used in the scripted directions • All scripted directions may be repeated to students as needed • May be provided in student’s native language Students who are off task: • Can say student’s name • Tell student to return to work on test • Provide visual cues for the student to stay on task During Testing: View Student Progress NOTE: Students should NOT “Submit” the test in between test sessions. Between testing sessions of each component, students should exit and save the test. When the next session begins, the SAL will need to Resume each student. At the end of each test session (e.g., Social Studies 1), student status should be “Exited” and NOT “Complete”. At the end of ALL test sessions (e.g., Social Studies 3), students will “Submit” their test and their status should now read “Complete”. 83 During Testing: Irregularities & Test Security 4. REPORTING TESTING IRREGULARITIES The SAL must immediately report any concern about breaches in test security or noncompliance with test administration procedures to the ARE. Please instruct test administrators to contact the SAL immediately to report all testing irregularities. During Testing: Contacts • ARE Hotline: 720.423.3736 • Pearson: 1-888-493-9888 (5:00 am – 7:00 pm MT, Mon. –Fri.) Decision tree on who to call in development and will be provided soon. 85 During Testing: Irregularities & Test Security Unauthorized Visitors and Media: • Only students, Test Administrators/Examiners, and authorized school, district, state personnel or state-sanctioned test monitors may be in testing areas during administration • Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students 86 During Testing: Irregularities & Test Security Breaches of Test Security Include: • Use of electronic devices (e.g. cell phone, smartphone, e-reader, tablet computer) by Test Administrator or student(s) while secure test materials are still distributed or while testing is in progress • Reading non-test related material(s) before closing out the test session • Altering or interfering with students’ responses in any way • Leaving test materials unattended or failing to keep them secure • Leaving students unattended while they are testing • Formally or informally scoring student responses to test items • Failing to follow test administration directions • Not administering a session according to the allotted time During Testing: Irregularities & Test Security Additional Breaches of Test Security Include: Failing to actively monitor testing students at all times Encouraging students to finish early Cheating by students (passing notes or talking to one another while testing or sharing responses to test items) Administering test(s) to family members or allowing unauthorized persons access to secure test materials Giving students access to test items or prompts prior to testing Viewing or letting students view secure content before testing Copying or reproducing any part of the passages or test items or any secure test materials or online test forms Removing secure materials from the school’s campus During Testing: Irregularities & Test Security Testing Irregularities Include: Building evacuation or lock-down Power or bandwidth failure Displaying testing aids in the testing environment (e.g., a bulletin board with relevant instructional material(s) during testing Failing to provide a student with a documented accommodation Providing a student with an accommodation that is not documented and therefore is not appropriate ALL instances of security breaches and testing irregularities must be reported to the SAL who reports it immediately to the ARE. During Testing: Irregularities & Test Security Emergencies: • If a student becomes ill during a test: – The student needs are the primary consideration. – The student may make-up the test. – The student may only have the amount of time that was left when the test was suspended. • If there is an emergency requiring the test to be stopped: • Evaluate and respond to the emergency … safety first! • If it is possible to do so without any risk to students and your self, note the time remaining in the test session • Students will be allowed to use the remainder of the testing time to complete the session at a later date. 90 During Testing: Reporting Irregularities Google Form COMING SOON!!! No more faxing!! 91 During Testing: Scheduling Make-up 5. SCHEDULE AND SUPERVISE MAKE-UP TESTING • • • • • • Students who arrive late OR are not tested on the regular administration date due to illness or other excused absence should be tested on a makeup day/session Ensure all make-up testing is completed before the end of the testing window Make-up testing sessions may be scheduled for any day after the initial administration date as long as they fall within testing window Test sessions must be administered in order The same test security and administration protocols for regular administration sessions apply to make-up test sessions It is not suggested to test with other sessions – due to timing differences NOTE: Students who become ill or have to leave for other reasons during testing should attempt to finish a test they started on a scheduled make-up date. Test administrators must note the exact place in test where student stopped. Students are not allowed to return to any previous session or change any previously completed item(s). Scheduling Make-Up Cont … • Steps (PearsonAccess): Remove students from original Test Session Create new group with students who need to take same session. TestAdministratorLastNameFirstInitial_TestSessionM_Rm# (e.g., JonesK_G5Sci1M_401) Do NOT mix different grades OR different content areas or Sessions Make-up: One grade! One content area! One session! Administer assessment 93 During Testing: Breaks • Scheduled breaks should occur between test sessions. During the scheduled break, students are permitted to go to the restroom, get up to stretch, and/or get a drink, if needed. • There should not be conversations among students and students are not permitted to use electronic devices, play games, or engage in activities that may violate the validity of the test. AFTER testing Tasks After Testing: Collection of Materials AFTER EACH SESSION: 1. COLLECT MATERIALS FROM TEST ADMINISTRATORS: Place all secure materials in CMAS Secure Return Envelope Student Authorization Tickets Seal codes Master list (student rosters containing TestNav usernames and passwords) Scratch paper Test booklets (paper-based) 2. COMPLETE SCHOOL SECURITY CHECKLIST AND STORE IN LOCKED STORAGE 3. CHECK STUDENTS WHO HAVE FINISHED SESSIONS ARE IN EXITED AND NOT COMPLETED STATUS. (IF COMPLETED, CALL ARE AND PEARSON.) Note: Need to Resume students before they can continue testing. After Testing: Cleanup Activities AFTER ALL SESSIONS HAVE BEEN COMPLETED: 1. FINALIZE INFORMATION IN PEARSONACCESS Verify that all students enrolled are accounted for Verify that all test sessions are in Completed status or Mark Completed Verify that all CoAlt scores have been entered into PearsonAccess Check student demographic information in PearsonAccess to verify that all information is correct for CMAS computer-based and paper-based students as well as CoAlt students. 97 After Testing: Stopping a Test Session 2. STOP THE TEST All test sessions must be Stopped at the end of a test administration Click on Stop to stop the test session. Reminder: STOP only after All students in a session are marked as Completed or Marked Complete status. 98 After Testing: Materials To Be Destroyed or Recycled 3. MATERIALS TO BE SECURELY DESTROYED The Test Coordinator must oversee the shredding of the following test materials immediately after all testing is complete: Scratch paper written on by students during testing Mathematics Reference Sheets written on by students during testing Printed Student Authorization Tickets Printed Seal Codes 4. MATERIALS TO BE RECYCLED Test Coordinator must recycle the following test materials immediately after all testing is complete: Test Administration Manuals (do not recycle until after EOY if administering both PBA and EOY components) Blank or unused scratch paper and Mathematics Reference Sheets After Testing: Sending Materials Back • 5. SEND TEST MATERIALS BACK TO PROCESSING CENTER 100 After Testing: Field Test Surveys • Test Administrators for the Field Test will complete a survey to gather feedback about the experience of administering PARCC assessments. • Students who participate in the Field Test will complete a survey to gather feedback about the student experience of taking PARCC assessments. Survey data will: Improve test administration protocols Identify potential sources of confusion for students Provide data on the occurrence of technical difficulties Provide data on the effectiveness of the testing environment to maximize student performance Provide data on the extent to which students engaged in on-task and/or off-task behaviors during the assessment 101 Roles and Responsibilities See Role-Specific Checklist on ARE website. (testing.dpsk12.org) 103 Infrastructure Trial What is an Infrastructure Trial? An Infrastructure Trial provides an opportunity for schools and students to prepare for the PARCC pilot by simulating test-day network utilization, and it introduces students to the online testing interface – TestNav8. The Trial will confirm that: • • • • • 105 TestNav8 is configured correctly Devices can successfully run TestNav8 Network will bear the full load Participating staff know what to do for PARCC Students are familiar with the computer-based tools and format Why Administer an Infrastructure Trial? Here are a few benefits to administering the Infrastructure Trial: • Schools have the opportunity to work with sample test forms intended to match expected school bandwidth utilization during testing. • Schools will create a similar testing environment (e.g., testing rooms, number of testing devices, power supplies, etc.) that will be used for the PARCC pilot. • Early detection of school technology readiness issues can mitigate possible problems and delays during assessment administration. • The Sample Items and Tutorial can be used to provide PARCC practice for all students participating in the PARCC field test. 106 Infrastructure Trial Steps Task STR Estimated Time Needed (in minutes) 45 SAL, STR 30 SAL, STR, Test Administrators 45 Provide Test Administrators w/PearsonAccess Log-in SAL 10 Set-up schedule and designate testing rooms SAL 30 Set-up testing environment, including Starting a Session Create sample students and test session STR 30 SAL 30 - 60 Print and Distribute Student Authorization Tickets SAL 15 SAL, STR, Test Administrators, Students 30 Stop a Session SAL, Test Administrators 10 Provide feedback to ARE and DoTS SAL, Test Administrators 15 Technology Readiness Check Review Pearson Infrastructure Trial training module Review PearsonAccess training module Administer and Monitor Test Session 107 Who Should be Involved 320 min (MAX) Support and Additional Information Resources • E-mail: OnlineAssess@dpsk12.org • DPS Websites: – http://onlineassessment.dpsk12.org – http://testing.dpsk12.org/ • PearsonAccess: www.pearsonaccess.com 109 Thank you for your help in coordinating the PARCC Pilot! Appendix 1 Total Pilot Administration Time Grade 3: English Language Arts/Literacy PBA Administration Time (in min) EOY Literary Analysis Research Simulation Narrative Writing Session 1 Session 2 Session Time 60 60 40 70 50 Additional Time 30 30 20 35 25 Total Time 90 90 60 105 75 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 112 Grades 4-5: English Language Arts/Literacy PBA Administration Time (in min) EOY Literary Analysis Research Simulation Narrative Writing Session 1 Session 2 Session Time 70 80 50 70 50 Additional Time 35 40 25 35 25 Total Time 105 120 75 105 75 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 113 Grades 6-11: English Language Arts/Literacy PBA Administration Time (in min) EOY Literary Analysis Research Simulation Narrative Writing Session 1 Session 2 Session Time 80 80 50 70 70 Additional Time 40 40 25 35 35 Total Time 120 120 75 105 105 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 114 Grades 3-5: Mathematics PBA Administration Time (in min) EOY Session 1 Session 2 Session 1 Session 2 Session Time 50 50 55 55 Additional Time 25 25 30 30 Total Time 75 75 85 85 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 115 Grades 6-8: Mathematics PBA Administration Time (in min) EOY Session 1 Session 2 Session 1 Session 2 Session Time 50 50 60 60 Additional Time 25 25 30 30 Total Time 75 75 90 90 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 116 Algebra I, Geometry, and Mathematics I PBA Administration Time (in min) EOY Session 1 Session 2 Session 1 Session 2 Session Time 55 55 70 70 Additional Time 30 30 35 35 Total Time 85 85 105 105 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 117 Mathematics II PBA Administration Time (in min) EOY Session 1 Session 2 Session 1 Session 2 Session Time 60 60 70 70 Additional Time 30 30 35 35 Total Time 90 90 105 105 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 118 Mathematics III PBA Administration Time (in min) EOY Session 1 Session 2 Session 1 Session 2 Session Time 65 65 70 70 Additional Time 35 35 35 35 Total Time 100 100 105 105 Every student must be provided with the FULL amount of Session Time. For this year, additional time is available to ALL students if some are still diligently working. Schools should plan on the Total Time for testing. 119 Appendix 2 Glossary of Acronyms 120 Acronym Definitions STR School Tech Representative PBA Performance-based assessment EOY End-of-Year assessment CBT Computer-based test SAL Site Assessment Leader TA Test Administrator ARE Assessment, Research, and Evaluation DoTS Department of Technology Support SDU Student Data Upload PARCC Partnership for Assessment of Readiness for College and Careers ELL English language learner 121