ADMINISTERING THE NEW 2010 STATE ASSESSMENTS Critical Information for Principals, Test Proctors and Monitors Pat Cummings, Director, Research & Evaluation — Tacoma Public Schools pcummin@tacoma.k12.wa.us 253-571-1280 Terry Easley, Student Assessment Coordinator — Tacoma Public Schools teasley@tacoma.k12.wa.us 253-571-1193 Thea Turnley, Testing Secretary — Tacoma Public Schools tturnle@tacoma.k12.wa.us 253-571-1190 2 INTENT Effectively implement the state assessment program To ensure the best opportunity for students to accurately show what they know and are able to do. 3 CODE OF CONDUCT It is your responsibility to ensure that standard procedures are followed. Ensure understanding of test protocol. Ensure accuracy of student demographics. Watch for irregularities during testing. Document any unusual or inappropriate behaviors during testing. Follow the Code of Professional Conduct. 4 CODE OF CONDUCT (… CONTINUED) WAC 181-87-060 Disregard or abandonment of generally recognized professional standards. Any performance of professional practice in flagrant disregard or clear abandonment of generally recognized professional standards in the course of any of the following professional practices is an act of unprofessional conduct: (1) Assessment, treatment, instruction or supervision of students 5 TEST PREP Educators must ensure that test preparation activities and materials provided to students will not adversely affect the validity of test score inferences and maintain the integrity of test results by eliminating practices designed to raise test scores without improving students’ real knowledge, skills or abilities in the areas tested. Review the Washington Educational Research Association (WERA) publication: Ethical Standards in Testing http://www.wera-web.org/pages/publications.php 6 RESPONSIBILITIES OF TEST PROCTORS (THOSE WHO READ THE DIRECTIONS TO THE STUDENTS) Attend required training. Read all training materials for each test they administer. Provide a positive test-taking climate. Administer tests to all eligible students. Ensure that test documents are given to the student identified in the coding on the document. Administer tests according to the Directions for Administration. Maintain confidentiality of test items, passages, performance tasks and individual student results. Document and report any testing irregularities to the School Assessment Coordinator and principal. Sign Test Security Assurance Form as required by OSPI. 7 TEST SECURITY State laws RCW 42.56.250 and 28A.635.040 limit access to tests and supportive materials and define penalties for disclosure of test items. They are designed to protect the integrity of the test. State laws RCW 28A.635.040 and WAC 180-87-060 provide penalties for the unauthorized use or disclosure of test content and flagrant disregard of generally recognized professional standards in test preparation and administration. Unprofessional conduct must be reported to the Office of Professional Practices at OSPI. 8 TEST SECURITY (… CONTINUED) Staff are not permitted to read, inspect, discuss or transmit secure test items, passages or performance tasks before, during or after the assessment has been administered. Public school employees must not read, review or scrutinize test items, passages or performance tasks, unless directed to do so by OSPI. (Note: Under very limited circumstances the appropriate testing practice for some students with IEPs, Section 504 Plans or in ELL programs may require staff reading or reviewing items, passages or tasks.) The annual release of test items from past state administrations may be found at http://www.k12.wa.us/Assessment/WASL/testquestions.aspx. These released items may be freely shared with teachers, students and parents. All test booklets must be kept in a secure location when not in use. 9 TEST SECURITY (… CONTINUED) All testing irregularities must be documented. The front cover of the test booklet contains a space for the test proctor to document any deviation from testing procedures. All Test Proctors, School Assessment Coordinators and Principals are required to sign security reports. The District Assessment Coordinator and Superintendent are required to return a signed security report to OSPI. 10 UPDATES FOR 2010 NEW • WASL has been replaced with: Measurements of Student Progress (MSP) for grades 3 – 8, High School Proficiency Exams (HSPE) for High School • MSP Reading, Math and Science assessments consist of one session. Work must be completed in one day according to your district approved testing schedule. • MSP Writing (gr 4 & 7) consists of two sessions (both in one test booklet). Work for each session must be completed in one day according to your district approved testing schedule. • HSPE Reading, Math and Science assessments consist of one session to be administered according to the mandatory testing schedule. • HSPE Writing consists of two sessions. Day One test booklet will be green, Day Two test booklet will be purple. Each session must be administered according to the mandatory testing schedule. • No testing of 9th graders. • Testing for MSP has moved to May (paper/pencil testing May 12 – 28; online testing May 3 – June 4) • Tacoma Middle Schools are registered to participate in online testing for Reading & Math. OSPI will review participation decisions and notify districts in January. • Developmentally Appropriate Proficiency Exams (DAPE) have replaced the WAAS-DAW. Testing is still available for 11th and 12th graders in reading and math by grade-band (ES or MS). Writing will still be available at grade levels 4 and 7. • Direction manuals for grades 3 – 8 will be in grade bands 3-5 and 6-8. • Math Formula Sheets will be included inside the front cover of the 6-8 and High School test booklets. • NO CALCULATORS allowed for gr 3 – 6 MSP Math. • Calculators are allowed for grades 7 & 8 MSP Math and grades 5 & 8 MSP Science. Calculators are also allowed for grades 10 – 12 HSPE, ES & MS WAAS DAPE Math and grades 10 – 12 HSPE Science. • Braille and large print materials are returned to CAB with your MSP/HSPE/WAAS-DAPE materials. DO NOT return materials to the Instructional Resource Center (IRC). Research & Evaluation will return all materials to the appropriate vendor. • Two new categories of students are now eligible for Direct Access to CAA Options: 11th & 12th grade transfers into Washington public schools from in-state home or private school, and Non-Native English Proficient (NNEP) students in the 11th & 12th grades who were exempt from the 10th grade WASL/HSPE due to first year transfer into a Washington school. • Online Proctor Questionnaires will be available during each test administration. • Early return of High School Grade 12 results will be available no later than the day after Memorial Day. • As in previous years, new Non-English Proficient (NNEP) students are not required to take the Reading and Writing assessments. However as of 2009, the Elementary and Secondary Education Act (ESEA) requires them to take the Math and Science assessments. 11 12 BEFORE TESTING It is inappropriate to try to find ‘a right technique’ that would give advantage to any student(s). The goal is to have scores accurately reflect what our students know and can do. Remove or cover any materials that may help students answer items that are on the test. The following are allowed to remain: - alphabet line (with pictures and/or Open Court are OK) - number line (cannot include fractions, decimals or multiplication chart) - verbatim copy of the “Writing Checklist” as it appears in Directions for Administration (Note: these checklists are also in the student test booklet) 13 BEFORE TESTING ( CONTINUED) The following must be removed or covered: Six Trait Posters Strategies for Reading, Writing, Math, Science Guides or lists showing paragraph structure or transition words Posters showing math/reading/science vocabulary lists Posters showing math problem-solving steps Posters showing science investigation attributes Math 300 chart must be covered Multiplication charts or tables 14 GO… MSP & HSPE! Answer Every Question! 15 TEST ADMINISTRATION Cell phones (staff and students) or other hand-held electronic devices must be turned off during all testing sessions. Backpacks, purses, cell phones and other hand-held devices must be out of view and out of reach of students during testing. 16 DURING TESTING Create a positive testing environment. The TESTING sign provided must be posted at the door of each testing site to prevent interruptions. 17 TEST PREPARATION ETHICS It is ethical to review skills, strategies and concepts previously taught. It is ethical to teach and/or review test-taking skills that address test-item characteristics. It is ethical to provide students with instructional reviews using released items. Such test preparation activities should be viewed as being a continual process, not something that is only done immediately prior to testing. 18 TEST ADMINISTRATION • The test must be administered by a trained staff member of a school district. • Student teachers, interns and paras may be test proctors and/or roaming monitors providing they have received the training for test administration. (Student teachers, interns and paras have a contractual relationship with the district.) • Approximate ratio for a standard classroom should be 1:30-35. Testing group of 200 would require 6 or 7 staff members. • MBWA: Monitor by walking around • Proctors and monitors should be instructed to watch for the following: be sure students are working in the correct section; be sure they are writing in their booklets (not on loose pages); be sure they are generally following the directions given at the beginning of the session. • Monitors should notify the test proctor of any irregularities. All testing irregularities must be documented. The front of the test book contains a space for the test proctor to document any deviation from testing procedures. A note should be placed in the cumulative file of any student involved in the irregularity. 19 TEST ADMINISTRATION ( CONTINUED) Read directions exactly as written, no paraphrasing. • You may highlight or mark in your Directions for Administration to facilitate their use. • Note: Test Proctors must refer to a student test booklet when reading the writing prompts to students on the days of testing because they are not included in the Directions for Administration. Always have an adult in the room when students are testing. 20 TEST ADMINISTRATION ( CONTINUED) If students ask questions, it is ethical for Test Proctor to: • Advise the group to: • Read the question quietly aloud to yourself. • Think about what the question is asking you to do. • Even if you’re unsure, take a good guess. You might know more than you think you do. • Use your pencil to underline key words in the test question. 21 TEST ADMINISTRATION ( CONTINUED) It is unethical to: • You may not paraphrase questions or read the items to students. • You may not give specific feedback to individual students about completing specific questions. • You may not make comments about quality or quantity of student work. • You may not suggest or “coach” students to mark or change their answers in any way. • You may not point out an incorrectly answered question, questions that have not been completed or read and comment on student essays. 22 TEST ADMINISTRATION ( CONTINUED) Breaks should last no longer than 10–15 minutes and should not extend over lunch or recess. • All Schools: Students taking breaks must be reminded that they should not discuss the tests with one another. • All Schools: Students should not miss their scheduled lunch. Students may continue to work on tests following a supervised lunch break. (If necessary, lunch can be brought to the students who need additional time.) • Elementary Schools: • The regular recess schedule should not be followed during testing. It may be beneficial to suspend the ringing of the bells. • For Grade 4 Writing: It may be appropriate for all students to complete the transcription and final editing of their writing tasks after a supervised lunch break. 23 TEST ADMINISTRATION ( CONTINUED) Test Irregularities: Examples (but not limited to): • Reproduction of test booklets or secure supporting testing materials. • Improper test preparation. • Improper test proctoring including: • Coaching and/or departing from prescribed script in Directions for Administration (DFA). • Not following the State or Building Test Schedule. • Providing accommodations (group or individual) not permitted in Directions for Administration (DFA). • Allowing breaks during testing outside the parameters listed in DFA. • Providing student access to tools or materials not allowed for that test. • Unforeseen interruption in test administration. 24 TEST ADMINISTRATION ( CONTINUED) If a testing irregularity occurs (suspected cheating, test administration error, etc.) DO NOT Stop the Testing Session! Test Proctor should make note of the irregularity on the students book and report the incident to the building Test Coordinator and principal who will report to the District Assessment office. 25 AFTER TESTING Invalidation decision will be made by OSPI if the resulting scores are judged not to accurately reflect what the tested student knows and is able to do. Tests may be invalidated when a testing irregularity occurs. Some irregularities that could lead to invalidation are: • inappropriate test preparation or materials on walls • cheating on a test is discovered • the test was improperly administered. Invalidated tests are treated as not having been tested. These students are included in calculations of percentages of students not meeting standard. 26 AFTER TESTING ( CONTINUED) Shred all writing drafts, they are confidential and secure. (Also, test books must not contain any loose papers.) Count and accurately return all test materials. Be sure signed Pre-ID Student Rosters are returned with your test materials. Be sure signed Staff and School Security Reports are returned with your test materials. 27 PARTICIPATION The statewide testing program focuses on assessing student progress in meeting the content standards in the Essential Academic Learning Requirements (EALRs) and Grade Level Expectations (GLEs) at grades 3, 4, 5, 6, 7, 8 and 10. Participation in state testing, including Washington Alternate Assessment System (WAAS), helps ensure that needs of all students will be considered in policy and curriculum decisions Students with an IEP have four assessment options: • MSP/HSPE without accommodations; • MSP/HSPE with accommodations; • MSP/HSPE-Basic with or without accommodations. This allows a student to pass the grade level test with a Level 2. • WAAS Portfolio 28 PARTICIPATION ( CONTINUED) Assure Wider Access, Not Advantage • The goal is to assure every student has the opportunity to participate in the assessment without providing a special advantage. • Some test procedures may be altered for any student, based on a review of the individual needs of the student. The alterations in the procedures must not be used for the first time on state assessments. • These procedures are available to any student who would benefit and uses them during regular instruction. • Refer to Accommodations Available for All Students in the Directions for Administration for detailed information. 29 PARTICIPATION (CONTINUED) Accommodations for Special Populations • Accommodations are practices and procedures in the areas of presentation, response, setting and timing/scheduling that provide equitable access during assessments for students with disabilities and limited access. • Accommodations provided must align with accommodations provided for the student in daily instruction and local assessments. No accommodation should be used for the first time on a state assessment. • Special populations in Washington state include: • Students in special education programs • Students with Section 504 Plans • English as second language/bilingual students • Be familiar with the following documents: • Accommodations Guidelines for Students with Disabilities (http://www.k12.wa.us/assessment/altassess.aspx) • Assessment Accommodations Guidelines for English Language Learners 20092010 (http://www.k12.wa.us/assessment/WLPTII/default.aspx) 30 PARTICIPATION ( CONTINUED) IEP and NNEP • Make arrangements for those students whose IEP specifies they will take the Washington Alternate Assessment System (WAAS) Portfolio. • Make arrangements for any Bilingual students who are New Non-English Proficient (NNEP) Students and are not participating in the state assessment. • NNEP students are those who first enrolled in a U.S. public school within the past 12 months. They are not required to take the Reading or Writing assessments. (Lists of NNEP students will be provided by the Second Language Office) • ESEA/NCLB, however, requires them to take the Math and Science tests. Test scores, including those in mathematics, are not counted in any way (i.e., % Meeting Standard or AYP results). If they do not take math, they will be counted in AYP as non-participants. Students who attempt at least two items will be counted as participants in the Math test. ESEA requires 95% participation. Be sure to have no more than 5% excluded from testing in math. For further information contact AYP Specialist at OSPI (360)7256348. • Your Test Coordinator should follow specific instructions provided by Research & Evaluation for proper coding of test booklets. 31 PARTICIPATION ( CONTINUED) Excused Absence • Students who do not take the assessment due to a ‘valid excuse’ will not be included in AYP or % Meeting Standard results. However, they will be counted as non-participants for AYP. Keep in mind AYP requires 95% participation. • A ‘valid excuse’ (OSPI term) is any ‘excused absence’ in Tacoma School District. Buildings should treat absences on test days in the same manner as any other day. 32 STILL NEED HELP? CALL 1193. 33