September 2015 3, SCPCSD District Office Training Room o o o o o o o o o o Introductions The School Test Coordinator’s role Resources for the STC Overview of all State Tests Test Security Lunch 12:00-1:00 Materials and Ordering—Precode English Language Learners Students with Disabilities Accountability Please tell us: o Your name o Your school o What else you do besides testing Organized—plans and implements effectively o Responsible—Successfully completes tasks ON TIME o Detail-Oriented—Assures Accuracy of every aspect and document related to testing o Dedicated– go “above and beyond” o o o o o Coordinates the administration of all statewide assessments, including preparation before and follow up after testing. Implements all policies/procedures for the assessments as directed by Test Coordinator and Test Administration Manuals, and SCPCSD Directives. Assures the security of all secure testing materials. Adheres to all state policies regarding test security. o Assures that students with Disabilities, Students with ELL Accommodations Plans and Students with 504 Plans receive appropriate testing accommodations. o Assures that appropriate testing environments are maintained. o Trains building level staff in test security administration. (Test Administrators & Monitors). o Emails from the District Test Coordinator will alert you of upcoming deadlines. o Emails from Test Contractors (i.e., ACT) o Test Contractor web pages and portals: o eDirect (for SCPASS and End of Course Tests) o ACT WorkKeys : South Carolina web page for ACT WorkKeys (also for the ACT and ACT Aspire) Our Charter District site for sharing documents and resources !! The Bookshelf https://sccharter-public.sharepoint.com (GO To ASSESSMENTS) o Will include information such as: o The District Assessment Calendar o STC Handbook o PowerPoint Trainings o Links to eDirect, SCDE websites, and contractor websites o Contact information for Customer Support *Many dates are TBD. o The Assessment Calendar will be on SharePoint. o Caution: Test Manuals for some tests will list the State Testing Window. Districts are often required to select a shorter window of dates within the state window. o o o o o o 32 Schools More online availability Still unknown! gr. 3-8 ELA and math test, gr. 11 college and career readiness assessment ELL assessment *Scheduled Tests o My IGDIS (Individual Growth and Development Indicators) o An early literacy measure o Individual Administration required first 45 days and last 45 days o Developmental Reading Assessment 2 o Provides a measure of independent reading level and comprehension o Individual Administration required first 45 days and last 45 days o Name: Cognitive Abilities Test & Iowa Assessment o Grades: 2nd o Subject Areas: Aptitude (verbal, quantitative, and nonverbal), reading, and math o Test Dates: October 21– November 11 o Format: Paper-and-pencil Who is tested? The norm-referenced tests (aptitude and achievement) for gifted and talented screening are administered in the fall of each year to students in grade 2. The information from the administration of the norm-referenced tests is entered into the GIFT software program, which identifies students who qualify for the program. Based on the results from the normreferenced tests, a secondary screening using a performance assessment may be required for possible candidates. o Name: SC Performance Tasks Assessment o Grades: Typically 2nd, but may include others o Subject Areas: Verbal and nonverbal o Test Dates: February 16– March 3 o Format: Paper-and-pencil with preteaching and manipulatives Who is tested? Students who partially qualify as Gifted and Talented in either Dimension A or Dimension B, but not both, based on CogAT/ITBS scores, may be given the Performance Tasks Assessment. This assessment provides a second opportunity to become identified as Gifted and Talented. o Name: End-of-Course Examination Program o Grades: 7-12 o Subject Areas: Algebra 1, English 1, US History and the Constitution, and Biology 1 o Test Dates: January, May, July o Format: Paper-and-pencil or Online Who is tested? All students who are enrolled in courses in which the academic standards corresponding to the EOCEP tests are taught must take the appropriate tests. The examinations count 20 percent of the students’ final grade in each course. South Carolina Alternate Assessment (SC-ALT) and National Center and State Collaborative (NCSC) o NCSC – ELA and Math-ages 8-13 and 16 o SC-ALT – Science and Social Studies, ages 9-13; Biology, age 16 o Test Dates: March 1-29, 2016 o Format: Paper-and-pencil Who is tested? Alternate assessment is for students with significant cognitive disabilities who are unable to participate in the general assessment program even with accommodations. Students must meet the participation guidelines for alternate assessment. With undetermined dates Procurement activities not finalized o Name: End-of-Course Examination Program o Grades: 7-12 o Subject Areas: Geometry, English 2 If required for federal accountability. Test contractor names and administration dates to be announced. o Name: SC Palmetto Assessment of State Standards o Grades: 4-8 o Subject Areas: Science and Social studies o Test Dates: May o Format: Paper-and-pencil or online Who is tested? o Students in grades 4-8 take both science and social studies. o Dates to be announced when the Summative Assessment ELA and math dates are announced. Test names and administration dates will be announced as soon as procurement activities are finalized. o All students in grade 11 and students in their third year of high school must be administered a College and Career Readiness Assessment and WorkKeys. o The College and Career Readiness Assessment is still TO BE DETERMINED. Test name and administration dates to be announced. o To Be Announced as soon as the procurement activities are finalized. o Test Dates: typically mid February – mid March Who is tested? All students in grades K-12 who are determined to have limited English proficiency - based upon the completion of a Home Language Survey and the initial assessment of their English proficiency. This includes those students whose parents have waived direct ESOL services. Participation is expected to be 100%, verified by the SCDE Title III office. o What Is WorkKeys? A job skills assessment published by ACT. o Three 45 minute assessments: reading for information, applied math, and locating information. Dates: Negotiations with ACT are in progress. NAEP Assessments Formative PSAT AP o Grades: 4, 8, and 12 o Subject Areas: 12 subject areas Test Dates: January – March o Format: Paper-and-pencil; pilot testing of tablets in 2015, technology based assessments begin in 2017. Who is tested? NAEP statisticians carefully select a sample of students to represent the entire student population. Main NAEP is administered to students in grades four, eight, and twelve; however, samples for long-term trend are based on age (9, 13, and 17) rather than grade. Test scores and questionnaire responses are always kept confidential. Results are never reported for individual students or schools. For the 2015-16 school year, NAEP assessment will focus on the Arts. NO DISTRICT PARTICIPANTS. The following assessments have been approved by the State Board of Education: o Blending Assessment with Instruction Program (BAIP-Math) o STAR Reading and STAR Mathematics o Measures of Academic Progress (MAP) o Istation o I-Ready – Paid for by the SCPCSD in 2015-16! Funding Process Each year, schools complete a survey to indicate the number of students tested and submit an invoice showing funds spent. The state collects this information from all districts and allocates funds based on the number of students tested statewide. Reimbursement varies each year and is not expected to be 100%. o The PSAT can be administered by Schools with a Level II code from the College Board. o Schools without a Level II code should refer students to other schools o The SCDE Office of Assessment will pay the College Board for all TENTH grade students who take the in grade 10 in 2015-16. o Test Date: October 14, 2015 o Name: Advanced Placement o Grades: Typically 11 & 12 o Subject Areas: 31 subjects including Calculus, Biology, & English Lit o Test Dates: May o Format: Paper-and-pencil Who is tested? The state will pay for students enrolled in approved Advanced Placement courses to take the exam (students may pay a small administrative fee). Any student may take any exam for $89. Schools must apply to the College Board for a level II code in order to administer AP exams. Students may make arrangements with their local high school. Dr. Kathryn Rhodes, SCDE o DTCs, STCs and all personnel involved in paper/pencil and online testing must be familiar with SC test security legiislation and State Board Regulations. o Pages 11-14 in Handbook o Pages 13-14: Read X. A-U Any suspected violation must be reported to the DTC o All STCs, TAs, and Monitors must sign after receiving training o Scan and Return to district office and keep copies. o In 2015-16 you will be asked to return these prior to the test dates. Secure materials must be kept in secure, locked storage when not in use. o If possible—no outside or inside windows. o No copy or fax machine or frequently accessed materials in the room. o o Do not leave secure materials unattended at any time. If a TA must leave the room before testing begins, materials should be placed in a locked drawer, cabinet, etc. or materials should be taken with the TA. o o Schools and districts are required to use security checklists to track distribution and return of all secure paper/pencil test materials STCs, TAs, and monitors are responsible for ensuring that all test materials and student responses for online tests are handled in accordance with security procedures outlined in the TAM. State Board Regulation 43-100, X, C: “Failing to proctor the test to ensure that examinees are engaged in appropriate test-taking activities” is considered a security violation. o Preparation- The TAs should make certain they have read the test manual and are well-prepared. o TAs should not deviate from the directions for conducting the test. o TAs should be alert and move throughout the room during testing in order to: observe any apparent cheating, talking, or copying, o Observe any cellphone use or use of electronic device o Check that students are following directions for marking responses or entering into the online testing system. o o Monitors may not be left in charge of a classroom in which students are testing or in which test materials are not in secure storage. These are actual violations that occurred in our district in 2013-14: o A test Administrator was using a cell phone during a small group administration of a high school test. o A student did not receive a test in a small group even though small group administration was included in his IEP. o A student was not allowed to type responses although his IEP specified that he should be allowed to do so. o A student received an oral administration accommodation of the SC PASS test but the student did not have an IEP or 504 plan . o A student was allowed to type responses even though typing responses was not an accommodation for that student. o Student was allowed to use a calculator (not in IEP). o A teacher administered the entire CogAt test on one day even though the Test Administration Manual specified that specific subtests be given on specific days.. o A test booklet and answer document were not returned on time. o o o o o A TA administered the ACT with Timing Accommodations when the students should have had the standard administration. A LEP student was supposed to have oral administration of the Algebra EOC and did not receive it. The ACT was administered to a small group of Students with Disabilities using the WorkKeys manual. The TA left a monitor with students taking the SCPASS makeup test while he went to another room to read directions to another group of students taking makeups. CogAt/IA tests were returned to the contractor several days late. Student: o Invalidation of test scores Teacher: o Report to SLED for information or investigation o Suspended/Revoked Certificate School: o Letter of Caution from the District Office o Probation o Revocation Remember that failing to report a violation is also a violation! o o o o o Test tickets are secure; use testing roster, in lieu of security checklist, to account for tickets. Online test may not be viewed by anyone prior to the test session. TAs are expected to ensure that visible online tests are not left unattended. Use of traditional desktop and laptop computers is recommended for online testing. If Chromebooks or iPads are allowed schools will be responsible for ensuring test security on these devices and will be accountable for any atypical impact on students test scores. Mr. Edwards, a teacher at Springfield Middle School, is very thorough. His students are taking the SCPASS test online this year, and Mr. Edwards wants to make sure that his students get as many points as possible on the test. During testing, as each student finishes, Mr. Edwards asks them to go to the Review/End Test screen. If he sees a blank response, he instructs the student to return to the item and answer it. This is a test security violation. TAs should not examine an online test or a paper answer document to make sure all of the questions were answered. While moving around the classroom, it is permissible for TAs to check that students are following the directions for marking their responses on the computer screen or in the answer document. It is not permissible to stop and read test items or check students’ responses on the computer screen or in their answer documents. The TA may make general announcements to the class such as reminding students to check their answers before exiting the test or to do a good job of erasing on the paper answer documents. All classrooms at High-Tec Middle School have computers. Ms. Twitter, a frequent user of her computer, e-mailed her colleagues after testing to ask if they noticed the question in the social studies test about the Museum of Ancient History. Ms. Twitter is guilty of several test security violations. TAs and other personnel are not permitted to read test items before, during, or after testing. Based on her email message, it appears that Ms. Twitter read a question in one of her student’s test booklets. She should not have done this unless she was conducting an oral or signed administration using a secure script. In addition, TAs are not permitted to disclose or discuss the contents of any test with students, teachers, or other personnel. Here again, Ms. Twitter committed a test security violation by e-mailing her colleagues with a reference to secure test content. In order to save time, Mr. Fatica decided to have his students practice the Online Tools Training (OTT) for the End of Course test immediately before the actual test administration To be efficient, he handed out the Student Test Tickets as soon as the students were seated. The class then began to work on the OTT as a group, openly discussing the practice items. Four students mistakenly used their test tickets to login to their actual tests during the OTT session. By the end of the OTT session, they had nearly completed the entire test This is a test security violation for several reasons. As indicated in Appendix B of the SCPASS TAM, the OTT should be used prior to the online testing window, not immediately prior to an actual test session. The TA failed to follow directions as specified in the test manual, but the TA also violated S.C. Code Annotated Section 59-1-445 (2004) by giving examinees access to the test questions prior to testing. Mrs. Hansel, the Special Education Coordinator, developed a plan for ordering customized materials and arranging for SCPASS testing accommodations. In December, she asked all teachers at Stonehouse Middle School to provide her with a list of the testing accommodations specified in each student’s IEP and/or 504 Plan. Teachers sent this information to Mrs. Hansel. After testing was completed, however, it was discovered that one of Mr. Gredler’s students had not received an accommodation for science as specified in his IEP. A review of the situation revealed that Mr. Gredler had provided Mrs. Hansel with the student’s IEP accommodations for social studies, but not for science. Not providing accommodations as appropriate for students with IEPs or 504 Plans is a test security violation. Because the student in Mr. Gredler’s class did not receive the accommodation specified in his IEP, an IEP team meeting must be convened as specified in the SCPASS TAM to determine whether or not the science test administration should be considered valid. o Develop an effective system for ensuring that students receive the correct accommodations. o Provide a comprehensive training for Test Administrators and monitors. o Emphasize that test manuals must be read in their entirety. It is not sufficient simply to attend training. o Encourage Test Administrators and monitors to contact you immediately if there is a questionable situation. Make sure you are available by phone. Testing is not the time for Test Administrators to make independent decisions. o o o o o o o o o Use security checklists provided by test contractors. Test Administrators sign out tests and sign them back in. o Know exactly how many documents each TA is responsible for. o COUNT, COUNT, COUNT every time documents change hands. o Identify which student used which document. Conduct a final inventory, then sign the security checklist. Double-check all labeling. Separate scorable from non-scorable. Keep a count of scorable documents. Follow diagrams in the TAM for packaging order. Complete Header Sheets if required. Return materials by the stated deadline. PLEASE ASK… o If a student was not given the proper accommodation, but this error was discovered and the student is given a different form of the test, does this still constitute a security violation? 12:00-12:45 o District Test Coordinator emails to you and emails sent to you from contractors will provide guidance regarding deadlines and next steps. Know your deadlines! o o 1. Precoding in PowerSchool 2. Contractor websites/portals o The Precode Process – Sends student information in school databases to testing contractors for the purpose of pre-assigning answer documents and test booklets via barcoded documents and labels. o (Provides the same data for online testing) o Eliminates manual coding, which saves time and labor and prevents errors. o Test contractors require state ID values to be unique and have a value for each student. Students with no state IDs and students with duplicate state IDs will not be precoded. o Communicate with your PowerSchool Administrator about: o Sorting materials o Customized materials o Paper vs. online administration o Data Collections – whole school responsibility. Work closely with PowerSchool Administrator, Special Education Coordinator, and Title III Coordinator to ensure that accurate data is uploaded by Test Contractors. o Precode Data Collections: o Kindergarten Readiness—August 24, 2015 o CogAT/Iowa Assessment – August 28, 2015 o Fall EOC: October o Spring Print Phase: January o Spring Update Phase: March o o o Communicate with your PowerSchool administrator!! Communicate with your Special Ed coordinator!! Pay attention to Precode vs. other ordering instructions to ensure that accurate data is uploaded by Test Contractors. o Available Online: o EOCEP o SCPASS o CogAt/IA (if your school previously signed up) o Gr.3-8 assessment and Gr. 11 summative assessment o NOT Available Online: o SC Performance Tasks o Gr. 4 and 5 Readiness o WorkKeys (no lockdown browser) o Make sure that Student is enrolled in a section with the proper course code o o o o o o o o o o o o 4111 Algebra 1 3142 Math Tech 2 4117 Intermediate Alg 4114 Common Core Alg 1 3011 English 1 3024 Common Core Eng 1 3221 Biology 1 3227 Applied Biology 2 3320 US History 3372 AP US History 336D IB History of the Americas 3322 Dual Enroll. American Hist. o Will the student test online or on paper? o o 1. 2. 3. 4. As of October 2014, the Sort ID fields affect ONLY SCPASS Use one of four options: An Alphanumeric entry up to 9 characters to sort by teacher, test administrator, or other grouping. AWG to sort alphabetically within grade If Sort ID is blank, materials will be sorted by Home Room. If Sort ID & Home Room are blank, materials will be sorted AWG. Oral/Signed Administration o Teacher-level materials (Script and/or CD-Rom) o Must be ordered via eDirect for SCPASS & EOCEP o Student-level materials (Test booklet) o Must be coded in PS for SCPASS o Must be coded in PS for online EOCEP For paper/pencil Oral Administrations, MAKE SURE the student booklet is the correct form to match the script. eDirect is the website for the test contractor Data Recognition Corporation (DRC). DRC provides the SC PASS Assessments (social studies and science) and EOCEP Assessments for our state. Each STC is provided with an account on eDirect (https://sc.drcedirect.com). Contact the DTC for assistance logging in or using eDirect. This account is used to: o Order test materials o View and download documents such as the TAM o Access online software downloads and training tools for online assessments o View reports after testing is completed ACT Testing: South Carolina o www.act.org/aap/southcarolina/act/ht ml o Contains Checklist of dates, Manuals and Supplements, Training, Score Reporting, and Customer Services contact information. o Each STC is provided with an account. o Vamshi Rudrapati, Director of Federal Programs o A limited English Proficient (LEP) –a student who has a primary language other than English and is not proficient in listening, speaking, reading, writing, or comprehension in the English speaking classroom as determined by a language assessment instrument. o In PowerSchool, the appropriate code for each student is based on the ACCESS or ELDA test score. o For new students, coding in PowerSchool is based upon performance on the assessment used for initial placement. o Assessments are NOT available in languages other than English. o Test Administrators may not translate any part of the tests except the test directions. o PowerSchool codes 1-7 can receive accommodations. o PowerSchool codes 8 and 9 do not receive accommodations. o Accommodations should be used only as appropriate for individual students and should not be applied to all LEP students indiscriminately. o Generally, the same accommodations that are available to Students with Disabilities are available to LEP students. o Accommodations should be recorded on the student’s accommodations form and kept with the student’s ESOL folder. • An ELL student CANNOT be exited from the ELL Program until the student meets the state exit criteria on the State English Language Proficiency Assessment. Beckie Davis, Director of Special Education Services o Students with disabilities must be included in state and district assessments. o Assessments must provide for accommodations for students with disabilities. o XO. Not providing accommodations (to include customized forms and modifications) as appropriate for students with IEPs or 504 Plans. This includes providing more accommodations (customizations, modifications) than appropriate. o Not providing accommodations or providing additional accommodations jeopardizes the validity of the inferences made on the basis of test data. o All of the following accommodations must correlate: o Stated in IEP or 504 o Received during regular instruction o Received during testing o Coded on answer document o Coded in PowerSchool o o o o Standard vs. non-standard (team decision) Only route to accommodations is IEP or 504 Exception: temporary conditions Violation requires review by IEP or 504 team Oral administration Signed administration Custom Materials (loose leaf, large print Oral administration scripts and Braille oral administration script for paper testing (for TEACHER USE: SCPASS and End of Course.) Test booklets for paper testing (EOC) o o o o Setting accommodations: preferential seating, separate location, small group, and individual administration Timing Accommodations:-frequent breaks Scheduling accommodations:-several sessions per day, time of day, administering the test over several days. Presentation Accommodations: reading test aloud to himself, TA signing directions, TA highlighting key words, etc. If accommodations are on the IEP and NOT listed in the Test Administration Manual….. o Contact Beckie and/or Jean o Courtney Mills, Director of Academic Programs 95% participation requirement is based on: o First day of testing (FDT) data o Students not tested (SNT) data o Medically unable to attend school or receive instruction o Homebound and physically or mentally unable to test o Expulsion o Withdrawal o Death of the student or a family member **All students not tested must have a reason entered in PowerSchool, even if the reason does not qualify for an exclusion. For example, parent or student refusal to test. o Every subgroup of at least 30 students Test Participation o o o If a student is enrolled on the first day of testing, he or she MUST take the test The goal is 95% participation overall and in every subgroup (gender, ethnicity, SES, etc.) Applies to the new assessments in ELA & Math Test Performance o o New Assessments (ELA/Math): Students’ scores only count if they are enrolled continuously from the 45th day through the first day of testing EOC (Bio & USH): Every score counts o Data will be extracted on or about the first day of each test o Student enrollment must be up-to-date o Accountability implications If a student misses any portion of PASS, NCSC, SC-Alt or the new accountability exams that he or she was supposed to take, you must complete the SNT fields on the Precode page. o If a student withdraws MORE THAN one week prior to testing, he must be properly withdrawn in PowerSchool before the first day of testing. o If a student withdraws LESS THAN one week prior to testing, and you properly withdraw him in PowerSchool before the first day of testing, there is nothing else you need to do. o If a student withdraws LESS THAN one week prior to testing, and you do NOT withdraw him in PowerSchool before the first day of testing, then you must complete the SNT fields for that student. ELA/Math o 2015-16: Teach and assess SC College-and Career-Ready Standards Science o 2015-16: Phase-in of 2014 standards continues o 2015-16: Assess 2005 standards o 2016-17: New standards will be assessed Social Studies o 2015-16: Teach & assess 2011 standards True Grade o Make sure the True Grade Field is BLANK for all students! Effect on Accountability o Students are expected to test based on their true grade. o There are consequences for incorrectly coding this field, including reduced participation rates or incorrect performance rates if students take the incorrect grade-level assessment, or reduced graduation rates if a high school student’s 9GR conflicts with the true grade. o Students are classified by the Instructional Setting field in PowerSchool o Will include more students o Some schools may now have a large enough subgroup to count. Jean Epps Coordinator of Assessment o o o o o jepps@sccharter.org 803-734-0117 Test administration Test security/violations Precode Courtney Mills Coordinator of Academic Programs o o o o o cmills@sccharter.org 803-734-0525 Accountability Questions First day of Testing Students Not Tested