Preparing for Testing April 15-June 15 and June 16-July 31 Joe Dell Brasel, Ed.D. Principal Consultant ACT Atlanta Office joedell.brasel@act.org Jennifer Stafford, Policy Advisor Office of Assessment & Accountability Kentucky Department of Education jennifer.stafford@education.ky.gov Agenda Testing Windows and Sessions Responsibilities and Deadlines Accommodations Exemptions Materials Return Shipping Prohibited/Acceptable Materials Online Testing Grading Scale Resources 1 Three Sessions Three separate EOC sessions ~ Multiple Choice 1 (Paper or Computer) ~ Multiple Choice 2 (Paper or Computer) ~ Constructed Response (Paper) Sessions are 45 minutes each ~ Paper sessions are timed by the test administrator. ~ Computer sessions are timed automatically by the computer. 2 Testing Sessions Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. Note: A 10-15 minute break is allowed between test sessions. 3 Traditional Test Windows/Options Includes Paper and Computer Testing Five EOC test windows per year ~ October 1-November 15 ~ December 1-January 15 ~ February 1-March 15 ~ ~ April 15-June 15 June 16-July 31 Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. Within the 10-day window, schools choose option of 1 day or 2 consecutive days per content area. ~ Option A (1 Day): 1 day for MC1/MC2 and CR ~ Option B (2 Days): 1 day for MC1/MC2; 1 day for CR ~ May schedule multiple content tests on same day. Note: MC1 and MC2 must be given in order on the same day. 4 Test Window Example for Option A Testing window ~ April 15-June 15 Two week window ~ April 16-27 One day for each subject ~ ~ ~ ~ April 16: English II April 17: Algebra II April 18: Biology April 19: U.S. History *Make-up sessions after the original test date within April 16-27. 5 Test Window Example for Option B Testing window ~ April 15-June 15 Two week window ~ April 16-27 Two days for each subject ~ ~ ~ ~ April 16, 17: English II April 18, 19: Algebra II April 23, 24: Biology April 25, 26: U.S. History *Make-up sessions after the original test date within April 16-27. 6 Feedback from Stakeholders For the Non-Traditional Setting More flexibility needed Students in Non-Traditional Settings may finish at various times throughout the year Impossible to test all non-traditional students in the 10-day window Testing should work to support students in alternative pathways 7 Non-Traditional Test Window/Options Five EOC test windows per year ~ ~ ~ October 1-November 15 December 1-January 15 February 1-March 15 ~ April 15-June 15 ~ June 16-July 31 Within each window, schools choose one day or two consecutive days per student(s) to complete sessions. ~ Option A (1 Day): 1 day for MC1/MC2 and CR ~ Option B (2 Days): 1 day for MC1/MC2; 1 day for CR May schedule multiple content tests on same day. Note: MC1 and MC2 must be given in order on the same day. 8 More Flexible Test Process for Non-Traditional Settings Flexible test process will be used for the remaining EOC windows in 2011-12. The focus is on creating test schedules for individual students as each student completes the course. WebEx Training, EOC Traditional and Non-traditional testing, October 31, 2011 KDE Website: http://www.education.ky.gov/kde/instructional+resources/curriculum+documents+and+resour ces/kde+-+webex+information+and+resources.htm 9 Traditional vs. Non-Traditional? High Schools with only Traditional Courses: Use School’s 10-day window Alternative Schools with only NonTraditional Courses: Use State’s broader window Schools with both Traditional and NonTraditional Courses: Use both school’s 10-day and State’s broad window 10 Steps for Ordering Confirm Unit Usage Create/Upload Users & Teachers Create/Upload Students Create Class Test Rosters *Finalize Class Rosters Note: Valuable Resources are located at: www.act.org/stateservices/kentucky 11 Responsibilities District or School Administrator: Conduct Administration Code and Inclusions Training Confirm Unit Usage per school ~ Determine Paper or Computer Testing ~ Estimate Number of Students Testing – No automatic overage. DAC/BAC should order additional tests per school. ~ Determine Testing Dates Create/Upload Students (i.e. roster) 12 Create and Upload Students Quality Core Student Template must be populated. Report in IC to pull all high school students: Under KY State Reporting -> KDE Reports -> EOC Assessment. Directions After selecting the school from the menu bar, select Generate Report. When given the option to Save or Open the file, choose Open. Save the file with the .xls extension. According to ACT, staff must paste the results of the report in the template provided by ACT before uploading the information. For questions, please contact Lisa McKinney at (502) 564-2020 or lisa.mckinney@education.ky.gov 13 Responsibilities School Administrator: Create Class Roster Name: ~ Name by school, class, teacher, and period – i.e. CCHS, Algebra II, C. Greer, period 5 ~ Separate class roster for extended time School Administrator or Teacher: Finalize Class Rosters ~ Verify all students to be tested are on roster ~ No roster in SDRR at this time ~ Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. ~ Create seating chart 14 Before Form Change Confirm Unit Usage When the Test Form Changes All end 2012-03-31 During Form Change After Form Change 15 Target Dates Deadlines for April 15 –June 15 End-of-Course Testing Begin Testing the Week of: April 16 Confirm Unit March 5 Usage Create/Upload Users & Teachers April 23 April 30 May 7 May 14 May 21 May 28 June 4 June 11 March 5 March 5 March 12 March 19 March 26 April 2 April 9 April 16 Should be Complete Create/Upload Students March 5 March 12 March 19 March 26 April 2 April 9 April 16 April 23 April 30 Create Class Test Rosters March 12 March 19 March 26 April 2 April 9 April 16 April 23 April 30 May 7 *Finalize Class Rosters March 19 March 26 April 2 April 9 April 16 April 23 April 30 May 7 May 14 *Finalize Class Rosters must be completed four (4) weeks prior to testing. Other dates are targets for workload management. 16 Target Dates Deadlines for June 16–July 31 End-of-Course Testing Begin Testing the Week of: June 18 Confirm Unit Usage April 23 June 25 July 2 July 9 July 16 July 23 July 30 April 30 May 7 May 14 May 21 May 28 June 4 Create/Upload Users & Teachers Create/Upload Students Should be Complete May 14 May 21 May 28 June 4 June 11 June 18 Create Class Test Rosters May 14 May 21 May 28 June 4 June 11 June 18 June 25 *Finalize Class Rosters May 28 June 4 June 11 June 18 June 25 July 2 May 7 May 21 *Finalize Class Rosters must be completed four (4) weeks prior to testing. Other dates are targets for workload management. 17 Accommodated Testing Paper Only R = Reader A = Audio B = Braille LP = Large Print Scribe English 10 Readers Approved - 2011-2012 No Readers - 2012 and beyond Paper and Computer Extended Time Paraphrasing Manipulative Prompting/Cueing Behavior Modification Interpreter (sign language) Dictionaries/Thesauri 18 Ordering Accommodated Test Materials April 15-June 15 Order Accommodated Materials by: Begin Testing the Week of: Accommodations Order April 16 April 23 April 30 May 7 May 14 May 21 May 28 June 4 June 11 March 19 March 26 April 2 April 16 April 23 May 7 May 14 April 9 April 30 This includes ordering of reader scripts. Fax Form to QualityCore Customer Services Form available at: http://www.act.org/stateservices/kentucky/accommodations.html 19 Ordering Accommodated Test Materials June16-July 31 Order Accommodated Materials by: Begin Testing the Week of: June 18 June 25 July 2 July 9 July 16 July 23 July 30 Accommodations Order May 21 May 28 June 4 June 11 June 18 June 25 July 2 This includes ordering of reader scripts. Fax Form to QualityCore Customer Services Form available at: http://www.act.org/stateservices/kentucky/accommodations.html 20 Exemption Types Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. Extraordinary Circumstance (Other Exemption) choice has open field to enter information. For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE web site and in the Forms section of the DAC/BAC. 21 Exemption Information Student identifying information Name 1. Keep paper form on-file in SSID the district. Grade 2. Enter information Gender electronically into SDRR. DOB School Name An Exemption Request is NOT Test Type automatically approved. Exemption Type Explanation of Medical or Extraordinary issue Relevant dates 22 Receiving/Storing Materials Shipment going to DACs will be identified with course name, school and BAC’s name for easy distribution Check shipment contents ~ Store Testing Boxes SECURELY – Test Booklets LOCKED storage ~ Miscellaneous Boxes – Two Answer Folders (MC1/MC2 and CR) – Pre-ID Labels – Reference Sheets--Algebra II – Test Supervisor’s Manual (MC), Room Supervisor’s Manual (one per 25 students (MC)), and Constructed Response Supervisor’s Manual Discrepancies— Call – School Header (866)764-7228 – Group Header 23 Supplemental Order Process Email: qualitycoreOM@act.org Quantity needed per course See example below: MASON COUNTY SCHL DIST MASON COUNTY HIGH SCHOOL Biology suborder 8233 10 tests Eng 10 suborder 8232 4 tests April 16– April 27 24 Seating Chart 25 Group Headers Two per class, per teacher ~ One for MC1/MC2 and one for CR Example: If Ms. Jones has 3 Algebra II classes, there will be 6 separate Group Headers. 3 MC Group Headers 3 CR Group Headers 26 27 Information for Group Headers 28 Completing Group Headers Test Roster Name (Block B) 29 Completing Group Headers Assignment ID (Block D) 30 Pre-ID Labels Arrive in Miscellaneous Box(s) One per student answer folder ~ MC1/MC2 ~ CR Errors on label Do not edit Make corrections online within class roster No Label Add new students online 31 Answer Document and Labels Affix label to answer folder. Do not bubble student information 32 Answer Document and No Label Student On Roster: ~ If student is on the roster, click on the name to locate QualityCore ID. Complete boxes A thru D on answer document.* Student Not On Roster: ~ Add student to roster from User Student List.** ~ Complete boxes A thru D on answer document. **Student’s name must be gridded on answer document exactly as shown on roster. **If units not available, contact DAC to have more units allocated to your school. 33 Answer Document and Not Included on Student Template Student Not Included on Student Template: Student must be created/uploaded into online system ~ Create new Student User on Site Administration page ~ Add student to roster ~ Complete boxes A through D on answer document. NOTE: Before testing, each student must have a QualityCore ID and listed on the roster. 34 No label Bubble student information 35 Return Shipping: Group Headers Group Header 2 Group Header 1 CR English 10 MC/MC English 10 36 Return Shipping Packing Envelopes KDE and ACT recommend return shipping from the school. ~ Used Answer Documents (MC1/MC2 and CR) ~ Testing Irregularity Report – Instructions on pages 12-17 of Test Supervisor’s Manual Boxes ~ Used and unused tests booklets in the boxes stamped with their course names ~ Unused answer documents and manuals in the boxes stamped “Miscellaneous” – Instructions on pages 12-17 of Test Supervisor’s Manual 37 Irregularities A disturbance or distraction occurs that could affect one or more students’ scores. A student becomes ill and discontinues testing. A student questions or challenges a test item. A student uses unauthorized testing aids. 38 Materials Computer Pencil/Paper Prohibited Notes Foreign language or English dictionary Allowed Scratch Paper-Please collect and destroy securely. Calculators Reference Sheets (Algebra II) Prohibited Scratch paper Notes Foreign language or English dictionary Allowed Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) 39 Online User’s Guide Online User’s Guide or CBT Manual should be accessed through the secure online system. No support materials will be shipped for online testing. 40 Practice Online Testing Coordinate with District Technology Coordinators to verify workstations are ready for online testing CBT Launch Demo PPT QC CBT QuickStart LaunchTest Teachers/Students may use the Launch Demo to practice the system. 41 Locating Launch PPT and Test www.act.org/stateservices/kentucky 42 43 Resources/Manuals 44 Retrieve Codes from System Test Control Code Vanguard Exit Code 45 Student Roster Information Retrieve student login information from Test Roster section of the online system. Print out the Student Login page that contains each student’s QualityCore ID. Teacher or Student will input the student’s information exactly as it is in the online system. QualityCore ID First Name Middle Initial (optional) Last Name Date of Birth (dropdown menu selection) 46 47 Online Testing Student will choose their correct birthdate from the dropdown menu and accept the User’s Agreement. The student has the option of completing a tutorial before beginning the test. 48 Student Login Page 49 Accept User Agreement 50 Complete Login 51 Choose Correct Test 52 Directions 53 Directions (continued) 54 Test Display Time Remaining 55 Student Prompt After Answering 56 Skipping a Question 57 Bookmark a Question 58 Reviewing Online Test Before the student submits a completed test module, a review page will display. This page will list all items on the test, the status of each item (answered, unanswered, or bookmarked), and how much time the student has left to review his/her work. 59 Student Review Page 60 61 Take a Break or End the Test Break 62 Test Control Code 63 Grading Scale Under Review EOC Subject Test EOC Scale Score Link to CPE-College Readiness Benchmark Course Letter Grade F D C B A U.S. History 125-135 136-143 144-147 148-152 153-175 148 English II 125-135 136-143 144-149 150-157 158-175 150 Algebra II 125-135 136-140 141-143 144-148 149-175 144 136-144 145-147 148-152 153-175 148 Biology 125-135 64 Test Security Recent loss of certification for Kentucky educators emphasizes a serious issue. Senate Bill 64 (2012 Kentucky General Assembly) an Act relating to assessment ethics has been filed. authorize prosecution of violations (a prosecuting attorney and the Attorney General may investigate allegations of violations and prosecute violations); require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board. 65 Resources Archived WebEx http://www.education.ky.gov/KDE/Instructional+Resources/C urriculum+Documents+and+Resources/KDE++Webex+Information+and+Resources.htm How-To Website http://www.act.org/qualitycore/how.html Kentucky QualityCore Website www.act.org/stateservices/kentucky 66