CoAlt: Science & Social Studies Administration Training 12 th Grade 2014-2015 Training Overview and Purpose Preparing for Testing Accommodations Administration After Testing 2 Overview Eligibility What is CoAlt What is different Standardization 12 th Grade CoAlt Science/Social Studies Purpose The Colorado Alternate Assessment (CoAlt) is a standards-based assessment designed specifically for eligible students with significant cognitive disabilities. The primary purpose of the assessment program is to determine the level at which Colorado students with significant cognitive disabilities meet the Extended Evidence Outcomes (EEOs) of the Colorado Academic Standards in the content areas of science and social studies. 4 Alternate Standards and Assessment Eligibility Criteria Worksheet Eligibility is determined by the IEP team 1 st Determine Academic Standard 2 nd Determine Assessment Patrick McGinty 720-423-3361 CoAlt: S & SS Standards-based assessment Measures students progress towards the Extended Evidence Outcomes of the Colorado Academic Standards Provides a picture of student performance Indicates individual student progress towards the academic content areas of Science and Social Studies 6 CoAlt: S & SS What is different: The student is presented with three answer options rather than four. The student will work with the test item until they provide the correct answer or the maximum number of attempts is reached. The scoring rubric incorporates the level of independence and answer, which will no longer be collected as two separate score points. 7 CoAlt: S & SS CoAlt Test Examiners may not reword prompts, but must follow the script exactly as written. A cue for the student to engage is included as the additional prompt, and will no longer need to be created by the CoAlt Test Examiner. CoAlt Test Examiners may mark student scores on the score recording form or in the test book, but final student scores must be entered online via PearsonAccess. 8 CoAlt: S & SS CoAlt Assessment Test Book Layout Item types 9 Selected Response – 26 Items Supported Performance Tasks – 4 Items Standardized This means… all students will have the same test content, resources, directions, testing conditions, and rating procedures one score obtained by one student in a part of Colorado will mean the same as the same score obtained by another student in another part of Colorado There is flexibility in the assessment within the standardization through the use of CoAlt Accommodations 10 2014 Test Window November 3 – November 21 Grade 12 Science and Social Studies CoAlt Testing Lists are available in School Folders 11 Preparing for the Assessment Preparing Students Before Testing Scheduling Environment Security / Chain of Custody Ethics Test Examiner Qualifications Score Monitor Materials Test Examiner Before Testing Preparing students for the CoAlt Academic Content Standards Extended Evidence Outcomes Curriculum Instruction and Practices 13 Alternate Assessment Preparing students for the CoAlt Administer available sample items from CDE website at http://www.cde.state.co.us/assessment/newassess-coaltsss Help students approach testing in a relaxed positive way Encourage student to put forth their best efforts Ask the student if they have other needs prior to beginning testing 14 Scheduling Read through Examiner’s Manual Preparation of Accommodations/Task Manipulatives Read through Items Cut out task manipulatives Individual administration (Only Test Examiner and Student in Testing Environment) No time limits or restrictions on time Allow time for breaks Breaks May be taken at any time Must complete the item the student started Return to the next item 16 Environment Space for giving the assessment Remove or cover reference materials Adequate lighting Adequate work space Distraction free CoAlt Science and Social Studies is a one-on-one Assessment between the Student and Test Examiner. No one else is allowed in the testing environment unless they have been trained annually Space for storing accommodations These are secure materials and must be 17 returned to SAL once testing is complete each day Security The following items must be secured: Item Protocols Student Materials Manipulatives/Option Cards Accommodated student materials Score recording form 18 Documented Chain of Custody The SAL is responsible for the distribution and collection of CoAlt: S & SS materials to and from test examiners immediately before testing and after testing on a daily basis. Test materials must not be stored in classrooms. CoAlt: S & SS accommodated materials must be returned to the SAL and secured with the other assessment materials. Only materials for the student being assessed at the time should be distributed. 19 Documented Chain of Custody Due to the unique nature of the CoAlt Assessments, Test Examiners will need access to a student’s materials prior to the test administration in order to prepare any necessary accommodations and manipulatives\option cards for the Supported Performance Tasks. 20 Ethics It is a breach of professional ethics for school personnel to provide verbal or nonverbal clues or answers, teach items on the test, share writing prompts, coach, hint or in any way influence a student’s performance during the test administration. 21 Test Examiner Test examiner must be a certified educator Test examiner should be the person who knows the student best Test examiners must be trained annually Para professionals may be present but may not administer the assessment and must be trained Anyone in the assessment environment must be trained annually 22 Materials Examiner’s Manual One shrink wrapped packet per student CoAlt test book Secure return envelope Task Manipulatives/Option Cards Secure Return Form Score Recording Form Student Response Form Test Security Form 23 SAMPLE TEST LAYOUT Examiner’s Manual – Page 9 a. Please turn to Page 9 in the Examiner’s Manual for the Sample Test Layout. b. Sample items are available at http://www.cde.state.co.us/assessment/CoAltItems.asp. CoAlt Test Examiners are encouraged to administer the sample item(s) available to students to prepare them for testing. 24 Test Examiner or SAL Before Testing Write the student’s full name on the cover of the test book Write the student’s full name, teacher’s name, school name and district name with a black marker on the secure return envelope Cut apart the option cards for each performance task Paper clip the cut-apart option cards to the corresponding student response page, then store them in the secure return envelope 25 Test Examiner Before Testing Read through the items and consider the specific needs of the student Review the EEOs (Extended Evidence Outcomes of the Colorado Academic Standards) being assessed Identify and secure any accommodations keeping the accommodations with the test materials at all times and given to Site Assessment Leader before and after testing each day 26 Accommodations Accommodations What does the student need to access the assessment? What is being measured? Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 29 Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 30 Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 31 Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 32 Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 33 Accommodations The student facing pages of test items may need to be adapted. Size Color Contrast levels Dimension Assistive technology Tactile 34 Accommodations The picture symbols/ icons provided in the CoAlt assessment should be used, except in the following circumstances: The student needs to use objects rather than pictures The student needs pictures of real objects rather than drawings The student has a personal lexicon with a specific representation for the concept or words in the student answer choices – in this case, all answer choices must be from the student’s personal lexicon Remember Accommodations used during instruction should be the accommodations used during assessment as long as they do not invalidate what is being measured. 36 Selected Response Administration 37 Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Alternate Prompt Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Selected Response Notice no repeating of the prompt. Activity 1 Find a partner and determine who will be the teacher and who will be the student. Administer Selected Response Released Item 57 Supported Performance Task Administration 58 Supported Performance Tasks Supported Performance Tasks Positive Consequences Negative Consequences Supported Performance Tasks Supported Performance Tasks Positive Consequences Negative Consequences Supported Performance Tasks Supported Performance Tasks Positive Consequences Negative Consequences Supported Performance Tasks Supported Performance Tasks Positive Consequences Negative Consequences Activity 2 Find a partner and determine who will be the teacher and who will be the student. Administer Supported Performance Task Released Item PearsonAccess Test Administration Video available at: http://www.pearsonaccess.com/cs/Satellite?c=Page&childpagename= Colorado%2FcoPALPLayout_v2&cid=1205794393634&pagename=co PALPWrapper&resourcecategory=Training After testing Entering Scores Test Examiner Returning Materials Site Assessment Leader Returning Materials Score Reports Scoring Enter scores into PearsonAccess Districts set up user accounts Karen Lutz – create teacher permissions in PearsonAccess Pearson emails original username/password Teachers choose password Scoring 1. 2. 3. 4. Log in to PearsonAccess with User ID Click on the Online Score Entry tab Verify Test Click on Enter Scores Scoring 5. Verify Current Organization is School Scoring 6. Click on name of the student in the box on the side 7. Select test Scoring 8. Enter form number 9. Enter accommodations for the student IEP Used Scoring 10. Enter student answers Each item needs to have a response Scoring 11. Answer Validity Questions How familiar are you with this student? Very familiar, somewhat familiar, familiar, somewhat unfamiliar, unfamiliar How many hours per week does this student spend in instruction on this content area? <1 hour, 1 to < 2 hours, 2 to <3 hours, 3 to < 4 hours, 4 to < 5 hours, >= 5 hours, Do not know Approximately how much of instructional time for this content area is in the general education classroom? 25%, 50%, 75%, 100%, none This student’s primary receptive communication is: oral language (spoken or sign), reading, picture communication (including symbol systems), tactile (tactile graphics or braille), other, do not know Scoring 11. Answer Validity Questions This student primary expressive communication is: oral language (spoken or sign), writing, picture communication (including symbol systems), tactile (tactile graphics or braille), other, do not know I feel that the student’s responses accurately reflect their understanding of the material. Strongly agree, agree, neutral, disagree, strongly disagree, do not know How much time did this student take on the assessment? [# minutes] (Test Examiner must keep track of start and stop time during test administration in order to accurately answer question) Scoring 11. Click Save Not Started In Progress Completed Test Examiner Returning Materials Test Examiner returns all testing materials to the Site Assessment Leader Test Examiner returns the following to the Site Assessment Leader in the unsealed secure return envelope. Task manipulatives Score recording forms Security form (One Security Form per Student’s Materials) 78 SAL Returning Materials Check materials to ensure all materials for the school have been 79 returned Security forms CoAlt secure materials envelope Ensure all scores are entered into PearsonAccess All sessions are in Completed status All enrolled students are accounted for Group materials: Secure return envelopes Used test books Unused test books Accommodated materials Sign the Certification Form Return materials to DAC Score Reports The same time as CMAS: Science and Social Studies score reports. Summer 2015 80 CoAlt Contacts Karen Lutz Assessment, Research and Evaluation 720-423-3020 karen_lutz@dpsk12.org Patrick McGinty Special Education Department 720-423-3361 patrick_mcginty@dpsk12.org CoAlt Training Congratulations! You have completed CoAlt Science and Social Studies Training. You will receive the Certificate of Completion, pay for 2 hours and your CoAlt Test Materials during the week of October 27th.