If you have never logged onto TELPAS online training, (https://tx.scoring.pearsonassessments.com/scoring/), you must self register. The code is training2016. Be sure to choose Region -10 Richardson and select our district. Feb 12-Deadline for teachers who will serve as verifiers should have completed online training. (Verifiers can not serve as raters) Feb 15- Online calibration window for ALL teachers scheduled to rate TELPAS rating samples. Calibrations must be completed individually and in a monitored setting. Feb 16- Writing Samples for TELPAS writing collections may begin. March 7-April 1- TELPAS Reading Assessment Window. April 4-6- Campus Test Coordinator check and update “resolution required” status in Pearson Access Next Rater Manual Page 1 General Information about TELPAS The assessment components for grades K–1 and 2–12 include the following: ■ Grades K–1 holistically rated observational assessments of listening, speaking, reading, and writing ■ Grades 2–12 multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, and 10–12 holistically rated student writing collections holistically rated observational assessments of listening and speaking Students’ answers to the reading tests, ratings from the holistically rated assessments, and all other student data are submitted through the TELPAS Assessment Management System. The instructions in this manual explain the responsibilities of raters for the spring 2016 Rater Manual Page 9 Rater Credentials • have the student in class at the time of the spring assessment window; • be knowledgeable about the student’s ability to use English in instructional and informal settings; • hold valid education credentials such as a teacher certificate or permit; • be appropriately trained in the holistic rating process as required by the TELPAS administration materials in accordance with 19 TAC, Chapter 101; and • rate the student in all eligible language domains ** How I set up TELPAS as a campus TC (LEP population 550) Raters- 4th period teachers: All 4th period core teachers will serve as TELPAS raters All students will complete five samples in their 4th class There will be one sample based on a topic from each content area. Pod leaders will receive an excel list with your pod’s LEP student roster. Please distribute copies to your team. After all five samples have been completed, teacher will separate the LEP student packets and alphabetize them (if a student is absent, please ensure they complete the missed sample before submitting samples). Do NOT throw away ANY student samples until the TELPAS window has closed in case a LEP student was mistakenly left off the main database. The following Monday, pods will meet to combine and alphabetize your pod’s LEP packets and turn all pod LEP packets in to LPAC chair, using the LEP list provided to you. Rater Manual Page 21 Verifiers can not serve as raters. Verifiers should complete the “Assembling and Verifying” online training. The writing collection verifier must complete the verification checklist in Appendix C to ensure that ■ each collection contains at least five total writing samples; ■ each writing collection includes at least one sample that elicits the use of past tense and at least two academic writing samples from mathematics, science, or social studies; ■ all writing assignments include the student’s name and date; ■ no writing samples collected before February 15, 2016; ■ no papers showing teacher corrections are included; ■ no worksheets or question-answer assignments are included; and ■ each collection includes samples written primarily in English. Collections that do not meet the requirements will be returned to the rater. Once the collection meets the above requirements, the verifier will initial and sign the verification checklist on the reverse side of the writing collection cover sheet. This affirms that the writing collection has been assembled correctly, as described above. Elective and sped teachers will verify writing samples All LEP student packets must have 5 writing samples and must include at least one narrative about a past event, and two writing samples from math, science, or SS Pod 1 & Kirk 66 LEP Students ** Total samples to rate approximately 12 each (Kirk 6 samples) Verifiers Akin & Cordova & Pond Pod 2 & Kirk 64 LEP Students ** Total samples to rate approximately 12 each (Kirk 6 samples) Verifier Brisby & Parker Pod 3 55 LEP Students ** Total samples to rate approximately 11 each (Kirk 6 samples) Verifier Williams & Compton Pod 4 & Fugate 53 LEP Students ** Total samples to rate approximately 10 each (Fugate 5 samples) Verifier Brigham & Fajardo Pod 7, Carroll, Anuwe 73 LEP Students ** Total samples to rate approximately 12 each Pod 5 & Fugate 56 LEP Students ** Total samples to rate approximately 10 each (Fugate 5 samples) Verifier Frederick & O Donnell Pod 8 & Czapski 53 LEP Students ** Total samples to rate approximately 11 each Verifier Cain, Shanks, & Sterling, Wright Verifier Hopkins & Powers Pod 6 46 LEP Students ** Total samples to rate approximately 8 each Verifier Graham & Hart Pod 9 (Mccullar, Hightower only) 20 LEP Students ** Total samples to rate approximately 10 each Verifier Horn **Please see sample set up. I attached the number of verifiers based on the number of LEP students per “pod”. Online Basic Training Course (Required for New Raters) There are two basic training courses, one for raters of K–1 students and one for raters of students in grade 2 or higher (2–12). The K–1 course covers the four language domains of listening, speaking, reading, and writing. The 2–12 course covers listening, speaking, and writing. After learning the basics of the holistic rating process, participants practice rating students as part of the course. New raters must complete this course before beginning online calibration activities. Approximate completion time: 4– 5 hours. Online Calibration (Required for New and Returning Raters) The online calibration activities consist of two sets of students to be rated. Each language domain is represented in each set. For K–1, each set includes all four language domains—listening, speaking, reading, and writing. For 2–12, each set includes listening, speaking, and writing. Raters complete only as many sets as it takes to calibrate. Approximate completion time per set: 1-2 hours. Rater Manual Page 13 Returning raters who have not completed calibration activities within the last three school years are required to complete the online basic training course before calibrating. Online Basic Training Course This course is for new raters and raters who have never completed the online basic training. Returning raters who have not completed calibration activities within the last three school years are required to complete the online basic course before calibrating. It provides instruction on using the PLD rubrics and gives raters practice rating students in each language domain. There are separate courses for K–1 and 2–12. Once you have completed all modules in the online basic training course, you will sign the holistic verification training log provided by your campus test coordinator. You may not proceed to calibration until you have completed the online basic training course and been assigned to a monitored calibration session by your campus. Online Calibration Online calibration must be completed by ALL raters, both new and returning, in a monitored setting. Raters use the PLDs to rate students in each language domain. Raters have two opportunities to calibrate on assigned grade cluster. Failure to pass calibration will not excuse you from rating. For K–1, each set contains 10 students to be rated. You must rate at least 70 percent of the students correctly within a set to demonstrate sufficient calibration. For all other grade clusters, each set contains 12 students to be rated. You must rate at least 67 percent of the students correctly within a set to demonstrate sufficient calibration. • Raters must know their assigned grade cluster to select the appropriate online training. • Raters should consult with their campus coordinator if they are unsure of their assigned cluster. Elementary Grade Clusters Grades K–1 Grade 2 Grades 3–5 Secondary Grade Clusters Grades 6–8 Grades 9–12 • Raters must begin with calibration set 1. If successful, a certificate will be available in the scoring summary tab of the TELPAS Online Training Center. The certificate should be printed and turned in to the proctor. • If raters are unsuccessful on set 1, they will be notified by testing coordinator when monitored session for set 2 will be held. • After completing a calibration set, raters immediately see results and annotations explaining the correct ratings. • Raters will need 1-2 hours to complete a calibration set. Raters must finish a calibration set once it is started. They will not be able to save their progress and return later to complete the set. TEA Slide 23 and 24 Yes, raters should use their rating rubrics (PLDs) and TELPAS Rater Manual, as needed. Any notes taken during calibration should be done on the scratch paper provided and not in the TELPAS manual. At the end of each calibration session, all notes taken by raters must be turned into the proctor and destroyed. Two outcomes are possible for individuals who complete the calibration activities but are not successful: The district may choose not to assign the individual to be a TELPAS rater. If the individual is needed to serve as a rater, the district must implement rater support procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics. Individuals are not authorized to serve as raters unless they complete all required training components. TEA Slide 15 • • Once you have completed all modules in the online basic training course, you will sign the holistic verification training log provided by your campus test coordinator. After you have successfully calibrated, go to the scoring summary tab of the TELPAS Online Training Center to access a certificate. Print a copy and turn it in to the session proctor. TEA Slide 16 It is a violation of state assessment procedures to share or discuss answers to the rating practice activities with individuals who have not yet completed the course. TELPAS testing violations must be reported as indicated in the “Test Security and Confidentiality Requirements” section at the front of this manual. All student writing samples must have the cover sheet listed below. All information must be completed Rater Manual Appendix Each rater will need to complete a Student Rating Roster Sheet. The rater must complete Student Name, grade level, rating, rater information, and appropriate signatures • Writing assigned on or after February 15, 2016 may be considered. • Writing samples may continue to be gathered until the date designated by the district as the deadline for completing the collections in order to submit the ratings. • At least 5 total samples are required in each collection. • In each collection there must be • - at least 1 writing sample that elicits the use of past tense • - at least 2 writing samples from math, science, or social studies TEA 19 Rater Manual Page 20 • • • • • • • Papers containing copied language Papers in which student relies heavily on resources (dictionary, thesaurus, etc.) Papers showing teacher comments and corrections Worksheets and question-answer assignments Papers that have been polished with help from peers or teachers Papers written primarily in student’s native language Papers that are brief, incomplete, or rushed TEA 20 TELPAS Heading Print LAST name ________________ Print FIRST name ________________ 4th period Teacher ________________________Grade ______ Pod _____ Student ID____________ Date____________ Rater Manual Pages 17-20 Subject LA: Eleanor Roosevelt once said, "You must do the thing you think you cannot do." Write a narrative about a time when you did something you thought you could not do. Subject Social Studies: If there was one law you could change, which law would it be and why? Subject Science: Explain the scientific method. In your explanation, be sure to include the following: • the steps of the scientific method • different types of variables • purpose of the steps Subject Math: Write a paragraph to explain the data in the graph. Subject Reading: Think about a story you have read. Describe one of the main characters in the story. Discuss the character’s motivations and how the author uses the character in the story to express a message. Support your ideas with examples and details from the story. You will need a TELPAS manual. Please use rubric in manual to score student papers. Teachers assigned to assist with pods should sit with that pod and pick their samples first. Before beginning to rate, ensure all student samples for your pod have been assigned to a rater. On the TELPAS Student rating Roster sheet, list the names of the students you will rate, along with their grade level. You must rate a student in all areas (Listening, Speaking, and Writing). Enter the rater information (See Key at bottom of page) Sign and Date (bottom left corner of page) If you require an additional rater, the person must sign and date under additional rater. Once you are done rating your samples, return folders to pod leader. Your rating sheet will be given to Ms. Gibbons, campus TC Pod Leaders will return all folders to Mr. Yanez, LPAC chair Rater Manual Page 21 Pages 31-35 Rubrics for each domain: listening, speaking, reading and writing began on page 31 of the rater manual. Once all writing samples have been collected, TELPAS online reading begins March 7. Online reading groups will be set up by pods. We will try to run three labs. We will approximately 550 LEP students to rate and complete the online reading. Please sign your oath as rater or verifier. Be sure to sign the appropriate oath based on your TELPAS role. Thank you for your time and attention!