If you have never logged onto TELPAS online training,
(https://tx.scoring.pearsonassessments.com/scoring/), you must self register. The code is
training2016.
Be sure to choose Region -10 Richardson and select our district. Feb 12-Deadline for teachers who
will serve as verifiers should have completed online training. (Verifiers can not serve as raters)
Feb 15- Online calibration window for ALL teachers scheduled to rate TELPAS rating samples.
Calibrations must be completed individually and in a monitored setting.
Feb 16- Writing Samples for TELPAS writing collections may begin.
March 7-April 1- TELPAS Reading Assessment Window.
April 4-6- Campus Test Coordinator check and update “resolution required” status in Pearson Access
Next
Rater Manual
Page 1
General Information about TELPAS
The assessment components for grades K–1 and 2–12 include the following:
■ Grades K–1
holistically rated observational assessments of listening, speaking, reading, and writing
■ Grades 2–12
multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, and 10–12
holistically rated student writing collections
holistically rated observational assessments of listening and speaking
Students’ answers to the reading tests, ratings from the holistically rated assessments, and all other
student data are submitted through the TELPAS Assessment Management System.
The instructions in this manual explain the responsibilities of raters for the spring 2016
Rater Manual
Page 9
Rater Credentials
•
have the student in class at the time of the spring assessment window;
•
be knowledgeable about the student’s ability to use English in
instructional and informal settings;
•
hold valid education credentials such as a teacher certificate or permit;
•
be appropriately trained in the holistic rating process as required by the
TELPAS administration materials in accordance with 19 TAC, Chapter
101; and
•
rate the student in all eligible language domains
** How I set up TELPAS as a campus TC (LEP population 550)
Raters- 4th period teachers:
All 4th period core teachers will serve as TELPAS raters
All students will complete five samples in their 4th class
There will be one sample based on a topic from each content area.
Pod leaders will receive an excel list with your pod’s LEP student roster. Please distribute
copies to your team.
After all five samples have been completed, teacher will separate the LEP student packets and
alphabetize them (if a student is absent, please ensure they complete the missed sample before
submitting samples). Do NOT throw away ANY student samples until the TELPAS window has
closed in case a LEP student was mistakenly left off the main database.
The following Monday, pods will meet to combine and alphabetize your pod’s LEP packets
and turn all pod LEP packets in to LPAC chair, using the LEP list provided to you.
Rater Manual
Page 21
Verifiers can not serve as raters.
Verifiers should complete the “Assembling and Verifying”
online training.
The writing collection verifier must complete the verification checklist in Appendix C to
ensure that
■ each collection contains at least five total writing samples;
■ each writing collection includes at least one sample that elicits the use of past tense
and at least two academic writing samples from mathematics, science, or social studies;
■ all writing assignments include the student’s name and date;
■ no writing samples collected before February 15, 2016;
■ no papers showing teacher corrections are included;
■ no worksheets or question-answer assignments are included; and
■ each collection includes samples written primarily in English.
Collections that do not meet the requirements will be returned to the rater. Once the
collection meets the above requirements, the verifier will initial and sign the verification
checklist on the reverse side of the writing collection cover sheet. This affirms that the
writing collection has been assembled correctly, as described above.
Elective and sped teachers will verify writing samples
All LEP student packets must have 5 writing samples
and must include at least one narrative about a past event,
and two writing samples from math, science, or SS
Pod 1 & Kirk
66 LEP Students
** Total samples to rate approximately
12 each (Kirk 6 samples)
Verifiers
Akin & Cordova & Pond
Pod 2 & Kirk
64 LEP Students
** Total samples to rate approximately
12 each (Kirk 6 samples)
Verifier
Brisby & Parker
Pod 3
55 LEP Students
** Total samples to rate approximately
11 each (Kirk 6 samples)
Verifier
Williams & Compton
Pod 4 & Fugate
53 LEP Students
** Total samples to rate approximately
10 each (Fugate 5 samples)
Verifier
Brigham & Fajardo
Pod 7, Carroll, Anuwe
73 LEP Students
** Total samples to rate approximately
12 each
Pod 5 & Fugate
56 LEP Students
** Total samples to rate approximately
10 each (Fugate 5 samples)
Verifier
Frederick & O Donnell
Pod 8 & Czapski
53 LEP Students
** Total samples to rate approximately
11 each
Verifier
Cain, Shanks, & Sterling, Wright
Verifier
Hopkins & Powers
Pod 6
46 LEP Students
** Total samples to rate approximately 8
each
Verifier
Graham & Hart
Pod 9 (Mccullar, Hightower only)
20 LEP Students
** Total samples to rate approximately
10 each
Verifier
Horn
**Please see
sample set up. I
attached the
number of
verifiers based
on the number
of LEP students
per “pod”.
Online Basic Training Course (Required for New
Raters)
There are two basic training courses, one for raters of
K–1 students and one
for raters of students in grade 2 or higher (2–12). The
K–1 course covers the
four language domains of listening, speaking, reading,
and writing. The 2–12
course covers listening, speaking, and writing. After
learning the basics of
the holistic rating process, participants practice rating
students as part of the
course. New raters must complete this course before
beginning online
calibration activities. Approximate completion time: 4–
5 hours.
Online Calibration (Required for New and Returning
Raters)
The online calibration activities consist of two sets of
students to be rated.
Each language domain is represented in each set. For
K–1, each set
includes all four language domains—listening,
speaking, reading, and
writing. For 2–12, each set includes listening,
speaking, and writing. Raters
complete only as many sets as it takes to calibrate.
Approximate completion
time per set: 1-2 hours.
Rater Manual
Page 13
Returning raters who have not completed calibration
activities within the last three school years are
required to complete the online basic training course
before calibrating.
Online Basic Training
Course
This course is for new raters and raters
who have never completed the online
basic training. Returning raters who
have not completed calibration activities
within the last three school years are
required to complete the online basic
course before calibrating. It provides
instruction on using the PLD rubrics and
gives raters practice rating students in
each language domain. There are
separate courses for K–1 and 2–12.
Once you have completed all modules
in the online basic training course, you
will sign the holistic verification training
log provided by your campus test
coordinator. You may not proceed to
calibration until you have completed the
online basic training course and been
assigned to a monitored calibration
session by your campus.
Online Calibration
Online calibration must be completed
by ALL raters, both new and returning,
in a monitored setting. Raters use the
PLDs to rate students in each language
domain. Raters have two opportunities
to calibrate on assigned grade cluster.
Failure to pass calibration will not
excuse you from rating.
For K–1, each set contains 10 students
to be rated. You must rate at least 70
percent of the students correctly within
a set to demonstrate sufficient
calibration.
For all other grade clusters, each set
contains 12 students to be rated. You
must rate at least 67 percent of the
students correctly within a set to
demonstrate sufficient calibration.
•
Raters must know their assigned grade cluster to select the appropriate online training.
•
Raters should consult with their campus coordinator if they are unsure of their assigned cluster.
Elementary Grade Clusters



Grades K–1
Grade 2
Grades 3–5
Secondary Grade Clusters


Grades 6–8
Grades 9–12
•
Raters must begin with calibration set 1. If successful, a certificate will be available in the
scoring summary tab of the TELPAS Online Training Center. The certificate should be printed
and turned in to the proctor.
•
If raters are unsuccessful on set 1, they will be notified by testing coordinator when monitored
session for set 2 will be held.
•
After completing a calibration set, raters immediately see results and annotations explaining the
correct ratings.
•
Raters will need 1-2 hours to complete a calibration set. Raters must finish a calibration set
once it is started. They will not be able to save their progress and return later to complete the
set.
TEA Slide 23 and 24
Yes, raters should use their rating rubrics (PLDs) and TELPAS Rater Manual, as needed.
Any notes taken during calibration should be done on the scratch
paper provided and not in the TELPAS manual. At the end of each
calibration session, all notes taken by raters must be turned into the
proctor and destroyed.
Two outcomes are possible for individuals who complete the calibration activities but are not
successful:

The district may choose not to assign the individual to be a TELPAS rater.

If the individual is needed to serve as a rater, the district must implement rater support
procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics.
Individuals are not authorized to serve as raters unless
they complete all required training components.
TEA Slide 15
•
•
Once you have completed all modules in the online basic training course, you will sign the
holistic verification training log provided by your campus test coordinator.
After you have successfully calibrated, go to the scoring summary tab of the TELPAS
Online Training Center to access a certificate. Print a copy and turn it in to the session
proctor.
TEA Slide 16
It is a violation of state assessment
procedures to share or discuss
answers to the rating
practice activities with individuals
who have not yet completed the
course. TELPAS
testing violations must be reported
as indicated in the “Test Security
and Confidentiality
Requirements” section at the front
of this manual.
All student writing samples must
have the cover sheet listed below.
All information must be
completed
Rater Manual
Appendix
Each rater will need to complete a Student
Rating Roster Sheet. The rater must complete
Student Name, grade level, rating, rater
information, and appropriate signatures
•
Writing assigned on or after February 15, 2016 may be considered.
•
Writing samples may continue to be gathered until the date designated by the district as the
deadline for completing the collections in order to submit the ratings.
•
At least 5 total samples are required in each collection.
•
In each collection there must be
•
- at least 1 writing sample that elicits the use of past tense
•
- at least 2 writing samples from math, science, or social studies
TEA 19
Rater Manual
Page 20
•
•
•
•
•
•
•
Papers containing copied language
Papers in which student relies heavily on resources (dictionary, thesaurus, etc.)
Papers showing teacher comments and corrections
Worksheets and question-answer assignments
Papers that have been polished with help from peers or teachers
Papers written primarily in student’s native language
Papers that are brief, incomplete, or rushed
TEA 20
TELPAS Heading
Print LAST name ________________
Print FIRST name ________________
4th period Teacher ________________________Grade ______
Pod _____
Student ID____________
Date____________
Rater Manual
Pages 17-20
Subject LA:
Eleanor Roosevelt once said, "You
must do the thing you think you
cannot do." Write a narrative about a
time when you did something you
thought you could not do.
Subject Social Studies:
If there was one law you could
change, which law would it be and
why?
Subject Science:
Explain the scientific method.
In your explanation, be sure to include
the following:
• the steps of the scientific method
• different types of variables
• purpose of the steps
Subject Math:
Write a paragraph to explain the data
in the graph.
Subject Reading:
Think about a story you have read.
Describe one of the main characters in
the story. Discuss the character’s
motivations and how the author uses
the character in the story to express a
message. Support your ideas with
examples and details from the story.
You will need a TELPAS manual.
Please use rubric in manual to score student papers.
Teachers assigned to assist with pods should sit with that pod and pick their samples first.
Before beginning to rate, ensure all student samples for your pod have been assigned to a rater.
On the TELPAS Student rating Roster sheet, list the names of the students you will rate, along with
their grade level.
You must rate a student in all areas (Listening, Speaking, and Writing).
Enter the rater information (See Key at bottom of page)
Sign and Date (bottom left corner of page)
If you require an additional rater, the person must sign and date under additional rater.
Once you are done rating your samples, return folders to pod leader.
Your rating sheet will be given to Ms. Gibbons, campus TC
Pod Leaders will return all folders to Mr. Yanez, LPAC chair
Rater Manual
Page 21
Pages 31-35
Rubrics for each
domain: listening,
speaking, reading and
writing began on
page 31 of the rater
manual.
Once all writing samples have been
collected, TELPAS online reading
begins March 7.
Online reading groups will be set up
by pods.
We will try to run three labs.
We will approximately 550 LEP
students to rate and complete the
online reading.
Please sign your oath as
rater or verifier. Be sure to
sign the appropriate oath
based on your TELPAS role.
Thank you for your time and
attention!