February 8-11, 2016
•
•
SNA Website Updates
Test Security
Rater Manual
Page 1
General Information about TELPAS
The assessment components for grades K–1 and 2–12 include the following:
■ Grades K–1
holistically rated observational assessments of listening, speaking, reading, and writing
■ Grades 2–12
multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, and 10–12
holistically rated student writing collections
holistically rated observational assessments of listening and speaking
Students’ answers to the reading tests, ratings from the holistically rated assessments, and all other
student data are submitted through the TELPAS Assessment Management System.
The instructions in this manual explain the responsibilities of raters for the spring 2016.
Rater Manual
Page 9
•
•
•
•
•
Have the student in class at the time of the spring assessment
window;
Be knowledgeable about the student’s ability to use English in
instructional and informal settings;
Hold valid education credentials such as a teacher certificate or
permit;
Be appropriately trained in the holistic rating process as required by
the TELPAS administration materials in accordance with 19 TAC,
Chapter 101; and
Rate the student in all eligible language domains.
Rater Manual
Page 21
Verifiers can not serve as raters.
Verifiers should complete the “Assembling and Verifying”
online training.
The writing collection verifier must complete the verification checklist in
Appendix C to ensure that
Collections that do not meet the requirements will be returned to the rater.
Once the collection meets the above requirements, the verifier will initial and
sign the verification checklist on the reverse side of the writing collection
cover sheet. This affirms that the writing collection has been assembled
correctly, as described above.
Online Basic Training Course
This course is for new raters and raters
who have never completed the online
basic training. Returning raters who
have not completed calibration
activities within the last three school
years are required to complete the
online basic training course before
calibrating. It provides instruction on
using the PLD rubrics and gives raters
practice rating students in each
language domain. There are separate
courses for K–1 and 2–12.
Once you have completed all
modules in the online basic training
course, you will sign the holistic
verification training log provided by
your campus test coordinator. You
may not proceed to calibration until
you have completed the online basic
training course and been assigned to a
monitored calibration session by your
campus.
Online Calibration
Rater Manual
Page 13
Online calibration must be completed
by ALL raters, both new and returning,
in a monitored setting. Raters use the
PLDs to rate students in each language
domain. Raters have two opportunities
to calibrate on assigned grade cluster.
Failure to pass calibration will not
excuse you from rating.
For K–1, each set contains 10 students
to be rated. You must rate at least 70
percent of the students correctly within
a set to demonstrate sufficient
calibration.
For all other grade clusters, each set
contains 12 students to be rated. You
must rate at least 67 percent of the
students correctly within a set to
demonstrate sufficient calibration.
•
Raters must know their assigned grade cluster to select the appropriate online training.
•
Raters should consult with their campus coordinator if they are unsure of their assigned cluster.
Elementary Grade Clusters



Grades K–1
Grade 2
Grades 3–5
Secondary Grade Clusters


Grades 6–8
Grades 9–12
•
Raters must begin with calibration set 1. If successful, a certificate will be available in the
scoring summary tab of the TELPAS Online Training Center. The certificate should be printed
and turned in to the proctor.
•
If raters are unsuccessful on set 1, they will be notified by testing coordinator when monitored
session for set 2 will be held.
•
After completing a calibration set, raters immediately see results and annotations explaining the
correct ratings.
•
Raters will need 1-2 hours to complete a calibration set. Raters must finish a calibration set
once it is started. They will not be able to save their progress and return later to complete the
set.
TEA Slide 23 and 24
Yes, raters should use their rating rubrics (PLDs) and TELPAS Rater Manual, as needed.
Any notes taken during calibration should be done on the scratch
paper provided and not in the TELPAS manual. At the end of each
calibration session, all notes taken by raters must be turned into the
proctor and destroyed.
Two outcomes are possible for individuals who complete the calibration activities but are not
successful:

The district may choose not to assign the individual to be a TELPAS rater.

If the individual is needed to serve as a rater, the district must implement rater support
procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics.
Individuals are not authorized to serve as raters unless
they complete all required training components.
TEA
14
•
•
Once you have completed all modules in the online basic training course, you will
sign the holistic verification training log provided by your campus test coordinator.
After you have successfully calibrated, go to the scoring summary tab of the TELPAS
Online Training Center to access a certificate. Print a copy and turn it in to the session
proctor.
TEA Slide 16
It is a violation of state assessment
procedures to share or discuss
answers to the rating
practice activities with individuals
who have not yet completed the
course. TELPAS
testing violations must be reported
as indicated in the “Test Security
and Confidentiality
Requirements” section at the front
of this manual.
All student writing samples must
have the cover sheet listed below.
All information must be
completed.
Rater Manual
Appendix
Each rater will need to complete a Student
Rating Roster Sheet. The rater must complete
Student Name, grade level, rating, rater
information, and appropriate signatures
•
•
•
•
•
•
•
Each collection contains at least five total writing samples;
Each writing collection includes at least one sample that
elicits the use of past tense and at least two academic
writing samples from mathematics, science, or social
studies;
All writing assignments include the student’s name and
date;
No writing samples collected before February 15, 2016;
No papers showing teacher corrections are included;
No worksheets or question-answer assignments are
included; and
Each collection includes samples written primarily in
English.
TEA 18
Rater Manual
Page 20
•
•
•
•
•
•
•
Papers containing copied language
Papers in which student relies heavily on
resources (dictionary, thesaurus, etc.)
Papers showing teacher comments and
corrections
Worksheets and question-answer assignments
Papers that have been polished with help from
peers or teachers
Papers written primarily in student’s native
language
Papers that are brief, incomplete, or rushed
TEA 19
Rater Manual
Page 21
Pages 31-35
Rubrics for each
domain: listening,
speaking, reading and
writing began on
page 31 of the rater
manual.
Reading Test
Administrator Manual
Pages 8-9
TELPAS reading tests are not timed. Students must be allowed to work at their individual
speed. Once a student begins a test, he or she must complete it on the same day.
The following Type 1
accommodations(approved
locally) are for eligible
students with disabilities
taking the TELPAS reading
tests.
 Individualized structured
reminders
 Amplification devices
 Projection devices
 Manipulating test
materials
 Basic transcribing
 Large print
The following procedures are
not permitted, as they may
invalidate the test.
 Students may not receive
reading assistance.
 Students may not use
English-language or foreignlanguage reference materials.
 Test questions and reading
selections may not be
translated.
 Test questions, answer
choices, and selections may
not be rephrased, clarified, or
read to students.
Reading Test
Administrator Manual
Page 20
 Students are NOT permitted Internet access nor cell phones during testing.
 Test administrators must complete seating charts for each test administration.
 Seating charts must include the names of the students testing, the location of each
student while testing, and the names of all test administrators/monitors involved in
the session.
 Test administrators may not view or discuss individual test questions or responses
unless specifically directed to by the test procedures.
 Test administrators should ensure that students’ responses remain confidential.
 Students are not allowed to talk to one another while testing is in progress.
 Students must not use reference materials.
 Students are allowed to use scratch paper. All scratch paper must be turned in to the
campus coordinator after testing.
 Test administrators must actively monitor the testing room while students are
working.
 After they submit their tests online, students may be allowed to quietly read books
or leave the testing room.
 Before a student who has finished testing leaves the room, the test administrator
must ensure that the student’s test is in “Completed” status.
•
Creating and Adding Students to a Session –
•
pg. 15 (Reading Manual)
•
pg. 36 (Rater Manual)
•
Generating and Printing Student Authorization Tickets –
•
pg. 16 (Reading Manual)
•
pg. 37 (Rater Manual)
•
Starting a Session –
•
pg. 22 (Reading Manual)
•
pg. 38 (Rater Manual)
•
Monitoring a Session –
•
pg. 23 (Reading Manual)
•
pg. 38 (Rater Manual)
•
Exiting a Student’s Session (i.e. to take a break) –
•
pg. 23 (Reading Manual)
•
pg. 39 (Rater Manual)
• Resuming a Student’s Session –
• pg. 24 (Reading Manual)
• pg. 39 (Rater Manual)
• Stopping a Session –
• pg. 25 (Reading Manual)
• pg. 40 (Rater Manual)
• Entering Score Code and Accommodations & Proficiency
Ratings –
• pg. 26 – 27 (Reading Manual)
• pg. 42 – 43 (Rater Manual – Proficiency Ratings section)
• Marking a Session Complete –
• pg. 27 (Reading Manual)
• pg. 42 (Rater Manual)
Administration Directions for Grades 2-5 begin on page 31.
Be sure to read directions in advance to become familiar with
the script.
Administration Directions for Grades 6-12 begin on page 37.
Be sure to read directions in advance to become familiar with
the script.
• If you have never logged onto TELPAS online training,
(https://tx.scoring.pearsonassessments.com/scoring/), you must self register.
The code is training2016. Be sure to choose Region -10 Richardson and select
our district.
• Feb 12 - Deadline for teachers who will serve as verifiers should have
completed online training. (Verifiers can not serve as raters.)
• Feb 15 - Online calibration window for ALL teachers scheduled to rate
TELPAS rating samples. Calibrations must be completed individually and in a
monitored setting.
• Feb 16 - Writing Samples for TELPAS writing collections may begin.
• March 7 - April 1 - TELPAS Reading Assessment Window.
• April 4 – 6 - Campus Test Coordinator check and update “resolution required”
status in Pearson Access Next