Texas English Language
Proficiency Assessment
System (TELPAS):
Holistic Rating Training
Audience: Teachers who will serve as
TELPAS raters
General Information about
TELPAS (p. 1)



Fulfills federal requirements for assessing
English Language Learners (ELLs), K-12
Aligned with the Texas English Language
Proficiency Standards (ELPS)
Results used in state and federal
accountability and performance-based
monitoring system
2
Holistically Rated Components
of TELPAS (p. 1)
Grade
Levels
Language Domains
K–1
Observational assessments in listening,
speaking, reading, and writing
2–12*
Observational assessments in listening and
speaking; writing collections for writing
*Online multiple-choice reading tests are used to assess the
reading domain for grades 2–12.
3
Georgetown ISD Calendar of Events
for TELPAS (p. 2 – Scheduling)
Events
Dates
Administration procedures training for holistic component
By February 20
New raters complete online basic course (K-1 or Gr. 2-12)
By February 27
Returning raters review TELPAS basics (see Slide 30 for
resources)
Before attempting
calibration activities
All raters complete online calibration activities
February 20 – March 2
Collect samples for Gr. 2-12 writing collections
February 20 – March 30
Training for Gr. 2-12 TELPAS Online Reading Test
By March 16
TELPAS Assessment Window (holistically rating all ELLs &
completing online reading test for Gr. 2-12)
March 19 – April 5
Campus Verifiers ensure that Gr. 2-12 writing collections
meet all assembly criteria
March 26 – April 2
Extended Collection Window (if needed to collect more
writing samples)
April 2 – 5
Extended Assessment Window (to rate/test ELLs in
extenuating circumstances)
April 9 – 11
Deadline for CTCs to enter all holistic ratings in the Texas
Assessment Management System
April 11 by 5:00 PM
4
Student & Test Data Submission for
TELPAS (p. 2)
All information is submitted online,
including:


Student Identification, Demographic, and Program
Information (submitted by Assessment Dept., verified
by campus personnel)
TELPAS Assessment Information (holistic ratings, rater
information, reading accommodations used, reasons
why a student could not be assessed as well as
student-entered answers to reading tests for Gr. 2-12)
Eligibility Requirements (p. 2)
All ELLs in Gr. K-12, including ELLs with
parent denials, are required to be
assessed in all language domains, with
the following exceptions:

ARD Decision: only in rare cases and made on a
domain-by-domain basis as documented in the student’s
IEP in conjunction with the LPAC

Newly Enrolled ELLs: students from another school
district, state, or country who enroll on or after March 19
will not be assessed in the holistically rated domains;
newly enrolled Gr. 2-12 students will take TELPAS
reading test
Eligibility Requirements (p. 3)
Note: ELLs in Gr. 2-12 who first enter U.S.
schools in the 2nd semester must now
take the online reading test. In the past,
we could automatically assign a rating of
beginning and not test the student, but
this is no longer allowed. All Gr. 2-12
ELLs must attempt the online reading
test.
Test Security & Confidentiality
Requirements (p. 4)






TELPAS – secure testing program (just like TAKS/STAAR)
Only trained, certified staff and/or their trained designees
who have signed oaths have access to test materials
Must receive training & sign oath before handling test
materials, confidential information, or administering a test
Must administer tests in strict accordance with instructions
in manuals
Must maintain confidentiality of confidential information
(such as completed student rating rosters)
Must destroy scratch paper used during reading tests
Test Security & Confidentiality
Requirements (p. 4-5)




No viewing, revealing, or discussing test content before,
during, or after a test administration unless specifically
authorized to do so by test administration procedures
No duplication, printing, recording, writing notes about,
or capturing by any electronic means any secure
assessment instrument
No individuals other than students may respond to test
items
No reviewing or discussing student responses or student
performance data during or after a test unless authorized
to do so by test administration procedures
Penalities for Prohibited Conduct
(p. 5-6)





Placement of restrictions on the issuance, renewal, or
holding of a Texas educator certificate, either indefinitely
or for a set term
Issuance of an inscribed or non-inscribed reprimand
Suspension of a Texas educator certificate for a set term
Revocation or cancellation of a Texas educator
certificate without opportunity for reapplication for a set
term or permanently
Criminal prosecution
Additionally, student test results may be invalidated.
Security Oaths (p. 6)



Oaths for TELPAS raters, writing collection
verifiers, test administrators, and technology
staff found in Appendix A (p. 83)
Each oath must be read and completed
AFTER training and BEFORE handling or
viewing secure test materials or confidential
information.
Some oaths include spaces to initial for
assigned roles, so some lines may remain
blank. (Read carefully before initialing!)
Testing Irregularities (p. 6-8)




Definition: Incidents resulting in a deviation
from documented testing procedures
Each person is responsible for reporting
immediately to the campus or district testing
coordinator any violation or suspected
violation of test security or confidentiality.
Failure to report is in violation of 19 TAC,
Chapter 101 and could results in sanctions.
Two types: Serious & Procedural
Serious Irregularities (p. 6-7)
Could result in referral to the TEA Educator Certification
and Standards Division for disciplinary action







Assisting students (directly/indirectly)
Tampering with student responses or writing samples
Falsifying TELPAS holistic ratings
Viewing secure test content (unless authorized to do so)
Discussing secure test content, student responses, or
student performance
Scoring student reading tests (formally/informally)
Duplicating, recording, or capturing electronically secure
test content
Examples of Procedural Irregularities
(p. 7-8)





Eligibility Error
IEP Implementation Issue
Improper Accounting for Confidential or
Secure Materials
Monitoring Error
Procedural Error
Reporting of Disciplinary Actions Taken
Against Students for Cheating on
State Assessments (p. 8)




A district may invalidate a student’s test if the district
determines that the student cheated.
Additional disciplinary action may be taken at the local
level.
Any local actions must be submitted to TEA using a
special online reporting form.
A separate online incident report form is necessary
ONLY IF the district determines that testing personnel
contributed to, caused, or did not detect the cheating due
to inadequate monitoring or another error.
Rater
Responsibilities
(p. 9 - 44)
Overview of the Rating &
Reporting Process (p. 9)




Districts identify ELLs in grades K–12 and designate
raters to assess students
Training on test administration procedures and holistic
rating is conducted to prepare grades K–12 raters to
assess English language proficiency consistent with
the holistic scoring rubrics, the Proficiency Level
Descriptors (PLDs)
Raters gather writing samples for ELLs in grades 2–12
to include in each student’s writing collection
Raters use PLDs to assign students a rating in each
language domain assessed
17
Rater Credentials (p. 10)
A TELPAS Rater is a teacher designated
to be the official rater of an ELL’s English
language proficiency.
Each TELPAS Rater must:





Have the student in class during spring semester
Be knowledgeable about the student’s ability to use
English
Hold valid teacher certificate or permit
Successfully complete holistic training & calibration
activities
Rate the student in all eligible language domains
Accommodations (p. 10)

Holistic ratings are based on student classwork and
observations of student in daily instruction.

For ELLs receiving SPED services, raters take into
account the ability of students to use English to access
the general curriculum at their enrolled grade level in
accordance with accommodations called for in their IEP.

Accommodations generally should not interfere with the
holistic rating process.
Talk to your Campus Testing Coordinator if you have
any concerns in this area.

Rater Checklist (p. 11)

Will help you keep track of holistic rating
activities

We will go through each activity in more detail in
the next set of slides.
Attend Training Session on
Administration Procedures (p. 12)



Today’s training is a part of your training on TELPAS
holistic rating procedures.
Read and study the TELPAS Manual for Raters and
Test Administrators.
Sign your Oath of Test Security and Confidentiality
for TELPAS Rater on p. 85 after this training session
and return it to the Campus Testing Coordinator
(CTC). If you need more time to read the manual
before you feel comfortable signing the oath, then
return it by the date designated by your CTC.
Complete Holistic Rating Training
Requirements (p. 13-18)

An online training process is used.

New raters complete an online basic training
course. (The course is optional, but highly
recommended, for returning raters.)

Both new and returning raters complete
calibration activities.
All eligible language domains are included in
the calibration activities, rather than just the
writing domain.

Activity 2: Page 13
Spring TELPAS Administration
Procedures Training
Covers holistic rating training requirements
and procedures for conducting TELPAS
New Raters
Online Basic Training
Course
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
Returning Raters
(Basic Training Course is optional for Returning Raters.)
If not calibrated:
Supplemental Holistic
Rating Training
Final Online
Calibration Activity
Set 3
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
Online Training Components (p. 14)

Online Basic Training Course (Required for New
Raters & Highly Recommended for Returning Raters)


One for raters of K–1 and one for raters of Gr. 2–12
(Approximate Completion Time: 4-5 hours)
Online Calibration (Required for New and Returning
Raters)

Separate calibration activities for grades K–1, 2, 3–5, 6–8, and
9–12 (Approximate Completion Time: 1-2 hours)
24
Online Training Components (p. 14-15)




Online courses are designed to prepare raters to
assess the English language proficiency of students
in a uniform manner statewide.
New Raters: Complete Online Basic Training Course
by February 27 (Deadline for GISD New Raters)
Training courses and calibration activities are grade
cluster specific (K-1, 2, 3-5, 6-8, 9-12), so confirm your
cluster BEFORE starting your online training.
If you will rate students from more than one grade
cluster, consult your Campus Testing Coordinator for
instructions.
25
Online Basic Training Course (p. 15)







Complete course in a distraction-free setting.
You may complete the course in more than one sitting.
The rating practice activities must be completed
independently. (online oath included)
Five practice activities are included for each language
domain.
There is no required number of students to rate correctly
since the activities are for practice.
It is a violation of state assessment procedures to share or
discuss answers to the rating practice activities with
individuals who have not yet completed the course.
You will be issued a course certificate upon completion.
26
Online Calibration (p. 16)



Each calibration set contains 10 students to rate, and all
holistically assessed language domains are represented
in each set.
 For K–1: listening, speaking, reading, and writing
 For 2–12: listening, speaking, and writing
A rater needs to rate at least 70 percent of the students
correctly to calibrate.
If a Returning Rater is unsuccessful on the first set, you
must complete the Online Basic Training Course (if not
already completed) and provide your CTC with your
training certificate (GISD requirement).
27
Online Calibration (p. 16)



Raters complete only as many sets as it takes to
calibrate.
 Many raters will be able to calibrate on the first set of
activities, and many others will be able to calibrate by
the end of the second set.
Calibration sets are available on February 20 and must
be completed by March 2 (in GISD).
Individuals who do not calibrate by the end of the second
set will be provided with supplemental training prior to
the third and final set.
28
Supplemental Holistic Rating Training
(p. 17)

Raters not calibrated after Set 2 must receive
supplemental support and then complete Set 3
before the start of testing window (in GISD this
means BEFORE spring break).

Raters need access code to complete Set 3

3rd Calibration Set: Available February 29
29
Resources for New & Returning
TELPAS Raters

TELPAS Manual for Raters & Test Administrators, p. 25-28; p. 34-38

Educator Guide to TELPAS Grades K-12 (web-based guide to
familiarize educators with TELPAS; includes student video segments,
authentic student writing, & sample test questions)
http://www.tea.state.tx.us/student.assessment/ell/telpas/

PowerPoint presentations are available at the website referenced
above under the heading: Rater Training for 2011-2012
 Making the ELPS-TELPAS Connection Grades K12 Overview
 Introductory Training on the PLDs Gr. K-1
 Introductory Training on the PLDs Gr. 2-12
30
Calibration – Key Points (p. 18)









3 opportunities to calibrate
Resources available as warm-ups (see slide 28)
Online oath
Self-paced
Students presented in random fashion but domain order fixed
(listening, speaking, reading (K-1 only), & writing
Score & rating annotations available right away
Although the 2nd set is available right away, DO NOT ATTEMPT
until you check in with your CTC. If you did not complete the Online
Basic Training Course, you MUST complete it before attempting the
2nd set. Review other support materials as well.
Training is complete after successful calibration on Set 1 or Set 2.
Print Calibration certificate and give it to your CTC.
Raters not successful after 2 attempts will receive supplemental
training before Set 3 can be accessed.
Accessing the TrainingCenter Website
(Appendix D)





See Appendix D starting on p. 97 for specific information
about accessing the TrainingCenter website.
Site code for new TELPAS users: telpas2012
New raters must register using the directions on p. 98100.
Returning raters already have an account and should
review p. 101-103.
Returning raters should review the “My Info” link and
update email, phone #, region, district, campus, etc. as
needed. Call Pearson at 800-627-0225 for assistance
(e.g., to change name & date of birth).
32
Texas TrainingCenter Login
https://texas.pearson.desire2learn.com/
33
Navigating the TELPAS
TrainingCenter (p. 104)

My Home: After successful login, click on
TELPAS 2012.
34
TELPAS Homepage

You will then see the TELPAS TrainingCenter
homepage, where you will access training courses
and/or calibration activities.
35
Accessing TELPAS Online
Courses (p. 106)



You must first accept the Rater Agreement for TELPAS Online
Training Courses to view courses and modules.
Video clips are included, so use headphones if needed.
Click on the title of each module to access. You must go through
each module and activities within the module to get credit for
completing the training.
See p. 106-108
for further details.
36
Accessing TELPAS Online
Calibration (p. 109-119)






Follow the instructions on p. 109-119 in the TELPAS Manual.
Calibration window opens February 20 and is available 24/7.
Make sure you choose the correct grade cluster (K-1, 2, 3-5,
6-8, 9-12) for calibration.
Video clips are included, so you may need to use headphones
to maintain security/confidentiality.
You may save your work and complete calibrating at another
time.
Do not click the Finish Calibration button until all students
are rated.
37
Accessing TELPAS Online
Calibration (p. 109-119)




You may use the TELPAS Manual and other outside resources
to complete the calibration activity. (It’s an open-book test!)
However, you must complete the activity BY YOURSELF. (No
phoning a friend!)
CAUTION: Do not attempt when you are tired, feel rushed, or do
not feel well.
If you do not complete Set 1 successfully, you must notify your
Campus Testing Coordinator (CTC) and complete the Basic
Training Course before you can access Set 2. This is a GISD
requirement. The system will allow you to immediately access
Set 2, but do not do so without notifying your CTC and
completing the Basic Training Course first.
38
Still Unsuccessful After Set 2:
What happens next? (p. 119)




It is very rare in GISD for a teacher to not calibrate after 2
attempts.
Those who still need to calibrate after 2 attempts will be
provided with supplemental support by Trudy Brandenburg.
These sessions may take place before or after school and/or
during your conference period.
You will be give an access code to proceed to Set 3 upon
completion of all supplemental support training activities.
39
Accessing Training Results &
Certificate and Assistance (p. 120-121)


See p. 120 for instructions on accessing the following:
- Training History
- Certificate of Completion for Online Courses
- Certificate of Successful Completion of Online Calibration
For help accessing or navigating the Texas TrainingCenter,
contact Pearson at 800-627-0225, Monday-Friday, 7:00 AM to
7:00 PM or by email at:
TELPAS.techhelp@support.pearson.com
40
Assemble & Verify Gr. 2-12 Student
Writing Collections (p. 19-20)








Writing collections must contain at least 5 samples (1 narrative
about a past event; 2 academic from math, science, or social
studies; 2 other samples).
Writing assigned on or after February 20 may be considered.
More than 5 samples should be collected.
The more recent the writing samples, the more accurate the
collection will be.
Include student name and date on all samples.
Staple the cover sheet and verification checklist found in
Appendix C (p. 95-96) to the front of the writing collection.
Photocopies of writing are okay if clear and legible.
Collect samples from February 20 through March 30.
Campuses may set earlier deadlines or interim deadlines, so
check with your CTC.
41
Writing Examples (p. 20-21)






Type 1: Basic descriptive writing on a personal/
familiar topic
Type 2: Writing about a familiar process
Type 3: Narrative writing about a past event
(REQUIRED)
Type 4: Personal narratives & reflective pieces
Type 5: Expository & other extended writing on a
topic from language arts
Type 6: Expository or procedural writing from
science, math, or social studies (2 samples
REQUIRED)
42
Tips for Good Writing Collections (p. 23)



Encourage students to take their time and write in
as much detail as possible.
Include writing tasks that allow students to truly
showcase the English they know while writing on
topics that are comfortable and familiar.
Also include writing tasks that stretch and push
students’ limits so that you can see the full extent of
their language abilities and any elements of second
language acquisition they still need to develop.
43
What Not to Include in a Collection (p. 23)







Papers containing language directly copied from a
textbook, lesson, or other written source
Papers with heavy reliance on a dictionary or thesaurus
Papers that show a teacher’s corrections
Papers that have been polished through editing by
peers, parents, or teachers
Papers written primarily in a student’s native language
Worksheets or question-answer assignments
Papers that are brief, incomplete, or obviously reflect
writing that was rushed
44
Verifying the Writing Collection
Components (p. 24)





TELPAS Raters and paraprofessionals are NOT
permitted to serve as a verifier.
All raters complete the verification checklist (see p. 96)
for their assigned ELL students as well as the front of
the cover sheet (see p. 95).
Campus verifiers (usually the CTC) must complete the
online training course, Assembling and Verifying Gr. 212 Writing Collections, on the Texas TrainingCenter
website by February 29 (GISD requirement).
Collections that do not meet the requirements will be
returned to the rater so that additional samples may be
collected.
The verifier will initial in each box and sign the
verification checklist at the bottom.
45
Prepare to Rate Your Students
Prior to rating your students, review p. 25-31 on the
following topics:








Language Domain Definitions
Proficiency Level Descriptors and Global Definitions
Progress Through the Proficiency Levels
Social and Academic Language Proficiency
Academic Language Proficiency Versus Academic
Achievement
Observing Students in Each Language Domain:
Listening, Speaking, Reading (K-1), Writing (K-1)
Collaboration with Others: GISD requires that you
collaborate with other teachers and school
personnel on your holistic ratings.
Final Preparations
46
Rate Your Students (p. 32)
You will need the following:



TELPAS Rater Manual, which includes the PLDs
The GISD Version of the TELPAS Student Rater Roster
(Do not use the one in Appendix B. The GISD version
has a column for collaborators to initial for each
student.)
The TELPAS Writing Collection Cover Sheet (p. 95-96)
run front/back for Gr. 2-12 students
Keep student writing collections & student rating
rosters in locked storage when not in use.
The primary rating window in GISD is March 19
through April 5.
47
Procedures for Rating Students (p. 33)











Use the PLDs on p. 34-38 to rate your students.
Always refer to the PLDs.
You may copy the PLDs and make notes on individual students if helpful.
Start with students whose English proficiency levels are clearest to you.
Holistic ratings should be based on a variety of observations.
Evaluate the most current level of English proficiency & consider at which
level the student performs most consistently.
Collaborate with others. (GISD Requirement!)
Complete all ratings for one student before proceeding to the next student.
Compare each student to the PLDs and do not let proficiency levels of
other ELLs influence your ratings.
Except for Gr. 2-12 writing, your determination is based on reflections of
observations, not formal language observation tasks.
Remember that academic language proficiency is not the same as
academic achievement. A student does not have to be a high achiever in
order to have an advanced high level of English language proficiency.
48
TAMS Online Activities (p. 39-43)



You will not be required to create and manage rating
entry groups. (Yipee!)
You will not be required to enter rating information
online. (Hurray!)
Your Campus Testing Coordinator or the District Testing
Coordinator will complete these tasks.
49
Prepare Materials for Return (p. 44)




Verify holistic ratings and rater information you supplied
on the Georgetown ISD TELPAS Student Rating
Roster are accurate and complete.
Review the accuracy of any other student data you have
been asked to verify.
Make sure you have completed, signed, and dated the
GISD TELPAS Student Rating Roster and obtained
the initials of a Collaborator for each student.
Gr. 2-12: Make sure that you have completed the
TELPAS Writing Collection Cover Sheet (front &
back) and stapled it to the front of each writing
collection.
50
Return Materials (p. 44)




Signed Oath of Test Security & Confidentiality for
TELPAS Rater (if not already returned)
Return your GISD TELPAS Student Rating Roster.
Turn in your student writing collections.
Return your TELPAS Manual after all TELPAS activities
have been completed.
51
TELPAS Calendar of Events in GISD: Let’s Review
Events
Dates
Administration procedures training for holistic component
By February 20
New raters complete online basic course (K-1 or Gr. 2-12)
By February 27
Returning raters review TELPAS basics (see Slide 30 for
resources)
Before attempting
calibration activities
All raters complete online calibration activities
February 20 – March 2
Collect samples for Gr. 2-12 writing collections
February 20 – March 30
Training for Gr. 2-12 TELPAS Online Reading Test
By March 16
TELPAS Assessment Window (holistically rating all ELLs &
completing online reading test for Gr. 2-12)
March 19 – April 5
Campus Verifiers ensure that Gr. 2-12 writing collections
meet all assembly criteria
March 26 – April 2
Extended Collection Window (if needed to collect more
writing samples)
April 2 – 5
Extended Assessment Window (to rate/test ELLs in
extenuating circumstances)
April 9 – 11
Deadline for CTCs to enter all holistic ratings in the Texas
Assessment Management System
April 11 by 5:00 PM
52