TELPAS Training for Principals
2014
Disclaimer
 This presentation does not take the place
of reading the manuals
 Campus test coordinators, raters,
verifiers, and reading test administrators
are responsible for reading the
appropriate manual(s) and complying
with all the instructions
Components of Today’s Training







Scope and Purpose of Training
General Testing Procedures
Test Security & Confidentiality
Overview of TELPAS
Principal’s Role
Online Reading Test
Final Documentation Submission
District and Campus Coordinator Manual
(DCCM, pg. T-13)
Principal’s Role in TELPAS
General Testing Procedures
 Test security
 Test security procedures and oaths
 Active monitoring
 Consequences of cheating
 Scheduling test administrations
 Testing window
 Time limits
 Breaks
 Make-up testing
 Preparing for test administrations
 Identifying eligible students
 Managing secure materials
 Preparing for online administrations
General Testing Procedures
(Continued)
 Testing with accommodations
 Allowable test administration procedures and materials
 Accommodations for students with disabilities
 Linguistic accommodations
 Ensuring students receive appropriate
accommodations
 Monitoring test administrations
 Availability of test coordinator and principal
 Completing the testing process
 Documentation
Test Security And Confidentiality
 Test Security
 Must secure and account for all secure materials and
confidential student information before, during, and after
each test administration
 Writing samples
 Rating rosters
 Student authorization letters
 Paper-based tests (if applicable)
 Access must be limited to personnel who meet the
requirements to participate in the testing, have been
trained, and have signed the appropriate oath
 Holistic raters
 Writing collection verifier(s)
 Reading test administrator(s)
 Rating entry assistant
 Technology staff
Test Security and Confidentiality
 Confidentiality
 Before handling secure materials, testing personnel must be
trained and sign the appropriate oath
 Personnel working in the AMS must read and accept a
statement of confidentiality
 No person may view, reveal, or discuss the contents of an
online assessment before, during, or after a test
administration unless specifically authorized by TEA
 If circumstances necessitate that an online assessment be
examined, permission must first be obtained from TEA
 No person may duplicate, print, record, write notes about, or
capture by electronic means any portion of a secure
assessment without prior approval from TEA
 No individual other than the student may respond to test
items
 No person may review or discuss student responses or
performance data during or after a test administration unless
specifically authorized to do so by the procedures outlined in
the test administration materials
Test Security and Confidentiality
 Two categories of irregularities:
 Serious
 Procedural
 Serious irregularities constitute severe violations of test
security and/or confidentiality and can result in the
individual(s) responsible being referred to the TEA Educator
Standards and Certification Legal Division for consideration
of disciplinary action including:
 Placement of restrictions on the issuance, renewal or
holding of a Texas educator certificate, either
indefinitely or for a set term
 Issuance of an inscribed or non-inscribed reprimand
 Suspension of a Texas educator certificate for a set
term
 Revocation or cancellation of a Texas educator
certificate without opportunity for reapplication for a set
term or permanently
Test Security and Confidentiality
 Testing Irregularities (Serious)
 Directly or indirectly assisting students
with responses to reading test questions
or holistic writing samples
 Tampering with student responses or writing samples
 Falsifying TELPAS holistic ratings
 Unauthorized viewing of secure test content
 Discussing secure test content, student responses, or
student performance
 Scoring student reading tests, either formally or
informally
 Unauthorized duplicating, recording, or electronically
capturing secure test content (online reading test)
 Teachers sharing answers to the online calibration
activities or practice rating activities (online training)
Test Security and Confidentiality
 Testing Irregularities (Procedural)
 Eligibility errors
 Testing ineligible students
 Failure to test eligible students in all appropriate
domains
 IEP Implementation Errors
 Failure to provide a prescribed accommodation
 Providing an unauthorized accommodation
 Improper accounting for secure materials
 Lost or misplaced writing samples or other confidential
or secure materials
 Rating rosters and writing samples must be
secured until the assessments are complete
 Rosters should be given to CTCs to be stored
 Writing samples remain confidential but
should be placed in the student’s permanent
folder after the assessment has been
recorded in the AMS
Test Security and Confidentiality
 Testing Irregularities (Procedural)
 Monitoring errors
 CTC did not require raters to return confidential
materials
 Test administrator left a room unattended when
students or secure materials were present or when
secure online tests were visible
 Secure online tests were left open and visible during a
lunch break, short break in room, or restroom break
 Testing personnel did not monitor students during a
break
 Testing personnel did not ensure that students worked
independently during the online reading test
 Students were not prevented from using cell phones or
other electronic devices to take pictures or send
messages
 A student was allowed to remove secure materials
Test Security and Confidentiality
 Testing Irregularities
 Procedural errors
 Test administrator failed to issue the correct
materials or non-allowed materials were
provided to students
 Untrained or improperly trained personnel were
allowed to rate students or administer tests
 Test administrator failed to use the test administrator
manual or failed to read the bolded test
administration instructions verbatim
 Displays that might provide assistance were visible
 TELPAS writing collection was not submitted in
accordance with the required assembly criteria
 Test administrator failed to provide a student with the
correct student authorization to access the reading
test
Test Security and Confidentiality
 Reporting Testing Irregularities
 Contact Teresa Daugherty immediately upon discovery
 Incidents involving disciplinary actions taken against
students for cheating
 Contact Teresa Daugherty
Overview: What is TELPAS?
Texas
English
Language
Proficiency
Assessment
System
TELPAS is the assessment
tool that fulfills federal
requirements for assessing
the English language
proficiency of ELLs in grades
K-12
What Does TELPAS Measure?
TELPAS assesses the proficiency of students in
four domains and reports student performance in
terms of four English language proficiency levels:
Domains Assessed
 Listening
 Speaking
 Reading
 Writing
Proficiency Levels
 Beginning
 Intermediate
 Advanced
 Advanced High
Assessment Components
 Grades K–1
 Holistically rated observational assessments of
listening, speaking, reading, and writing
 Grades 2–12
 Holistically rated observational assessments of
listening and speaking
 Holistically rated writing collections
 Multiple-choice online reading tests in six grade
clusters: 2, 3, 4–5, 6–7, 8–9, 10–12
Students’ online reading test answers, holistically rated assessments,
and all other student data are submitted through the Assessment
Management System
TELPAS Student Rating Roster
Principal’s signature
verifies:
• Rater is a trained
and calibrated rater
• Additional rater
meets the
requirements
• Roster is
completed properly
• Ratings are
accurately
displayed
Rater Credentials
 Rater must:
 Have the student in class at the time of the spring
assessment window
 Be knowledgeable about the student’s ability to use
English in both instructional and informal settings
 Hold valid educational credentials
 Be appropriately trained in the holistic process
 Rate the student in all eligible domains
 May include bilingual teachers, ESL teachers, general
education teachers, special education teachers, G/T
teachers, and teachers of enrichment subjects
Paraprofessionals may NOT serve as raters!!
Fall
ELPS-TELPAS
Professional
Development
Grades
K–12 Holistic
Rating Training
Flowchart
(For new teachers and new prospective raters -- recommended)
Spring TELPAS Administration
Procedures Training
Covers holistic rating training requirements
and procedures for conducting TELPAS
New Raters
Returning Raters
Online Basic Training
Course
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
If not calibrated:
Supplemental Holistic
Rating Training
Final Online
Calibration Activity
Set 3
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
Online Training Components
 Online Basic Training Course
 Required for:
 All NEW raters
 All raters who have not completed training
within the last three school years
 Any rater who failed to calibrate on the 1st or
2nd attempt last year
 Two basic courses
 K-1: Covers all four language domains
(listening, speaking, reading, and writing)
 2-12: Covers the listening, speaking, and
writing domains
 Must be completed before attempting the online
calibration
 Approximate time to complete: 4-5 hours
R
A
T
E
R
R
E
S
P
O
N
S
I
B
I
L
I
T
I
E
S
Online Training Components
 Online Calibration
 Required for ALL raters (new & returning)
 Consists of 3 sets of (10) students to be rated
in all applicable domains
 Approximate time to complete: 1 hour
R
A
T
E
R
R
E
S
P
O
N
S
I
B
I
L
I
T
I
E
S
Training Certificates & Professional
Development Credit
 Training certificates are generated for raters who complete
training courses and calibration activities
 *Certificate of completion issued when a rater
completes an online course
 *Certificate of successful completion issued when a
rater demonstrates sufficient calibration (70 percent or
better) on a calibration set
 Five hours are awarded for the K–1 and 2–12 basic training
courses
 Two hours are awarded (in all) for calibration
* Raters must provide a copy to the CTC for documentation
Supplemental Support Providers
 Purpose:
 To provide a system of supplemental support to assist
raters who have not successfully calibrated by the end
of the second set
 Each campus must assign at least one SSP
 Requirements for SSP
 Be a 2012-2013 fully trained rater in the applicable K-1
or 2-12 grade span
 Complete the recorded web-based training
 Calibrate successfully on either set 1 or set 2
End Dates for Holistic Rating Training
 TEA recommends completion of training
requirements by the first day of the TELPAS
assessment window (March 17)
 Basic training courses and calibration activities will
be open throughout TELPAS assessment window to:
 allow districts to handle extenuating
circumstances
 allow raters to refer back to course information
and practice activities as they rate their students
Key Holistic Training Dates
* KISD window closes on April 4th to provide adequate time for
verification of completion
Monitoring Course Completions & Calibration
Activities (CTC Responsibility)
 Statewide rater lookup tool: Texas TrainingCenter
 Reports for online training and calibration
 TELPAS Returning Rater Planning Roster
 Uses records from the last five school years to
generate a list of previously trained raters
 TELPAS Confidential Course Completion Roster
 Lists online basic training course status and
performance by user for the current year
 TELPAS At-a-Glance Training and Calibration Report*
 Lists training course and calibration status for all
registered users for the current year
 Identifies “Time Spent” on calibration activities
 TELPAS Confidential Calibration Summary Report
 Provides calibration summary information by grade
cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade
clusters combined
*TELPAS At-a-Glance Training and Calibration Report
 New: “Time Spent” column documents how long the
rater spent on the calibration activities
 If “Time Spent” field indicates an unlikely value for
successfully working through the scenarios and rating
the students, CTC must investigate
 If the rater did not perform the calibration activities
independently, CTC must report this irregularity
 These types of irregularities fall into the “Serious”
category that could result in severe consequences
*TELPAS At-a-Glance Training and Calibration Report
Assembly & Verification of Grades 2-12
Writing Collections
CTC appoints individual(s) to verify the collection of
writing samples meets the criteria required
Writing Collection Verifier Credentials
 May be LPAC administrators, school counselors,
or other suitable staff
 May NOT be paraprofessionals
 May NOT be teachers serving as TELPAS raters
this year
Assembly & Verification of Grades 2-12
Writing Collections
 Raters are responsible for assembling writing
collections that accurately depict the ability of the
students to communicate in writing
 Writing samples should come from a variety of
core content areas
 Writing samples should be taken from authentic
classroom activities that are grounded in
content area TEKS and ELPS
 Recent writing samples should be weighted more
heavily in the event that a student’s rating is
borderline between two levels of proficiency
 Classroom observations are not used for these
grade levels
Assembly & Verification of Grades 2-12
Writing Collections
 Requirements for samples:
 Must contain at least 5 writing samples
 At least 1 narrative writing sample about
a past event
 At least 2 academic writing samples from
math, science, or social studies
 Assigned on/after February 17, 2014
 Should reflect current proficiency
 Each sample must include student’s name
and date
 Cover sheet and verification checklist
(Appendix C) must be completed and stapled
to student’s writing samples
 Photocopies of classroom writing
assignments may be used if clear and legible
 Writing samples may be typed if
spelling/grammar checkers disabled
Writing from Authentic Classroom
Activities
 Do not gather all of your LEP students and have a
“writing party” for TELPAS
 Writing samples should be collected from classroom
assignments in which all students participate
Assembly & Verification of Grades 2-12
Writing Collections
The district coordinator is required to submit a
testing irregularity incident report to TEA if the
student writing samples submitted are based
on incorrectly assembled writing collections
Validity and Reliability
 CTC oversees procedures to ensure validity and reliability
of holistic ratings
Killeen ISD’s policy is to implement the 1st and 4th
recommendations of TEA
Validity and Reliability
Procedures to Ensure Validity & Reliability
 As was the case last year, there must be a second set of
eyes reviewing the rater’s assessment for each student
 Writing samples must be reviewed by a trained and
calibrated 2nd rater, but he/she does not have to have
the student in class
 Other holistic domain ratings can be corroborated by
any certified professional who has a knowledge of the
student’s listening and speaking capabilities in an
academic and social environment
 UNLIKE primary raters, 2nd raters need not rate all
domains; each needs to sign appropriate form
TELPAS Assessment Eligibility
Requirements
 Campuses are required to assess all K-12 ELLs enrolled
during the TELPAS testing window*:
 Currently identified as LEP
 LEP code = 1 in eSchoolPlus
 Includes parent denials
 Includes homebound students
 Does NOT include students who have been exited from
the program and who are in their 1st or 2nd year of
monitoring
 LEP codes F, S in eSchoolPlus are NOT tested
* In rare instances due to ARD specifications or other unusual
circumstances, a student may not be required to participate in
one or more TELPAS domains--see DCCM Page T-4
Identifying Eligible ELLs
CTC Responsibility
1.
Use the Advanced Search tab in eSchoolPlus to find
currently identified LEP students
2.
KISD Connect Precode report (filtered on LEP = C) should
match the students found in #1
3.
*Use KISD Reporting (SSRS) to identify students who were
previously enrolled as LEP and who were not exited from the
program
* Use this report with either of the other two methods to make sure
your list is complete.
Key Dates in Determining Which Campus is
Responsible for Assessing Students
 Responsibility for assessing students who enroll or
withdraw before the testing window
 Student withdraws/enrolls before March 17
 Sending campus:
 Do NOT enter any ratings
 Remove student from all online test sessions
and holistic rating entry groups
 If student has writing samples, give them to
receiving campus
 Receiving campus:
 Responsible for assessing all domains
 Enter holistic ratings
 Administer online reading test
Key Dates in Determining Which Campus is
Responsible for Assessing Students
 Responsibility for assessing students who enroll or withdraw
during the testing window
 Student withdraws/enrolls on or after March 17
 Sending campus:
 Responsible for entering all holistic ratings
 If student has not taken the online reading test,
remove student from all test sessions
 Receiving campus:
 Responsible only for administering the online
reading test (if student has not already completed
the test)
Note: Students whose last day is March 7th, are not officially
withdrawn until March 17th so the sending campus must
enter holistic ratings for these students
Important Dates
 Timeline
 Holistic rating completion/rating roster turn-in to CTC
 Earliest Date: 3/17/2014
 Deadline: 4/4/2014*
 Assembling & verifying writing collections (grades 2-12)
 Earliest Date: 3/17/2014
 Deadline: 4/4/2014*
* KISD window closes on April 4th to provide adequate time for
verification of completion
TELPAS Student Rating Roster
Rating
Section
Signatures
Legend
Properly Completing the TELPAS Student Rating
Roster (Rating Section)
 Place one name—the entire name—on one line (if possible)
 Grade level must be K, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, or 12
 Rating domain entries must be B, I, A, H, E, or X
 NO substitutions or other abbreviations allowed
 The Reading (K-1 only) column should be blank for grades 2-12
 There should be NO other blank entries
Properly Completing the TELPAS Student Rating Roster
(Rater Information Section)
 Rater A and Rater B Information columns must
be completed
 Rater A entries must be 1, 2, 3, 4, 5, 6, 7, OR 8
 Rater B entries must be 1, 2, or 3
 Consult the Rater Information listed below the
roster to determine the correct value for each
Properly Completing the TELPAS Student
Rating Roster (Signature Section)
 Rater must sign and date the roster
 Additional rater (almost all should have one) must sign and date
the roster
 Principal must sign and date the roster
 Nobody else may sign for the principal
 Campus Name must be written on the roster
What’s Wrong with this Picture?
What’s Wrong with this Picture?
.
.
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
So… Now that you know what a rating roster should NOT
look like, what might a correctly completed roster look like?
TELPAS Writing Collection Cover Sheet
Properly Completing the TELPAS Writing
Collection Cover Sheet (Front Side)
 Student Name,
Campus Name,
Enrolled Grade Level,
and Number of Writing
Samples must be
legibly written on the
cover sheet
 Rater must sign the
cover sheet
 Additional rater (most
should have one)
must sign the roster
 Writing Rating must
reflect just the final
rating
Properly Completing the TELPAS Writing
Collection Cover Sheet (Back Side)
 All boxes must be
initialed by the rater
and/or verifier as
indicated unless there
is documentation
attached explaining
why the criteria is not
met
 Verifier must print,
sign, and date the
sheet on the
appropriate lines
Online Reading Tests For Grades 2–12
TELPAS Reading Test Change
 New standards were set for TELPAS reading**
 Standards were adjusted to meet the new
definition of “grade level-appropriate” that
accompanies the increased rigor of STAAR
 Domain weights have been shifted in the
composite score calculations:
 Reading: 50% Previously 75%
 Writing: 30%
Previously 15%
 Listening: 10% Previously 5%
 Speaking: 10% Previously 5%
**What this means for you: TELPAS Reading scores may
be lower overall this year
Accommodations
 Eligible students with disabilities:
 Majority of testing accommodations available for
STAAR reading and STAAR English I & II are
available for the TELPAS reading test
 Large print/projection device (project test on wall)
 Colored overlay (tape to monitor)
 Individual or small group administration
 See Accommodations Resource page
 Non-allowed accommodations
 Braille administration
 Oral administration
 Dictionary of any kind
Accommodations
 If a student with a disability is allowed a testing
accommodation, the accommodation type(s) must be
indicated at the time of testing:
 Type 1 (accommodations approved locally)
 Available for students who meet specific eligibility
criteria
 Decision is made by the appropriate team of people
at the campus level; e.g., ARD committee & LPAC
 No ARF required
 Type 2 (accommodations requiring TEA approval)
 Appropriate campus level teams determine whether
or not the student meets all of the criteria
 If all criteria is met, an ARF must be submitted to
TEA
Accommodations
 Linguistic Accommodations:
 No linguistic accommodations are allowed
 Only test directions may be clarified, translated, or
reworded in simplified English
 No dictionaries of any type may be used
 Extra time is not needed because the test is not timed
(but must be completed within the school day)
Linguistic accommodations are designed for STAAR and STAAR-L
assessments to minimize the impact of language deficiencies on the
assessment of subject knowledge and skills
General information
 Multiple-choice online reading tests in six grade
clusters: 2, 3, 4–5, 6–7, 8–9, 10–12
 Administered in the TestNav 7 format
 Accessed from the Texas Assessment Management
System
In rare circumstances (juvenile detention centers, homebound), a
paper administration of a reading test for grade 2 or above may be
authorized by TEA. Refer to the 2014 District and Campus
Coordinator Manual (page T-10) for more information about
submitting a formal request for a paper administration.
Reading Test Administration Procedures
 Test administrators must become familiar with the test
administration directions
 Sentences are shorter, language is simpler
 TA’s may adjust the language and specificity of the
administration directions to the level of English
proficiency of the students
 TA’s must NOT change the substance of the information
contained in the directions
 TA’s may translate into the native language the
administrative directions that they read aloud to the
students before the test.
 TA’s must NOT translate test items or reading selections
Gather Materials for Testing




TELPAS Manual for Raters and Test Administrators
Seating chart – must use district chart
Session roster of students to be tested
Printed student authorizations
 Secure documents
 Keep in locked storage before the test
 Scratch paper for each student
 Pencils for use with the scratch paper
Note: All scratch paper and student
authorization letters must be returned to the
CTC and destroyed at the completion of the
test session.
What’s Wrong with this Seating Chart?
What test was administered?
What is the location of the test? Campus? Room?
What date was the test administered?
Who are the test administrators/monitors?
What times were the test administrators/monitors in the room?
What times were the students testing?
Final Data Verification Window
 Assessment window closes Wednesday, April 9
 Verification window closes Friday, April 11
 Allows districts time to verify completeness and accuracy
of student data before scoring begins
 If during verification process it is discovered a student
was not tested, the student must be tested during the
verification window
 Reminder: KISD’s deadline for completion or ratings
entry is April 4th
Final CTC Duties
 Bring the following items to KLSS at your scheduled time
on Monday, April 7th:
 TELPAS Rater Oaths (for all raters)
 TELPAS Writing Collection Verifier Oath(s)
 TELPAS Reading Test Administrator Oath(s)
 Online Basic Training Certificates
 Online Calibration Certificates
 TELPAS Student Rating Roster
 TELPAS Writing Collection Cover Sheet (both sides)
with writing samples for every student assessed
 Seating Charts for online reading test
 Session rosters for online reading test
* Technology Staff Oath not needed because I will verify
technologists have signed their oaths before giving them
access to TAMS.
Resources












District and Campus Coordinator Manual
Coordinator Manual Resources Webpage
TELPAS Rater Manual
TELPAS Reading Test Administrator Manual
TELPAS Resources Webpage
 PowerPoint training modules posted
Assembling and Verifying Grades 2–12 Writing Collections
online course
 Found on the Texas TrainingCenter
Coordinator’s and Rater’s User Guides for Online Holistic
Rating Training
Educator Guide to TELPAS
User’s Guide for the Texas Assessment Management
System
User Roles and Permissions for the Texas Assessment
Management System
TestNav 7 Combined Technical Guide
Unified Texas Minimum System Requirements
Contact Information
•
•
•
•
•
•
•
Teresa Daugherty, Director for Assessment & Accountability
• Direct line to office: 336-0318
• Cell Phone: (254) 760-4897
• Home Phone: (254) 986-2242
Brenda Gooding, Director’s Secretary : 336-0319
Matt Howell, Testing Coordinator: 336-0336
Deb Brockway, Testing Specialist: 336-0298
Rose Childers, Testing Specialist: 336-0333
Martin McGinnis, Technician: 336-6990
Renee Ham, Data Manager: 336-0320