Fall ELL Assessment Update

advertisement
September 09, 2013
TETN Event #20783
Student Assessment Division
Texas Education Agency
 These slides have been prepared by the Student Assessment
Division of the Texas Education Agency
 If any slide is changed for local use, please remove the TEA
footer at the bottom of the slide
TEA Fall ELL Assessment Update
2
 What’s New
 STAAR Spanish Highlights
 STAAR L
 TELPAS
 Key Steps to Take this Fall
 ELL Progress Measure
TEA Fall ELL Assessment Update
3
 Assessments for students served by special education and
assessments for ELLs are now the responsibility of the
Assessments for Special Populations Unit in the Student
Assessment Division.
TEA Fall ELL Assessment Update
5
 Practice sets consist of approximately 25 items for each
STAAR L assessment
 To be posted in early 2014
 Will be available in online format similar to TELPAS so that
students may experience the items as they will be presented
in the operational administration.
TEA Fall ELL Assessment Update
6
 Beginning 2013–2014, 5th and 8th grade students
assessed with STAAR L in mathematics will be held to same
SSI requirements for both mathematics and reading,
including retesting, as students taking the general STAAR
assessments
TEA Fall ELL Assessment Update
7
 For ELLs who ―
 have been enrolled in U.S. schools 3 school years or less (5 or less if
qualifying unschooled asylee/refugee) and
 have not yet attained TELPAS advanced high reading rating
 When enrolled in English I/ESOL I course, eligible ELL shall
not be required to retake assessment each time it is
administered if student passes course but does not meet
standard
 Rule to be posted for public comment in October for 30
days
Note:
 Students are not exempt from testing while in the course
 Provisions do not apply to English II
TEA Fall ELL Assessment Update
8
 Committees comprised of ELL focus group members and
educators convened in August to review standards for
grades 2–12 TELPAS reading tests
 Cut scores adjusted for each proficiency level of each
grade cluster test
 These standards will be implemented spring 2014
TEA Fall ELL Assessment Update
9
 Beginning in the 2013–2014 school year, students must be
enrolled for 60 consecutive school days for that year to
count in years in U.S. schools calculations. Please note that
this is not to be calculated retroactively.
 Unschooled Asylee Refugee
 Continue as it has in the past
 Students with Interrupted Formal Education (SIFE)
 SIFE and Limited Prior Schooling groups from 2012–2013
have been collapsed
 This data will be collected through the student data upload
 Specific information will be included in the 2014 DCCM
TEA Fall ELL Assessment Update
10
 Spring test administration manuals will be split —
 TELPAS Rater Manual
 TELPAS Reading Test Administrator Manual
 This should decrease the number of additional
manuals ordered by districts
TEA Fall ELL Assessment Update
11
 Available for students in grades 3–5
 Grades 3–5 reading and math
 Grade 4 writing
 Grade 5 science
 Same grades and subjects are tested as English
TEA Fall ELL Assessment Update
13
 Students for whom Spanish version of STAAR test is the most
appropriate measure of academic progress
 LPAC determines if STAAR Spanish is an appropriate
assessment for ELLs and non-ELLs
TEA Fall ELL Assessment Update
14
 Focus is on the most essential curriculum: readiness
standards
 Content and skills are addressed at a greater depth
and cognitive complexity
 Rigor evident on




the test as a whole
individual test questions
more inferential questions
performance standards
TEA Fall ELL Assessment Update
15
TEA Fall ELL Assessment Update
16
 Annual Activities:
 Testing contractor develops items
 TEA reviews items and ensures items meet quality
assurance
 Educators review the items for appropriateness before
they are field tested (language, grade level, TEKS,
free from bias, etc.)
 Items are field tested
 Data of items is reviewed
 Items with solid data are included in the Item Bank
 Tests are constructed from the Item Bank
TEA Fall ELL Assessment Update
17
 Follow the same guidelines as English item development
 Reading and Writing
 The items and/or passages are developed separately to
account for cultural and linguistics differences.
 Mathematics and Science
 Items from English development are translated or
transadapted into Spanish.
TEA Fall ELL Assessment Update
18
 Test items for STAAR Spanish are selected from the
English development
 Goal is to build tests for regular STAAR and STAAR
Spanish using the same items if appropriate
 Item writing and review process for transadapted items
ensure that items in Spanish are linguistically and
culturally appropriate and that they meet grade-level
expectations
 Every year bilingual educators review selected items
for STAAR Spanish tests
TEA Fall ELL Assessment Update
19
 STAAR Spanish and regular STAAR both –
 follow the same item development guidelines
 use the same blueprints
 adhere to same guidelines to build tests in terms of
range of content tested and cognitive complexity
 expect same student performance
TEA Fall ELL Assessment Update
20
2013
Spanish
Total Students (Satisfactory) (Advanced) (Unsatisfactory)L
in 2013
LII-2013
LIII-2013
I-2013
Grade 03 READ
36,841
68%
15%
32%
Grade 04 READ
24,323
57%
11%
43%
Grade 04 WRIT
25,436
59%
3%
41%
Grade 05 READ
10,785
70%
10%
30%
Grade 03 MATH
19,024
59%
8%
41%
Grade 04 MATH
9,426
51%
7%
49%
Grade 05 MATH
3,606
44%
5%
56%
Grade 05 SCIENCE
5,370
41%
2%
59%
TEA Fall ELL Assessment Update
21
Grade
Subject
2012
2013
% Change
3
Math
56%
59%
3%
Reading
65%
68%
3%
Math
53%
51%
-2%
Reading
60%
57%
-3%
Writing
64%
59%
-5%
Math*
49%
44%
-5%
Reading*
69%
70%
1%
Science
41%
41%
0%
4
5
* Primary Administrations
TEA Fall ELL Assessment Update
22




Understand the level of performance the TEKS require
Teach students the academic vocabulary
Teach both readiness and supporting content and skills
Emphasize critical/inferential thinking, problem solving, and
application rather than isolated or memorized content and
skills
 Reinforce connections between different content areas (e.g.,
math and science, math and reading)
TEA Fall ELL Assessment Update
23
TEA Fall ELL Assessment Update
25
TEA Fall ELL Assessment Update
26
TEA Fall ELL Assessment Update
27
TEA Fall ELL Assessment Update
28
TEA Fall ELL Assessment Update
29
TEA Fall ELL Assessment Update
30
 2013 STAAR tests were released in August
 Grade 4 Writing Scoring Guides are available on the
Student Assessment website
 Timeline for new mathematics curriculum
TEA Fall ELL Assessment Update
31
 New TEKS adopted in April 2012
 Convene advisory groups in 2013
 New STAAR items are being developed to address
new TEKS in 2014
 Implement new TEKS in 2014–2015 school year
 New STAAR items are field-tested in 2014–2015
school year
 New STAAR items are assessed in 2015–2016 school
year
TEA Fall ELL Assessment Update
32
 Online interface provided certain linguistic
accommodations for qualifying students:
 Clarification in English at the word or phrase level for
pre-determined words
 Words read aloud at the word-by-word level
 35,000 students across the state were administered
STAAR L across all administration in 2013
TEA Fall ELL Assessment Update
34
 Available early spring 2014
 Minor updates to grades 3–8; Updates to EOC version
to address assessment changes from HB 5
 Should be used to familiarize students with clarification
and read aloud accommodations and standard
TestNav tools
 Test administration directions for operational STAAR L
assessments will assume some familiarity with online
interface
TEA Fall ELL Assessment Update
35
 Paper test booklets (and ECGs as applicable) will be
approved by TEA in rare circumstances
 Accommodations that are not available in TestNav
 Unavoidable technological problems that make online testing
impossible
 Other special situations (e.g., homebound students, JJAEPs,
etc.)
 Detailed information about STAAR L paper request process
will be posted on Coordinator Manual Resources page at
http://www.tea.state.tx.us/student.assessment/manuals/dccm
TEA Fall ELL Assessment Update
36
 Student who was approved for a paper administration
in the spring but is retesting in December will not
automatically receive paper materials
 DTC should forward prior approval to TEA at
ELL.tests@tea.state.tx.us so paper materials can be
ordered from Pearson
TEA Fall ELL Assessment Update
37
 Reminder: These students are not eligible for special ELL
assessment, accommodation, or accountability provisions




No testing in Spanish
No linguistic accommodations during testing
No English I EOC special provisions
No unschooled asylee/refugee provisions
 ELLs with parental denials may, however, use bilingual, ESL,
or other allowable dictionaries as part of dictionary policy
for STAAR reading and writing tests in grade 6 and up;
under this policy, use of dictionaries not considered linguistic
accommodation
TEA Fall ELL Assessment Update
38
 Assessment window for spring: March 17–April 9
 Data verification window: April 10–11
TEA Fall ELL Assessment Update
40
Date
Activity
Jan 13
Assembling and Verifying Grades 2–12 Writing Collections course available
Jan 6-10
TELPAS manuals shipped to districts
Jan 24
End date for district coordinator training—all TELPAS components
Jan 27
Online basic training courses for new K–1 and 2–12 raters available
Jan 27
Supplemental support provider recorded Web-based training available
Feb 7
End date for campus coordinator training—holistically assessed components
Feb 17
Calibration window opens for new and returning raters—first 2 sets
Feb 17
End date for training raters on administration procedures
Feb 17
Earliest eligibility date for TELPAS writing samples
Feb 26
3rd and final calibration set available; supplemental training begins
Mar 17-Apr 9 TELPAS assessment window
TEA Fall ELL Assessment Update
41
2013–2014 training resources:
 PowerPoint presentations (updated)
 Making the ELPS-TELPAS Connection: K–12 Overview
 Introductory Training on the PLDs (separate modules for K–1
and 2–12)
 Grades 2–12 Writing Collection Overview
 Holistic Rating Training Requirements
 Educator Guide to TELPAS
These resources will be available on the TELPAS Resources webpage at
www.tea.state.tx.us/student.assessment/ell/telpas/
TEA Fall ELL Assessment Update
42
Grades
K–1
Grade 2
Grades
3–5
Grades
6–8
Grades
9–12
2012 Total
Successful
Calibrations
29205
100%
15464
100%
36054
100%
17160
99%
14988
98%
2013 Total
Successful
Calibrations
29689
100%
15336
100%
36415
99%
17460
99%
15454
98%
2012 Successful
after Set 1
26599
91%
13863
90%
30142
83%
13233
77%
9964
65%
2013 Successful
after Set 1
25901
87%
11466
75%
23432
64%
13659
77%
12154
77%
TEA Fall ELL Assessment Update
43
Grades
K–1
Grade 2
Grades
3–5
Grades
6–8
Grades
9–12
2012 Successful
after Set 2
2365
8%
1336
9%
4948
14%
3433
20%
3804
25%
2013 Successful
after Set 2
3234
11%
3203
21%
10126
28%
2424
14%
2702
17%
2012 Successful
after Set 3
241
1%
265
2%
964
3%
494
3%
1220
8%
2013 Successful
after Set 3
554
2%
667
4%
2857
8%
1377
8%
598
4%
2012 Unsuccessful
after Set 3
8
0%
13
0%
136
0%
87
0%
246
2%
2013 Unsuccessful
after Set 3
47
0%
46
0%
250
1%
199
1%
379
2%
TEA Fall ELL Assessment Update
44
Course
Completions
Assembling and Verifying Writing Collections
8138
Grades K–1 Online Basic Training Course
17961
Grades 2–12 Online Basic Training Course
22741
TEA Fall ELL Assessment Update
45
 There will be a full release of TELPAS forms for all
grade bands in 2014.
 These are to be released in an online format to allow
them to be seen in the TestNav environment, just as the
students see the operational test.
TEA Fall ELL Assessment Update
46
 Teachers are required to implement the ELPS and
content area TEKS in instruction
 District and campus administrators need working
knowledge of ELPS and TELPAS
 TELPAS familiarization training is
 good for future raters
 good way to reinforce use of PLDs all year long
TEA Fall ELL Assessment Update
48
 Beginning of year:
 Review ELLs’ past TELPAS results to see if making steady
progress in learning English
 TELPAS confidential campus student rosters include
 2 years of test scores
 how long student has been in U.S. schools
TEA Fall ELL Assessment Update
49
LPAC meetings during school year:
 Use previous spring’s TELPAS results and current year’s
teacher input to
 gauge progress in English proficiency
 review and adjust linguistic accommodations used in
instruction
 plan for instructional interventions, if necessary
 plan for linguistic accommodations during state
assessment
TEA Fall ELL Assessment Update
50
 When implemented effectively in instruction, linguistic
accommodations
 accelerate learning of academic content and English
 reduce length of time and degree to which substantial
linguistic accommodations needed
The ELPS, as measured by TELPAS, support
better learning of the TEKS, as measured by STAAR
TEA Fall ELL Assessment Update
51
 ELL Progress Measure will:
 take into account the amount of time needed to
acquire English affects time needed to fully learn
and demonstrate grade-level academic skills in
English
 be applied to all content areas
 Brochure with more information to be posted this fall on
the ELL Assessments webpage at
http://www.tea.state.tx.us.student.assessment/ell
TEA Fall ELL Assessment Update
53
Satisfactory
TEA Fall ELL Assessment Update
54
Initial
Years in
Schools
1
DRAFT
1
1
1
1
2
2
2
2
3
3
3
4
TEA Fall ELL Assessment Update
4
Initial TELPAS
Composite
Proficiency
Level
Beginning and
Extenuating
Circumstances
Beginning
Intermediate
Advanced
Advanced High
Intermediate or Below
and Extenuating
Circumstances
Intermediate or Below
Advanced
Advanced High
Advanced or Below and
Extenuating
Circumstances
Advanced or Below
Advanced High
Advanced High or Below
and Extenuating
Circumstances
Any TELPAS Score
Plan
5-Year Plan
4-Year Plan
3-Year Plan
2-Year Plan
1-Year Plan
5-Year Plan
4-Year Plan
3-Year Plan
2-Year Plan
5-Year Plan
4-Year Plan
3-Year Plan
5-Year Plan
4-Year Plan
55
ELL Progress
Measure Plan
Expectation
1st Year (E1)
2nd Year (E1)
5-Yr Plan
3rd Year (E2)
4th Year (E3)
5th Year (LII)
1st Year (E1)
DRAFT
4-Yr Plan
2nd Year (E2)
3rd Year (E3)
4th Year (LII)
1st Year (E2)
3-Yr Plan
2nd Year (E3)
3rd Year (LII)
2-Yr Plan
1-Yr Plan
1st Year (E3)
2nd Year (LII)
1st Year (LII)
TEA Fall ELL Assessment Update
56
 ELL Progress Measure will be incorporated into the
2014 state accountability reports
 Used to calculate accountability for both Index 1 & 2
 For detailed information regarding the accountability
system:
http://ritter.tea.state.tx.us/perfreport/account/2013/2
0130328coe/pi_technical_5-23-13.pdf
TEA Fall ELL Assessment Update
57
Annual ESC LPAC Assessment Training TETN
October 8, 2013
9:00 a.m. – 12:00 p.m.
Event #20784
Open to ESCs only
TEA Fall ELL Assessment Update
58
Educators are invited to review items before they are
field tested for:
STAAR (all programs) and TELPAS
Please go to the following link to nominate
yourself or other educators: http://educator.force.com/TX
TEA Fall ELL Assessment Update
59
“This was a great learning experience”
“I would love to participate again”
“Fue una experiencia muy bonita y educativa”
“The meeting was informative and made me feel like I made a
difference”
“Awesome experience!”
“!Aprendí mucho!”
“Excellent process and very beneficial!”
“I really felt that I contributed with my opinions”
TEA Fall ELL Assessment Update
60
 Go to www.tea.state.tx.us/student.assessment and click on
ELL Assessments
 Call the TEA Student Assessment Division at (512) 463-9536
 Email us at ELL.tests@tea.state.tx.us
TEA Fall ELL Assessment Update
61
Download