2014
Accountability
System
Jana Schreiner
Senior Consultant
Accountability
State Assessment
972-348-1480
Jana.Schreiner@Region10.org
Resources
http://ritter.tea.state.tx.us/perfreport/account/
2014/index.html
www.lead4ward.com
www.region10.org/accountability
Reading
Grade 5
Math
Grade 8
Grade 5
Grade 8
Percent Meeting Phase In Standard
Level II: Satisfactory
Percent Meeting Recommended
Standard
Level II: Satisfactory
Region 2013
Region 2014
Region 2013
Region 2014
79%
79% NC
44%
46% +2
86%
85% -1
51%
50% -1
Percent Meeting Phase In Standard
Level II: Satisfactory
Percent Meeting Recommended
Standard
Level II: Satisfactory
Region 2013
Region 2014
Region 2013
Region 2014
75%
80% +5
42%
45% +3
77%
80% +3
35%
39% +4
5th and 8th Reading and Math
100%
95%
90%
85%
80%
85%
80% 79%
79%
80% 79%
82%
76%
Region 10
75%
Texas
70%
65%
60%
55%
50%
5th Math
5th Reading
8th Math
8th Reading
Agenda

Overview Accountability System
 Ratings
 Safeguards
 Distinctions
2014 Ratings Labels
Rating
based on 4
Indexes
Performance Index
Framework
Index 1
Index 2
Index 3
Index 4
Student
Achievement
Student Progress
Closing
Performance
Gaps
Postsecondary
Readiness
Rating based on 4
Performance Indexes
Performance Standards on STAAR
Unknown
Dec. 2014
1st Phase-in
Level II
2nd Phase-in
Level II
Final Level
II
Performance
Index 1: Student Achievement
Index 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all
subjects for all students.
2014
2013





Combined over All Subjects: Reading,
Mathematics, Writing, Science, and Social
Studies.
Student Groups: All Students.
Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments
(15 total):
 Reading I; Reading II; Reading III
 Writing I; Writing II; Writing III
 Algebra l; Geometry; Algebra ll
 Biology; Chemistry; Physics
 World Geography; World History; US History
English Language Learners (English and Spanish
tests):
 ELLs in US schools Years 1-3 excluded
 ELLs in US schools Year 4 or more included




Combined over All Subjects: Reading,
Mathematics, Writing, Science, and Social
Studies.
Student Groups: All Students.
Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments (5
total):
 English l; English ll
 Algebra l
 Biology
 US History

English Language Learners (English and Spanish
tests):
 ELLs in US schools Year 1 excluded
 ELLs in US schools Year 2 and
beyond included
Index 1: Student Achievement



English I and II from Spring 2014 +
Include Reading I and II from July 2013 and
December 2013
Substitute Assessments EOCs (PSAT, PLAN, SAT, ACT,
AP)




Standard at Meeting Final Level II (CCR Standard)
Counted as PASSER for Index I
Counted as Meeting CCR Standard for Index IV
Not used in Index 2 and 3
Index 2: Student Progress
 Progress Measures by Subject Area and School Type
Proposed 2014
2013
Elem. School
Middle School
High School
Elem. School
Middle School
High School
READING
READING
Gr. 4 Reading
Gr. 6 Reading
English l Reading
Gr. 4 Reading
Gr. 6 Reading
_
Gr. 5 Reading
Gr. 7 Reading
English ll Reading
Gr. 5 Reading
Gr. 7 Reading
_
_
Gr. 8 Reading
_
_
Gr. 8 Reading
_
_
English l Reading
_
_
_
_
MATHEMATICS
MATHEMATICS
Gr. 4 Mathematics
Gr. 6 Mathematics
Algebra l
Gr. 4 Mathematics
Gr. 6 Mathematics
Algebra l
Gr. 5 Mathematics
Gr. 7 Mathematics
_
Gr. 5 Mathematics
Gr. 7 Mathematics
_
_
Gr. 8 Mathematics
_
_
Gr. 8 Mathematics
_
_
Algebra l
_
_
Algebra l
_
_
_
WRITING
WRITING
_
_
English ll Writing
_
Index 2: Student Progress
Index 2: 2013 Construction – Table 1
STAAR Weighted
Progress Rate
Example Calculation
for Reading Progress
Number of Tests
Performance
Results:
Met or Exceeded
Progress
Number
Percent
Exceeded Progress
Number
Percent
Reading Weighted
18
Progress Rate
All
Pacific
Two or
African Amer.
Hispani
Student
Asian
Islande White More
Amer. Indian
c
s
r
Races
100
50
ELL
40
30
80 40
80% 80%
40
100
%
20
67%
20 20
20% 40%
30
75%
5
17%
100 120
175
84
Special Total Max.
Ed. Points Points
479 800
Index 2: Student Progress
Index 2: 2013 Construction – Table 2
STAAR Weighted
Progress Rate
All
Students
Africa
Pacific
Two or
Amer.
Hispani
n
Asian
Islande White More
Indian
c
Amer.
r
Races
ELL
Special Total Max.
Ed. Points Points
Reading
Weighted Progress
100
120
175
84
479
800
Mathematics
Weighted Progress
85
98
150
160
493
800
Writing
Weighted Progress
140
170
310
400
Total
Index 2 Score (total points divided by maximum points)
1282 2000
64
Index 2: Student Progress
Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student
group, students with disabilities, and English language learners.
By Subject Area:
Reading, Mathematics
One point for Met progress level
Two points for Exceeded progress level
 Progress Measures by Subject Area and School Type
 New for 2014:
No Index 2 for High Schools (9-12 campuses) or AEA
Inclusion STAAR-Modified, STAAR-Alt
Inclusion of ELL Students
Index 2: Student Progress
Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student
group, students with disabilities, and English language learners.
 New for 2014:
 Students who skip grades included
 Students who transition from Spanish to English in
mathematics included
 3rd grade student who receive ELL progress measure
will count
 ELL Denials: Students whose parent(s) have denied ELL
services included
 Considered as Non-ELL student for Index 2
Where can I find info?


Campus rosters
Student have either STAAR Progress or ELL
Progress
Index 3: Closing Performance Gaps
Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two
lowest performing race/ethnicity student groups.
2013
 Points based on STAAR performance:
 Phase-in 1 Level II satisfactory
2014
 Points based on STAAR performance:
 Phase-in 1 Level II satisfactory performance:
performance:
One point for each percent of tests MET
Phase-in 1 Level II
 By Subject Area:

Reading, Mathematics, Writing, Science, and
Social Studies.
Student Groups:
 Economically Disadvantaged
 Lowest Performing Race/Ethnicity from
2012
One point for each percent of tests MET Phase-in
1 Level II
 Level III advanced performance:
Two points for each percent of tests at
the Level III advanced performance
standard.
 By Subject Area:

Reading, Mathematics, Writing, Science, and Social
Studies.
Student Groups:
 Economically Disadvantaged
 Lowest Performing Race/Ethnicity from
2013…groups must have 25 tests in
reading AND math
 Inclusion of ELL Students
Index 3: Closing Performance Gaps
Index 3: 2014 Construction – Table 1 (based on 2014 STAAR performance)
STAAR Weighted
Performance Rate
Example Calculation for
Reading Weighted
Performance
Number of Tests
Performance Results:
Phase-in 1 Level II
Satisfactory and above
Number
Percent
Level III Advanced
Number
Percent
Reading Weighted
Performance Rate
Economically
Disadvantaged
Lowest Performing
Lowest Performing
Race/Ethnic Group - 1 Race/Ethnic Group - 2
80
40
25
80
100%
20
50%
25
100%
40
50%
0
0%
150
50
Total
Points
Maximum
Points
400
600
25
100%
200
Index 3: Closing Performance Gaps
Index 3: 2014 Construction – Table 2
(based on 2014 assessment results by subject area)
STAAR Weighted
Performance Rate
Economically
Disadvantaged
Lowest Performing
Race/Ethnic Group - 1
Lowest Performing
Race/Ethnic Group - 2
Total
Points
Maximum
Points
Reading Weighted
Performance
150
50
200
400
600
Mathematics Weighted
Performance
125
100
90
315
600
Writing Weighted
Performance
80
90
125
295
600
Science Weighted
Performance
120
40
90
250
600
Social Studies Weighted
Performance
50
40
80
170
600
1430
3000
Total
Index 3 Score (total points divided by maximum points)
48
For Discussion……

ELL
http://ritter.tea.state.tx.us/perfreport/account/2014/index.html
Index 4: Postsecondary Readiness
Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the
foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and
middle schools in preparing students for high school.
2013

Graduation Score: Combined performance across
the graduation and dropout rates for:



Grade 9-12 Four-Year Graduation Rate for All
Students and all student groups; or
Grade 9-12 Five-Year Graduation Rate for All
Students and all student groups, whichever
contributes the higher number of points to
the index.
RHSP/DAP Graduates: All Students and
race/ethnicity student groups.
2014

Graduation Score: Combined performance across the
graduation and dropout rates for:



Grade 9-12 Four-Year Graduation Rate for All Students
and all student groups; or
Grade 9-12 Five-Year Graduation Rate for All Students
and all student groups, whichever contributes the
higher number of points to the index.
RHSP/DAP Graduates: All Students and race/ethnicity
student groups.
 STAAR Score: STAAR Percent Met Final Level ll
for All Students and race/ethnicity student
groups.
Additional Indicators Required by House Bill 5 (83rd Texas
Legislature, 2013)
 College Ready Graduates.
Amer.
Pacific
Asian Hispanic
Indian
Islander
STAAR Score
STAAR % Met
29%
16%
40%
Final Level ll on
Two or More Tests
STAAR Score (STAAR total points divided by maximum points)
23%
White
Two or
More
Races
38%
36%
ELL
Special
Ed.
Total
Points
Max.
Points
182
600
30
Graduation Score (Gr. 9-12)
4-yr. graduation rate
84.3%
78.8%
78.8%
91.6%
86.0%
44.2%
69.8%
533.5
700
5-yr. graduation rate
85.1%
78.8%
80.0%
92.1%
84.0%
48.9%
77.5%
546.4
700
Highest Graduation Total
Graduation Score (best of total graduation points divided by maximum points)
546.4
700
78.0
RHSP/DAP Score
4-yr. graduation
82.7%
76.4%
83.6%
Percent RHSP/DAP
RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points)
83.0%
Postsecondary/College-Ready Graduates Score
College-Ready
82.0%
72.0%
78.0%
Graduates subject
(ELA & Math)
College-Ready Score (total points divided by maximum points)
89.0%
Overall Index Score
STAAR Score
30.0
Multiply
Graduation Score
78.0
by
RHSP/DAP Score
81.4
Weight
College-Ready Score
80.2
Index Score (sum of weighted index scores)
325.7
400
81.4
321.0
80.2
400
Index 4: Postsecondary Readiness
Indicator
All
African
Students Amer.
Index 4: Postsecondary Readiness
STAAR Level II Final Performance
 Percent Met Final Level II on Two or More Assessments
Weighting of Indicators: ALL FOUR components
Indicator
Weight
STAAR Component
25%
Graduation
25%
Graduation Plan
25%
Post-Secondary Indicators
25%
Post-Secondary Indicator:
 Percent Met Criteria on ELA AND MATH
32
Index 4 Targets
STAAR Component




Elementary-12
Middle School-13
High School- 18
21(changed as of
April 25th posting)*
District--13
All four components

Districts, high
schools, and multigrade campuses-56
57 (changed as of
April 25th posting)*
Rating Labels: AEA
2014 System Standard accountability labels:
Met Alternative Standard
Improvement Required
Distinction Designations
2013 Distinction Designation

Campus Top Twenty-Five
Percent:
Campuses in the top quartile
of their campus comparison
group earn a distinction
designation.
2014 Distinction Designation





Student Progress
based on Index 2
Academic Achievement in:
 Reading/ELA
 Mathematics
Campus Top Twenty-Five Percent:
Campuses in the top quartile of their campus comparison group

Student Progress (based on Index 2)
 Closing Performance Gaps (based on Index 3)
Academic Achievement in:
 Reading/English Language Arts
 Mathematics
 Science
 Social Studies
Districts and Campuses Postsecondary Readiness:
House Bill 5 (83rd Texas Legislature, 2013) expanded distinctions
for districts and campuses for attainment of postsecondary readiness
Criteria must include indicators based on percentages of students who:
 Achieve college-readiness standards on STAAR;
 Earn nationally/internationally recognized business/industry




certification;
Complete a coherent sequence of CTE courses;
Complete dual credit or a postsecondary course for local
credit;
Achieve college readiness standards on SAT, ACT, PSAT, or
ACT-PLAN;
Earn college credit based on AP/IB performance.
Accountability Ratings and Distinction Designations
2013 and 2014 Accountability Rating
(Districts and Campuses)
2013 Distinction Designations
Campuses Only
Student Progress
Met Standard
Academic Achievement:
Reading/ELA
Mathematics
2014 Distinction Designations
Districts and Campuses
Postsecondary Readiness
Campuses Only
Student Progress
Closing Performance Gaps
Academic Achievement:
Reading/ELA
Mathematics
Science
Social Studies
Improvement Required
N/A
N/A
System Safeguards
Safeguard Measures and Targets:
 Reporting system disaggregates performance by student
group, performance level, and subject area.
 Performance rates are calculated from the assessment results
used to calculate Index 1: Student Achievement.
 2013 targets for the disaggregated system-safeguard results:
 STAAR performance target corresponds to Index 1 (50%);
 STAAR participation target required by federal
accountability (95%);
 Federal graduation rate targets and improvement

calculations for 4-year rate (78%) and 5-year rate (83%);
and
Federal limit on use of alternate assessments (1% and 2%).
Entity
All
African Amer.
Pacific
Two or More Eco.
Asian Hispanic
White
Students Amer. Indian
Islander
Races
Disadv.
ELL
Special Ed.
Performance Rates*
State
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Federal
79%
79%
n/a
n/a
79%
n/a
79%
n/a
79%
79%
79%
State
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Federal
79%
79%
n/a
n/a
79%
n/a
79%
n/a
79%
79%
79%
Writing
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Science
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Social Studies
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Reading
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
Mathematics
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
Reading
Mathematics
Participation Rates
Federal Graduation Rates (including improvement targets)
4-year
80%
80%
80%
80%
80%
80%
80%
80%
80%
80%
80%
5-year
85%
85%
85%
85%
85%
85%
85%
85%
85%
85%
85%
District Limits on Use of Alternative Assessment Results
Reading
Modified
2%
Not Applicable
Alternate
1%
Not Applicable
Modified
2%
Not Applicable
Alternate
1%
Not Applicable
Mathematics
2014 Accountability System Safeguard Measures and Targets
Indicator
* Targets for 2014 correspond to the performance target for Index 1: Student Achievement.
Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting
40