2014
Accountability
System Overview
Kim Gilson
Senior Consultant
Data and Accountability
972-348-1480
kim.gilson@region10.org
http://ritter.tea.state.tx.us/perfreport/account/2014/index.html
Accountability Resources:
http://ritter.tea.state.tx.us/perfreport/account/2014/faq.html
Accountability Resources FAQ:
2014 Ratings Labels
Performance Index
Framework
Index 1
Index 2
Index 3
Index 4
Student
Achievement
Student Progress
Closing
Performance
Gaps
Postsecondary
Readiness
Rating based on 4
Performance Indexes
All Targets Must Be Met
In a nutshell…







Formerly excluded ELLs come into the system
Progress available to more students in index
two
Held to Level III advanced in Index Three
Held to Final Recommended in Index Four
Safeguard Targets Increase
More Distinctions Available
First Year of No High School TAKS Scores
LOOKING FORWARD…
2014 to 2015…
STAAR Phase-In Changes Announced
STAAR Standards Phase-In Old to New
10
Advanced Level III: No Changes
New Math TEKS and Accountability
Students who participate in the spring 2015
STAAR grades 3–8 mathematics
administrations will receive a raw score prior
to the end of the school year. Once new
performance standards are approved, they will
be retroactively applied to students’ test results
from the spring 2015 administrations. New
reports and data files will be sent to school
districts in August 2015.
New Math TEKS and Accountability
Student Success Initiative (SSI) retest
opportunities for STAAR mathematics at grades
5 and 8 will not be offered in 2015. For the
2014–2015 school year, districts will use other
relevant academic information to make
promotion/retention decisions for mathematics.
Please note that SSI will still be in effect for
reading in 2014–2015.
New Math TEKS and Accountability
2015 state and federal accountability results
will not be based on the new standards. For
accountability purposes only, the state plans to
establish a link between the spring 2015
STAAR grades 3–8 mathematics tests and the
previous mathematics tests to determine
equivalent performance standards
STAAR A


STAAR M is no longer available
STAAR A is an online version of
Regular STAAR with digitally
based accommodations
 Available
to Special Education
students and 504 students with
dyslexia or a related disorder

STAAR A is NOT subject to the 2%
cap on alternative assignments
STAAR Alternate 2



Paper/pencil version of STAAR Alt
Standardized
Still subject to 1% cap on
Alternative Assessments
Index 1
Did Students Meet Level II
Phase-In I?
Index 1: Student Achievement
Index 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all
subjects for all students.
2014
2013





Combined over All Subjects: Reading,
Mathematics, Writing, Science, and Social
Studies.
Student Groups: All Students.
Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments
(15 total):
 Reading I; Reading II; Reading III
 Writing I; Writing II; Writing III
 Algebra l; Geometry; Algebra ll
 Biology; Chemistry; Physics
 World Geography; World History; US History
English Language Learners (English and Spanish
tests):
 ELLs in US schools Years 1-3 excluded
 ELLs in US schools Year 4 or more included




Combined over All Subjects: Reading,
Mathematics, Writing, Science, and Social
Studies.
Student Groups: All Students.
Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments (5
total):
 English l; English ll
 Algebra l
 Biology
 US History

English Language Learners (English and Spanish
tests):
 ELLs in US schools Year 1 excluded
 ELLs in US schools Year 2 and
beyond included
EOC’s and Accountability:
TEA takes the BEST SCORE of a the PREVIOUS
July, December, and Current May
Administration
(regardless of when student first tested)
Index 1: Student Achievement
How Many Students Passed (Phase-in 1 Level II)
How Many Students Took The Test
NEW TARGET FOR 2014 is
55%
(2013 was 50%)
Index 1 Data Table Study
Index 1 Target: 55
(AEC’s: 30)
Group: All Students
Looking to 2015…

Expect an increase in the target
 2013
was 50
 2014 was 55


Statutory Requirements are that all
assessments are included in the accountability
system .
Index 1 “works” for all tests, including new
ones!
Index 2
Student Growth
(Not evaluated for AEC’s or High Schools)
Big Idea:
Did ALL Students
Improve from their
2013 Performance?
ALL Students…





Low students
Middle students
Special Education students
High Performing students
Students of all Race/Ethnicities
Index 2: Student Progress
Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student
group, students with disabilities, and English language learners.
 New for 2014:
 Students who skip grades included
 Students who transition from Spanish to English in
mathematics included
 3rd grade student who receive ELL progress measure
will count
 ELL Denials: Students whose parent(s) have denied ELL
services included
 Considered as Non-ELL student for Index 2
Surprise!

ELL students in 3rd Grade received an ELL
Progress Measure
Index 2: Student Progress
 Progress Measures by Subject Area and School Type
2013
Elem. School
Middle School
2014
High School
READING
Elem. School
High School
READING
Gr. 4 Reading
Gr. 6 Reading
English l
Reading
Gr. 5 Reading
Gr. 7 Reading
English ll
Reading
_
Gr. 8 Reading
_
_
_
English l
Reading
_
MATHEMATIC
S
MATHEMATI
CS
Middle School
Gr. 4 Reading
Gr. 6 Reading
_
Gr. 5 Reading
Gr. 7 Reading
_
Gr. 8 Reading
_
_
_
_
Gr. 4
Mathematics
Gr. 6
Mathematics
Algebra l
Gr. 5
Mathematics
Gr. 7
Mathematics
_
Gr. 4
Mathematics
Gr. 6
Mathematics
Gr. 5
Mathematics
Gr. 7
Mathematics
_
_
Gr. 8
Mathematics
_
Gr. 8
Mathematics
_
_
Algebra l
_
_
Algebra l
WRITING
High Schools and Index 2




You didn’t receive a rating, BUT you
have data, AND contributed to the
district
Algebra 1: A Full Class!
Reading: ELL Progress Measure and
STAAR Alt
Last Page of Distinction Designations
will give you a Quartile Ranking for
Math and Reading “Greater Than
Expected Student Growth”
Quartile Data

Last Page of Distinction
Designation Report
Weighted Index:
1 Point for Meeting Growth
2 Points for Exceeding Growth
Minimum Size: 25
Index 2: Student Progress
2014: Reading and Math Are The Only
Subjects Included
The index calculation is a 2-step process
Index 2: Student Progress
Index 2: 2014 Construction – Page 21 Acct. Manual
Index 2: Student Progress
Index 2: 2014 Construction – Page 21 Acct. Manual
Index 2 Data Table Study
Index 2 Target:
Targets (released July 29):
District 16
Elementary 33
Middle 28
High School/K-12 NA
Groups: Race/Ethnicity, Sped, ELL
Minimum Size: 25
Index 2







-This index does not discriminate
Of those campuses who missed Index 2:
10 <55 (missed Index 1)
15 55-70 in Index 1
9 71-80 in Index 1
5 81-90 in Index 1
2 90’s (92 and 95) in Index 1
Looking Forward…


2015: 7th Grade Writing!!!
3-8 Math will not receive a Growth Measure
for 2015
 This
leaves: Reading, Writing, and Math for ELL
students



Index 2 is “TBD” for grades 3-8 for 2015
Students who change test formats (M to
Regular, or Anyone taking A) will not receive
a growth measure
HIGH SCHOOL IS BACK IN INDEX 2!!!
Looking Forward




High School Index 2 Will be Comprised of:
Eng 1 to Eng 2
8th Grade Math to Algebra 1
So…No Eng 1…..except for ELL’s through the
ELL Progress Measure
Looking Forward…

What if my campus is Improvement Required
for Index 2….and then we don’t receive an
Index 2 score in 2015???
Index 3: Closing
Performance Gaps
Big Idea:
“Passing” Isn’t Enough!
Performance at the Highest
Level is Achieved for ALL
Students
Let’s Put it in Instructional
Language:


Who is answering the 5-6 hardest questions on
the test correctly?
Note that before they can answer them
correctly…
 They
must have prior experience in problems of
that rigor AND
 They must be expected to attempt them
independently
Groups:
Econ Dis AND
Lowest Performing Student
Groups from Last Year
Group Selection
•
•
From 2013 Data, any race/ethnicity group with at least 25 tests
in Reading AND Math is eligible.
The lowest performing are chosen for 2014 analysis
•
If 3+ groups meet minimum size, then lowest 2 are
chosen
•
If 2 groups meet minimum size, then lowest is chosen
•
If 1 group meets minimum size, then no race/ethnicity
group is used
Index 3: Closing Performance Gaps
Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two
lowest performing race/ethnicity student groups.
2013
 Points based on STAAR performance:
 Phase-in 1 Level II satisfactory
2014
 Points based on STAAR performance:
 Phase-in 1 Level II satisfactory performance:
performance:
One point for each percent of tests MET
Phase-in 1 Level II
 By Subject Area:

Reading, Mathematics, Writing, Science, and
Social Studies.
Student Groups:
 Economically Disadvantaged
 Lowest Performing Race/Ethnicity from
2012
One point for each percent of tests MET Phase-in
1 Level II
 Level III advanced performance:
Two points for each percent of tests at
the Level III advanced performance
standard.
 By Subject Area:

Reading, Mathematics, Writing, Science, and Social
Studies.
Student Groups:
 Economically Disadvantaged
 Lowest Performing Race/Ethnicity from 2013
data…groups must have 25 tests in
reading AND math
 Inclusion of ELL Students
Writing, Science, And Social
Studies



It is not uncommon to see 0’s for student
groups in these subjects
Groups can only be included if they meet
minimum size in Reading AND Math
Because Writing, Science, and Social Studies
aren’t tested every year, student groups often
do not meet minimum size and are excluded
from these subjects
Index 3: Closing Performance Gaps
READING
Index 3: 2014 Construction – Page
STAAR Weighted Performance
Rate
Example Calculation for
Reading Weighted
Performance
Number of Tests
Performance Results:
Phase-in 1 Level II
Satisfactory and above
Number
Percent
Level III Advanced
Number
Percent
Reading Weighted
Performance Rate
Economically
Disadvantaged
Lowest Performing
Race/Ethnic Group - 1
Lowest Performing
Race/Ethnic Group - 2
80
40
25
80
100%
20
50%
25
100%
40
50%
0
0%
150
50
Total
Points
Maximum
Points
400
600
25
100%
200
Index 3: Closing Performance Gaps
Index 3: 2014 Construction – Table 2
(based on 2014 assessment results by subject area)
STAAR Weighted
Performance Rate
Economically
Disadvantaged
Lowest Performing
Race/Ethnic Group - 1
Lowest Performing
Race/Ethnic Group - 2
Total
Points
Maximum
Points
Reading Weighted
Performance
150
50
200
400
600
Mathematics Weighted
Performance
125
100
90
315
600
Writing Weighted
Performance
80
90
125
295
600
Science Weighted
Performance
120
40
90
250
600
50
40
80
170
600
1430
3000
Social Studies Weighted
Performance
Total
Index 3 Score (total points divided by maximum points)
48
What the reports don’t say…

How do ALL Students compare in Advanced
Level III to the Student Groups?
 Do
we have a problem for ALL Students, or just
certain groups?
 You
need to go back to Pearson reports from last
year or use data management programs to find
that
Index 3 Data Tables
Study
Targets (released July 29):
Districts 28
Elementary 28
Middle 27
High School/K-12 31
AEC’s: 11
Looking Forward…

STAAR A is TBD in Index 3
Index 4
Post Secondary
Readiness
Index 4: Postsecondary Readiness
Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the
foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and
middle schools in preparing students for high school.
2013


Graduation Score: Combined performance across
the graduation and dropout rates for:
 Grade 9-12 Four-Year Graduation Rate for All
Students and all student groups; or
 Grade 9-12 Five-Year Graduation Rate for All
Students and all student groups, whichever
contributes the higher number of points to
the index.
RHSP/DAP Graduates: All Students and
race/ethnicity student groups.
2014

Graduation Score: Combined performance across the
graduation and dropout rates):



Grade 9-12 Four-Year Graduation Rate for All Students
and all student groups; or (2013 Cohort)
Grade 9-12 Five-Year Graduation Rate for All Students
and all student groups, whichever contributes the
higher number of points to the index. (2012 Cohort)
RHSP/DAP Graduates: All Students and race/ethnicity
student groups. (Class of 2013)
 STAAR Score: STAAR Percent Met Final Level
ll for All Students and race/ethnicity student
groups.
Additional Indicators Required by House Bill 5 (83rd Texas
Legislature, 2013)
 College Ready Graduates. (Class of 2013)
Index 4: 4 Components
STAAR Final Level II in 2+ Subjects: ALL
Grade Levels
Graduation Rate: High Schools Only
Recommended/Distinguished Graduates: High
Schools Only
College Ready Graduates: High Schools Only
STAAR Component
•
•
This applies to Everyone!
Final Level II on 2+ Tests
(1 test if a student only takes 1)
• STAAR and STAAR Modified
(No STAAR Alt)
• All Subjects
Index 4 Targets
STAAR Component




Elementary-12
Middle School-13
High School- 18
21(changed as of
April 25th posting)*
District--13
All four components

Districts, high
schools, and multigrade campuses-56
57 (changed as of
April 25th posting)*
Indicator
Afric
All
an
Students Amer
.
Amer.
Indian
Asian
Pacific
Two or
Hispani
Islande White More
c
r
Races
STAAR Score
STAAR % Met
Final Level ll on
29%
16%
40%
23%
Two or More Tests
STAAR Score (STAAR total points divided by maximum points)
38%
ELL
Special
Ed.
36%
86.0%
44.2%
69.8%
STAAR Component: All Grade
Levels 77.5%
84.0% 48.9%
RHSP/DAP Score
4-yr. graduation
82.7%
76.4%
83.6%
83.0%
Percent RHSP/DAP
RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points)
Minimum
Size = 25
Minimum
Overall Index Score
30.0
STAAR Score
Multipl
78.0
Graduation Score
y
81.4
RHSP/DAP Score
by
College-Ready
80.2
Weight
Score
Index Score (sum of weighted index scores)
Max.
Points
182
600
30
Graduation Score (Gr. 9-12)
4-yr. graduation
84.3%
78.8%
78.8%
91.6%
rate
5-yr. graduation
85.1%
78.8%
80.0%
92.1%
rate
Highest Graduation Total
Graduation Score (best of total graduation points divided by maximum points)
Postsecondary/College-Ready Graduates Score
College-Ready
Graduates subject
82.0%
72.0%
78.0%
(ELA & Math)
College-Ready Score (total points divided by maximum points)
Total
Points
is 25
89.0%
533.5
700
546.4
700
546.4
78.0
325.7
700
400
81.4
Size
321.0
400
80.2
This IS Index 4 for Elementary and Middle Schools
Elementary and Middle School
Targets
•
•
•
•
•
Targets are based on your campus
configuration. (P. 15 of the Accountability
Manual)
Elementary is 12
Middle School is 13
High Schools who only have one component is
21
Districts who ONLY have the STAAR
Component is 13.
Index 4 Data Tables
Study: STAAR
Component
Graduation Rates
(or Annual Dropout Rate)
Class of 2013 4-year Graduation Rate
OR Class of 2012 5-year Graduation Rate
(whichever is higher)
OR 2012-2013 Annual Dropout Rate for Grades 9-12 for
campuses and students in Grades 9, 10, 11, or 12 (only if no
graduation rate available)
Graduation Plan Component
Recommended or Distinguished Plans
• 4-year Longitudinal Cohort (Class
of 2013)
Or
• Annual Percent if No Longitudinal
Data
College Ready Graduates
Index 4 Construction: If All 4
Components are Included
Average Your 4 Components:
STAAR Component
Graduation Rates
Graduation Plans
Post Secondary Indicator
Index 4 Construction: If All 4
Components are Included
Targets:
Districts
57
High Schools/K-12 57
Index 4 Data Tables
Study: Graduation
Rates, Plans, and Post
Secondary Indicator
System Safeguards




Designed to Ensure that Student Group
Performance is not Masked by A Performance
Index Framework
Calculated from Index 1 Data, and Graduation
Rates in Index 4
State Minimum Size: 25
Federal Minimum Size (for groups):
 Performance
and Participation is 25 and 10% or 200
 Graduation Rates:

Federal Grad Rates Have an Improvement Target
(P. 78)
Entity
All
African Amer.
Pacific
Two or More Eco.
Asian Hispanic
White
Students Amer. Indian
Islander
Races
Disadv.
ELL
Special Ed.
Performance Rates*
76
State
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Federal
79%
79%
n/a
n/a
79%
n/a
79%
n/a
79%
79%
79%
State
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Federal
79%
79%
n/a
n/a
79%
n/a
79%
n/a
79%
79%
79%
Writing
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Science
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Social Studies
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
55%
Reading
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
Mathematics
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
95%
Reading
Mathematics
Participation Rates
Federal Graduation Rates (including improvement targets)
4-year
80%
80%
80%
80%
80%
80%
80%
80%
80%
80%
80%
5-year
85%
85%
85%
85%
85%
85%
85%
85%
85%
85%
85%
District Limits on Use of Alternative Assessment Results
Reading
Modified
2%
Not Applicable
Alternate
1%
Not Applicable
Modified
2%
Not Applicable
Alternate
1%
Not Applicable
Mathematics
* Targets for 2014 correspond to the performance target for Index 1: Student Achievement.
Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting
2014 Accountability System Safeguard Measures and Targets
Indicator
Looking Forward…



Class of 2014 will have TAKS scores
for Post-Secondary Readiness
Indicators
Graduation Plans will need to be
redefined for Foundation Plans and
Endorsements
EOC Retesters and OOS students???
Distinctions
Distinctions Available 2014

Campuses:
 Academic
Achievement in Reading/ELA
 Academic Achievement in Math
 Academic Achievement in Science*
 Academic Achievement in Social Studies*
 Top 25%: Student Progress
 Top 25%: Closing Performance Gaps*

Campuses and Districts:
 Postsecondary
Readiness*
Comparison Groups



Campuses and Districts are ranked in a
comparison group with 40 comparable schools
The Quartile is notated on your Distinction
Tables (Q1, Q2, Q3, Q4)
Being in Top Quartile Contributes to the
Distinction
Calculations

Academic Achievement in Reading/ELA, Math,
Science, Social Studies, and Science:
 High
Schools: Q1 in at least 1/3 of Indicators
 Middle/Junior High/Elementaries: Q1 in at least ½
of Indicators
 Attendance
Plus One Other Indicator Required
Example
Top 25% Distinctions


Top 25% in Student Progress
Top 25% Closing Achievement Gaps
 Campuses
are ranked with their comparison
groups
 High Schools are not eligible this year for Top
25% Student Progress because they don’t receive
an Index 2 score
Post Secondary Readiness

Elementary/Middle/Junior Highs Have 1
Indicator: Index 4 STAAR Component
 They
are ranked with their comparison group
and earn a Distinction for Top 25%


High Schools and K-12 Have 8 Indicators and
Must be Q1 in at least 1/3 of the Indicators
Districts Must Have at Least 70% of CampusLevel Indicators in Q1
Final Ratings Overview





What areas are strengths and weaknesses for
your district?
What answers do your reports provide?
What questions do they create?
What are your next steps?
What support do you need from Region X?