FLDOE “Value-Added Model”
School District of Palm Beach County
Performance Accountability
DRE
Background: FLDOE Value-Added Model
• Established by Student Success Act
(SB 736)
• Developed by committee of teachers, principals,
parents, union representatives, superintendents,
school board members, district administrators and
postsecondary faculty
DRE
What is the FLDOE
“Value-Added Model”?
DRE
Florida
Model
The Answer
DRE
Thank you for your attention.
Do you have any questions?
DRE
FLDOE Value-Added Model
• Teacher Component
• School Component
• Based on Student Learning Growth
– Predictions cannot be different based on student’s
gender, race, ethnicity, or socioeconomic status
DRE
FLDOE Value-Added Model
Variables determining student learning growth
Two or more years of prior achievement scores
Gifted status
Attendance
Mobility (number of transitions)
Difference from modal age in grade (indicator of retention)
Class size
The number of subject-relevant courses in which
the student is enrolled
• Homogeneity of entering test scores in the class
•
•
•
•
•
•
•
DRE
FLDOE Value-Added Model
Variables determining student learning growth
• Students with Disabilities (SWD) status
–
–
–
–
–
–
–
–
–
–
Language impaired
Hearing impaired
Visually impaired
Emotional/behavioral
Specific learning disability
Dual sensory impaired
Autism spectrum disorder
Traumatic brain injury
Other health impaired
Intellectual disability
• English Language Learner (ELL) status
– LY
DRE
FLDOE Value-Added Model
Variables determining student learning growth
TERMS
DRE
What is the
Student Learning Growth Score?
The difference between
Current test score and
Predicted test score
What is the
Predicted Student Score?
DRE
60 70 80 90 100…
85
75
65
20 30 40 50
55
45
35
25
10
CURRENT TEST
What is the Predicted Student Score?
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
85
75
65
PREDICTED SCORE
55
55
45
Answer:
Average of the current
scores of similar students
The prediction describes
typical growth observed
among similar students.
35
25
10
CURRENT TEST
What is the Predicted Student Score?
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
ACTUAL SCORE
Above Predicted Score
PREDICTED SCORE
Below Predicted Score
ACTUAL SCORE
10
CURRENT TEST
Student Learning Growth is the Amount
Above or Below Predicted Score
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
DRE
60
50
20 30 40 50
60 70 80 90 100…
70
?
Each prior year
test score will
have a Predicted
current year test
score.
10
CURRENT TEST
What is the Predicted Student Score
Based on Prior Achievement?
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
FLDOE Value-Added Model
• Two or more years of prior
achievement scores
• Attendance
• Mobility (number of transitions)
• Difference from modal age in
grade (indicator of retention)
• Class size
• The number of subject-relevant
courses in which the student is
enrolled
• Homogeneity of entering test
scores in the class
• LY
•
•
•
•
•
•
•
•
•
•
•
Gifted status
Language impaired
Hearing impaired
Visually impaired
Emotional/behavioral
Specific learning disability
Dual sensory impaired
Autism spectrum disorder
Traumatic brain injury
Other health impaired
Intellectual disability
What is the Predicted Student Score?
10
20 30 40 50
60 70 80 90 100…
Based on Prior Achievement
& Other Variables
CURRENT TEST
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
Based on Prior Achievement
Only
10
20 30 40 50
60 70 80 90 100…
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
Reading Grade 7
Indicators By Degree of Impact
All other variables being equal
Indicator
ELL Indicator
Intellectual Disability
DSS Points
32
-24
Reading Grade 7
Indicators Ranked By Statistical Significance
Indicator
Achievement: Prior Year
Achievement: Two Prior Years
Enrolled in 2 or more courses
Difference from Modal Age
Attendance
Number of students in Class 1
Homogeneity of Class 2 Prior Year Test Scores
Language Impaired
Specific Learning Disability
Homogeneity of Class 1 Prior Year Test Scores
ELL Indicator
Homogeneity of Class 3 Prior Year Test Scores
Number of students in Class 5
Enrolled in 2 or more class periods
Mobility: Number of School Transfers
Intellectual Disability
T-Statistic
75.667
38.167
18.354
15.977
13.571
8.439
7.182
5.362
5.013
4.750
4.673
3.188
2.385
2.289
2.271
2.141
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
What is the Predicted Student Score?
10
20 30 40 50
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
Calculating Learning Growth of Students
10
20 30 40 50
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
55
45
10
C
40
40
50
-10
D
50
70
60
10
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
Calculating Learning Growth of Students
10
20 30 40 50
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
55
45
10
C
40
40
50
-10
D
50
70
60
10
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
Calculating Learning Growth of Students
10
20 30 40 50
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
55
45
10
C
40
40
50
-10
D
50
70
60
10
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
10
CURRENT TEST
Calculating Learning Growth of Students
10
20 30 40 50
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
55
45
10
C
40
40
50
-10
D
50
70
60
10
60 70 80 90 100…
PRIOR TEST
DRE
How do you calculate the
teacher learning growth score?
• Identify the students assigned to the teacher
TERMS
• Determine the learning growth of each of the
assigned students
• Calculate the average learning growth of the
students
DRE
60 70 80 90 100…
20 30 40 50
Ms. Typical
Student Growth
10
CURRENT TEST
Teacher Growth Score = Average Student Growth
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
55
45
10
C
40
40
50
-10
D
50
70
60
10
Average
10
20 30 40 50
0
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
Ms. Positive
Student Growth
10
CURRENT TEST
Teacher Growth Score = Average Student Growth
Student
PY
CY
Pred
Growth
A
20
30
40
- 10
B
30
55
45
10
C
40
75
50
25
D
50
70
60
10
Average
10
20 30 40 50
8.75
60 70 80 90 100…
PRIOR TEST
DRE
60 70 80 90 100…
20 30 40 50
Ms. Negative
Student Growth
10
CURRENT TEST
Teacher Growth Score = Average Student Growth
Student
PY
CY
Pred
Growth
A
20
30
40
-10
B
30
25
45
- 20
C
40
40
50
-10
D
50
70
60
10
Average
10
20 30 40 50
- 7.5
60 70 80 90 100…
PRIOR TEST
DRE
How do you calculate the
school learning growth score?
• Identify the students assigned to the school
• Determine the learning growth of each of the
assigned students
• Calculate the average learning growth of the
students
DRE
PY
CY
Pred
Growth
G
10
65
35
30
H
20
25
45
-20
I
30
55
45
10
J
40
40
50
-10
20 30 40 50
60 70 80 90 100…
Stdt
K
50
55
55
0
L
60
45
60
-15
M
70
85
70
15
N
80
45
75
-30
O
90
80
100
-20
10
CURRENT TEST
School Growth Score = Average Student Growth
Avg
10
20 30 40 50
-4.44
60 70 80 90 100…
PRIOR TEST
DRE
How is the Teacher ValueAdded Score Calculated?
DRE
FLDOE Teacher Value-Added Model
Conceptual
=
(
Teacher
Growth
) + (.5
School
Growth
)
X
School
Growth
Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)
DRE
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
2400
2200
2000
1800
1600
1400
1200
1000
1000
1200
1400
1600
1800
2000
2200
2400
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
TEACHER A
2400
2200
2000
1800
1600
1400
1200
1000
1000
1200
1400
PY Math CY Math Predicted Growth
1717
1833
1844.89
-11.89
1764
1922
1876.31
45.69
1553
1793
1735.28
57.72
1683
18862000
1822.17
63.83
1600
1800
2200
2400
Avg
38.84
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
TEACHER B
2400
2200
2000
1800
1600
1400
1200
1000
1000
1200
1400
PY Math CY Math Predicted Growth
1506
1684
1703.86
-19.86
1997
2059
2032.04
26.96
1691
1857
1827.51
29.49
1153
1510
1467.92
42.08
2036
2108
2058.11
49.89
1876
2003
1951.17
51.83
1600
1800
2000
2200
2400
Avg
30.06
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
TEACHER C
2400
2200
2000
1800
1600
PY Math CY Math Predicted
1400
1200
1000
1000
1200
1400
1600
Avg
Growth
1777
1865
1885.00
-20.00
1898
1954
1965.87
-11.87
1734
1894
1856.26
37.74
2001
2075
2034.72
40.28
1575
1800
18052000
1749.98
2200
55.022400
20.24
TEACHER A
TEACHER B
TEACHER C
SCHL AVG
PY Math
1717
1764
1553
1683
1506
1997
1691
1153
2036
1876
CY Math
1833
1922
1793
1886
1684
2059
1857
1510
2108
2003
Predicted
1844.89
1876.31
1735.28
1822.17
1703.86
2032.04
1827.51
1467.92
2058.11
1951.17
Growth
-11.89
45.69
57.72
63.83
-19.86
26.96
29.49
42.08
49.89
51.83
1777
1865
1885.00
-20.00
1898
1954
1965.87
-11.87
1734
1894
1856.26
37.74
2001
2075
2034.72
40.28
1575
1805
1749.98
55.02
29.13
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
SCHOOL
2400
2200
2000
1800
1600
1400
1200
1000
1000
1200
1400
1600
1800
2000
2200
2400
Teacher Value-Added Score
Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)
Teacher Growth
School Growth
TChgrowth - Schgrowth
.5 x Schgrowth
Tchvas
Teacher
A
39
29
10
15
25
Teacher Teacher
B
C
30
20
29
29
1
15
16
-9
15
6
DRE
Summary
• Based on prior achievement and
selected student characteristics
• Student Learning Growth
–Difference between current score
and predicted score
• Teacher VAM consider both
teacher and school learning
growth
DRE
References
• FLDOE Student Growth Implementation Committee
http://www.fldoe.org/committees/sg.asp
• FLDOE Race to the Top (RTTT)
http://www.fldoe.org/arra/racetothetop.asp
• SDPBC Department of Research and Evaluation
http://www.palmbeachschools.org/dre/Articles.asp
DRE