Understanding Final Evaluation Results

advertisement
Student Learning Growth Details
November 27th and November 29th
Agenda

Review of Student Learning Growth Calculation

ESS Demonstration

Student Learning Growth Details

Frequently Asked Questions

Question and Answer
Review: Student Learning Growth


To comply with state law, the FLDOE chose a valueadded model to measure a teacher’s contribution to
student learning
This model accounts for some of the key variables
that influence student learning including prior test
scores, attendance, mobility, ESE and ELL status, and
class size.
Review: Student Learning Growth



The FLDOE model produces in a score and standard
error that is individualized for every teacher and
unique for every school.
The standard error is based on the number of
students taught and the consistency of student
results.
The standard error is a measure of the degree of
variation that is likely in the score.
Review: Student Learning Growth


The standard error can be used to create a confidence
interval (range of scores) that take into account the
potential error in any score.
The larger the adjustment for standard error used, the
more confidence that the range of scores created is an
accurate reflection of teacher or school influence on
student learning.
0.5 Standard Error ~ 38% confidence
 1.0 Standard Error ~ 68% confidence
 2.0 Standard Error ~ 95% confidence

Student Learning Growth Calculation
Name
SLG Score
SLG Standard Error
Employee 1
0.04
0.11
Employee 2
-0.61
0.24
Employee 3
0.24
0.06
Employee 4
0.32
0.25
Employee 5
-0.02
0.26
Employee 6
0.14
0.20
Employee 7
0.06
0.13
Employee 8
0.28
0.17
Employee 9
-0.21
0.05
Employee 10
-0.26
0.05
School 1
0.07
0.28
School 2
0.03
0.30
School 3
-0.04
0.31
The FLDOE provides districts
with a file containing
information on teacher Student
Learning Growth (SLG) scores.
Though much more data are
available than presented, some
scores are personal and some
scores are school scores.
Through recommendations of
the Teacher Evaluation
Committee, the Principal
Evaluation Committee,
teachers, principals, and other
district staff, we chose a
calculation method that uses
this data as fairly and
equitably as possible.
Student Learning Growth Calculation





Classification decisions are made based on the entire confidence interval calculated.
To receive a rating of Highly Effective, the Entire Confidence Interval must be located
in the the
Highly Effective range.
To receive a rating of Effective, Any Point in the Confidence Interval must intersect at any
point with the Effective range.
To receive a rating of Needs Improvement, the Upper Bound of the Confidence Interval must
be located in Needs Improvement .
To receive a rating of Unsatisfactory, the Entire Confidence Interval must be located in the
Unsatisfactory range.
Student Learning Growth Calculation – Highly Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.24 (+24%)
0.06 (6%)
(0.12, 0.36)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s entire confidence interval touches no category other than
‘Highly Effective’ at any point, this employee is rated as ‘Highly Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.04 (4%)
0.11 (11%)
(-0.18, 0.26)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this
employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-.20 (-20%)
0.07 (7%)
(-0.34, -0.06)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this
employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.13 (-13%)
0.08 (8%)
(-0.29, 0.03)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this
employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.13 (13%)
0.11 (11%)
(-0.09, 0.35)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this
employee is rated as ‘Effective’.
Student Learning Growth Calculation – Needs
Improvement/Developing
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.21 (-21%)
0.05 (5%)
(-0.31, -0.11)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches no higher than ‘Needs
Improvement’ at any point, this employee is rated as ‘Needs Improvement’.
Student Learning Growth Calculation - Unsatisfactory
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.26 (-26%)
0.05 (5%)
(-0.36, -0.16)
The SLG score and standard error is used to create a confidence interval for each person or
school that displays with 95% confidence a range of scores. The data from the entire interval is
used to make classification decisions. The data for the employee presented above is graphed
below. The SLG score is represented by the circle and the lines extending out from the circle
represent the confidence interval.
SLG
Unsatisfactory
(1)
Needs Improvement
(2)
-15%
-10%
Effective
(3)
0%
Highly Effective
(4)
10%
Because this employee’s confidence interval touches no higher than ‘Unsatisfactory’
at any point, this employee is rated as ‘Unsatisfactory’.
Student Learning Growth Scores and Ratings
SLG Evaluation Score
SLG Evaluation Rating
4.0
Highly Effective
3.0
Effective
2.0
Needs Improvement
2.0
*Developing
1.0
Unsatisfactory
*This rating is only available for instructional personnel with up to three
total years of instructional experience
What Will This Look Like?
Rating
Raw Score
% of Overall Score
Weighted
Score
E
3.10
60%
1.86
Instructional Practice
Student Learning
Growth
Final Evaluation
Rating
Raw Score
% of Overall Score
Weighted
Score
E
3.00
40%
1.20
Rating
Weighted
Score
E
3.06
What Will This Look Like?
Finding Student Learning Growth Details
This is the new portion of Employee Self Service
where Student Learning Growth Details can be
accessed.
Finding Student Learning Growth Details
Finding Student Learning Growth Details
You can select
the graph icon
in the new
column on your
evaluation table
to find the
confidence
interval used for
the SLG score
classification.
Student Learning Growth Details
When you select the graph icon in
the new column in your evaluation
table, a file will appear that
presents your score, your standard
error, and your confidence interval.
Please remember that some
personnel received scores directly
calculated from students they instruct
and other personnel received scores
calculated from their associated
school(s).
Student Learning Growth Details Examples



We are going to examine a few examples of the
student learning growth details.
The student learning growth details chart will provide
your name, evaluation year, student learning growth
rating, score, standard error, and a graphical
representation of your confidence interval.
Please note that the confidence interval is not drawn to
scale but meant to represent how the classification
decision was made.
Frequently Asked Questions



Why do I have the same evaluation score (e.g. 3) as
another person who also received an individual
score?
Why are students in non-FCAT classes not included
in the student learning growth calculation?
Will the final evaluation ratings for 2011 - 2012
be included in any merit pay system?
Frequently Asked Questions



Are ESE students taking the Florida Alternate
Assessment in the model for the 2011 – 2012
evaluation?
Are FCAT 2.0 retake students in the model for the
2011 – 2012 evaluation?
Does the distribution of final evaluation results
follow a normal distribution (bell curve)?
Overall Final Evaluation Results
60%
50%
40%
Normal Distribution
SCPS Distribution
30%
20%
10%
0%
U
NI/D
E
HE
Questions/Concerns

Please continue to email hr_evals@scps.k12.fl.us
with questions and concerns.
Download