Student Learning Growth Details November 27th and November 29th Agenda Review of Student Learning Growth Calculation ESS Demonstration Student Learning Growth Details Frequently Asked Questions Question and Answer Review: Student Learning Growth To comply with state law, the FLDOE chose a valueadded model to measure a teacher’s contribution to student learning This model accounts for some of the key variables that influence student learning including prior test scores, attendance, mobility, ESE and ELL status, and class size. Review: Student Learning Growth The FLDOE model produces in a score and standard error that is individualized for every teacher and unique for every school. The standard error is based on the number of students taught and the consistency of student results. The standard error is a measure of the degree of variation that is likely in the score. Review: Student Learning Growth The standard error can be used to create a confidence interval (range of scores) that take into account the potential error in any score. The larger the adjustment for standard error used, the more confidence that the range of scores created is an accurate reflection of teacher or school influence on student learning. 0.5 Standard Error ~ 38% confidence 1.0 Standard Error ~ 68% confidence 2.0 Standard Error ~ 95% confidence Student Learning Growth Calculation Name SLG Score SLG Standard Error Employee 1 0.04 0.11 Employee 2 -0.61 0.24 Employee 3 0.24 0.06 Employee 4 0.32 0.25 Employee 5 -0.02 0.26 Employee 6 0.14 0.20 Employee 7 0.06 0.13 Employee 8 0.28 0.17 Employee 9 -0.21 0.05 Employee 10 -0.26 0.05 School 1 0.07 0.28 School 2 0.03 0.30 School 3 -0.04 0.31 The FLDOE provides districts with a file containing information on teacher Student Learning Growth (SLG) scores. Though much more data are available than presented, some scores are personal and some scores are school scores. Through recommendations of the Teacher Evaluation Committee, the Principal Evaluation Committee, teachers, principals, and other district staff, we chose a calculation method that uses this data as fairly and equitably as possible. Student Learning Growth Calculation Classification decisions are made based on the entire confidence interval calculated. To receive a rating of Highly Effective, the Entire Confidence Interval must be located in the the Highly Effective range. To receive a rating of Effective, Any Point in the Confidence Interval must intersect at any point with the Effective range. To receive a rating of Needs Improvement, the Upper Bound of the Confidence Interval must be located in Needs Improvement . To receive a rating of Unsatisfactory, the Entire Confidence Interval must be located in the Unsatisfactory range. Student Learning Growth Calculation – Highly Effective Name SLG Score SLG Standard Error Confidence Interval Employee 1 0.24 (+24%) 0.06 (6%) (0.12, 0.36) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s entire confidence interval touches no category other than ‘Highly Effective’ at any point, this employee is rated as ‘Highly Effective’. Student Learning Growth Calculation - Effective Name SLG Score SLG Standard Error Confidence Interval Employee 1 0.04 (4%) 0.11 (11%) (-0.18, 0.26) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’. Student Learning Growth Calculation - Effective Name SLG Score SLG Standard Error Confidence Interval Employee 1 -.20 (-20%) 0.07 (7%) (-0.34, -0.06) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’. Student Learning Growth Calculation - Effective Name SLG Score SLG Standard Error Confidence Interval Employee 1 -0.13 (-13%) 0.08 (8%) (-0.29, 0.03) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’. Student Learning Growth Calculation - Effective Name SLG Score SLG Standard Error Confidence Interval Employee 1 0.13 (13%) 0.11 (11%) (-0.09, 0.35) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’. Student Learning Growth Calculation – Needs Improvement/Developing Name SLG Score SLG Standard Error Confidence Interval Employee 1 -0.21 (-21%) 0.05 (5%) (-0.31, -0.11) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches no higher than ‘Needs Improvement’ at any point, this employee is rated as ‘Needs Improvement’. Student Learning Growth Calculation - Unsatisfactory Name SLG Score SLG Standard Error Confidence Interval Employee 1 -0.26 (-26%) 0.05 (5%) (-0.36, -0.16) The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG Unsatisfactory (1) Needs Improvement (2) -15% -10% Effective (3) 0% Highly Effective (4) 10% Because this employee’s confidence interval touches no higher than ‘Unsatisfactory’ at any point, this employee is rated as ‘Unsatisfactory’. Student Learning Growth Scores and Ratings SLG Evaluation Score SLG Evaluation Rating 4.0 Highly Effective 3.0 Effective 2.0 Needs Improvement 2.0 *Developing 1.0 Unsatisfactory *This rating is only available for instructional personnel with up to three total years of instructional experience What Will This Look Like? Rating Raw Score % of Overall Score Weighted Score E 3.10 60% 1.86 Instructional Practice Student Learning Growth Final Evaluation Rating Raw Score % of Overall Score Weighted Score E 3.00 40% 1.20 Rating Weighted Score E 3.06 What Will This Look Like? Finding Student Learning Growth Details This is the new portion of Employee Self Service where Student Learning Growth Details can be accessed. Finding Student Learning Growth Details Finding Student Learning Growth Details You can select the graph icon in the new column on your evaluation table to find the confidence interval used for the SLG score classification. Student Learning Growth Details When you select the graph icon in the new column in your evaluation table, a file will appear that presents your score, your standard error, and your confidence interval. Please remember that some personnel received scores directly calculated from students they instruct and other personnel received scores calculated from their associated school(s). Student Learning Growth Details Examples We are going to examine a few examples of the student learning growth details. The student learning growth details chart will provide your name, evaluation year, student learning growth rating, score, standard error, and a graphical representation of your confidence interval. Please note that the confidence interval is not drawn to scale but meant to represent how the classification decision was made. Frequently Asked Questions Why do I have the same evaluation score (e.g. 3) as another person who also received an individual score? Why are students in non-FCAT classes not included in the student learning growth calculation? Will the final evaluation ratings for 2011 - 2012 be included in any merit pay system? Frequently Asked Questions Are ESE students taking the Florida Alternate Assessment in the model for the 2011 – 2012 evaluation? Are FCAT 2.0 retake students in the model for the 2011 – 2012 evaluation? Does the distribution of final evaluation results follow a normal distribution (bell curve)? Overall Final Evaluation Results 60% 50% 40% Normal Distribution SCPS Distribution 30% 20% 10% 0% U NI/D E HE Questions/Concerns Please continue to email hr_evals@scps.k12.fl.us with questions and concerns.