Student Learning Growth Details
November 27th and November 29th
Agenda
Review of Student Learning Growth Calculation
ESS Demonstration
Student Learning Growth Details
Frequently Asked Questions
Question and Answer
Review: Student Learning Growth
To comply with state law, the FLDOE chose a valueadded model to measure a teacher’s contribution to student learning This model accounts for some of the key variables that influence student learning including prior test scores, attendance, mobility, ESE and ELL status, and class size.
Review: Student Learning Growth
The FLDOE model produces in a score and standard error that is individualized for every teacher and unique for every school. The standard error is based on the number of students taught and the consistency of student results. The standard error is a measure of the degree of variation that is likely in the score.
Review: Student Learning Growth
The standard error can be used to create a confidence interval (range of scores) that take into account the potential error in any score. The larger the adjustment for standard error used, the more confidence that the range of scores created is an accurate reflection of teacher or school influence on student learning. 0.5 Standard Error ~ 38% confidence 1.0 Standard Error ~ 68% confidence 2.0 Standard Error ~ 95% confidence
Student Learning Growth Calculation Name
SLG Score
SLG Standard Error
Employee 1
0.04
0.11
Employee 2
-0.61
0.24
Employee 3
0.24
0.06
Employee 4
0.32
0.25
Employee 5
-0.02
0.26
Employee 6
0.14
0.20
Employee 7
0.06
0.13
Employee 8
0.28
0.17
Employee 9
-0.21
0.05
Employee 10
-0.26
0.05
School 1
0.07
0.28
School 2
0.03
0.30
School 3
-0.04
0.31
The FLDOE provides districts with a file containing information on teacher Student Learning Growth (SLG) scores. Though much more data are available than presented, some scores are personal and some scores are school scores. Through recommendations of the Teacher Evaluation Committee, the Principal Evaluation Committee, teachers, principals, and other district staff, we chose a calculation method that uses this data as fairly and equitably as possible.
Student Learning Growth Calculation
Classification decisions are made based on the entire confidence interval calculated. To receive a rating of Highly Effective, the Entire Confidence Interval must be located in the the Highly Effective range.
To receive a rating of Effective, Any Point in the Confidence Interval must intersect at any point with the Effective range.
To receive a rating of Needs Improvement, the Upper Bound of the Confidence Interval must be located in Needs Improvement .
To receive a rating of Unsatisfactory, the Entire Confidence Interval must be located in the Unsatisfactory range.
Student Learning Growth Calculation – Highly Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.24 (+24%)
0.06 (6%)
(0.12, 0.36)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s entire confidence interval touches no category other than ‘Highly Effective’ at any point, this employee is rated as ‘Highly Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.04 (4%)
0.11 (11%)
(-0.18, 0.26)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-.20 (-20%)
0.07 (7%)
(-0.34, -0.06)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.13 (-13%)
0.08 (8%)
(-0.29, 0.03)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’.
Student Learning Growth Calculation - Effective
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
0.13 (13%)
0.11 (11%)
(-0.09, 0.35)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches ‘Effective’ at any point, this employee is rated as ‘Effective’.
Student Learning Growth Calculation – Needs Improvement/Developing Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.21 (-21%)
0.05 (5%)
(-0.31, -0.11)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches no higher than ‘Needs Improvement’ at any point, this employee is rated as ‘Needs Improvement’.
Student Learning Growth Calculation - Unsatisfactory
Name
SLG Score
SLG Standard Error
Confidence Interval
Employee 1
-0.26 (-26%)
0.05 (5%)
(-0.36, -0.16)
The SLG score and standard error is used to create a confidence interval for each person or school that displays with 95% confidence a range of scores. The data from the entire interval is used to make classification decisions. The data for the employee presented above is graphed below. The SLG score is represented by the circle and the lines extending out from the circle represent the confidence interval. SLG
Unsatisfactory (1)
Needs Improvement (2)
-15%
-10%
Effective (3)
0%
Highly Effective (4)
10%
Because this employee’s confidence interval touches no higher than ‘Unsatisfactory’ at any point, this employee is rated as ‘Unsatisfactory’.
Student Learning Growth Scores and Ratings SLG Evaluation Score
SLG Evaluation Rating
4.0
Highly Effective
3.0
Effective
2.0
Needs Improvement
2.0
*Developing
1.0
Unsatisfactory
*This rating is only available for instructional personnel with up to three total years of instructional experience
What Will This Look Like? Rating
Raw Score
% of Overall Score
Weighted Score
E
3.10
60%
1.86
Instructional Practice
Student Learning Growth
Final Evaluation
Rating
Raw Score
% of Overall Score
Weighted Score
E
3.00
40%
1.20
Rating
Weighted Score
E
3.06
What Will This Look Like?
Finding Student Learning Growth Details
This is the new portion of Employee Self Service where Student Learning Growth Details can be accessed.
Finding Student Learning Growth Details
Finding Student Learning Growth Details
You can select the graph icon in the new column on your evaluation table to find the confidence interval used for the SLG score classification.
Student Learning Growth Details When you select the graph icon in the new column in your evaluation table, a file will appear that presents your score, your standard error, and your confidence interval.
Please remember that some personnel received scores directly calculated from students they instruct and other personnel received scores calculated from their associated school(s).
Student Learning Growth Details Examples
We are going to examine a few examples of the student learning growth details.
The student learning growth details chart will provide your name, evaluation year, student learning growth rating, score, standard error, and a graphical representation of your confidence interval. Please note that the confidence interval is not drawn to scale but meant to represent how the classification decision was made.
Frequently Asked Questions
Why do I have the same evaluation score (e.g. 3) as another person who also received an individual score? Why are students in non-FCAT classes not included in the student learning growth calculation? Will the final evaluation ratings for 2011 - 2012 be included in any merit pay system?
Frequently Asked Questions
Are ESE students taking the Florida Alternate Assessment in the model for the 2011 – 2012 evaluation? Are FCAT 2.0 retake students in the model for the 2011 – 2012 evaluation? Does the distribution of final evaluation results follow a normal distribution (bell curve)?
Overall Final Evaluation Results 60% 50% 40% Normal Distribution SCPS Distribution
30% 20% 10% 0% U
NI/D
E
HE
Questions/Concerns
Please continue to email
[email protected] with questions and concerns.
