Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Educator Effectiveness
1
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Teacher Effectiveness System in Act 82 of 2012
School Building Data
Teacher Observation & Practice
Effective 2013-14 SY
Danielson Framework Domains
1. Planning and Preparation
2. Classroom Environment
3. Instruction
4. Professional Responsibilities
Observation/
Practice, 50%
Effective 2013-14 SY
Indicators of Academic Achievement
Indicators of Closing the Achievement Gap, All Students
Indicators of Closing the Achievement Gap, Subgroups
Academic Growth PVAAS
Other Academic Indicators
Credit for Advanced Achievement
Teacher Specific Data
PVAAS / Growth 3 Year Rolling Average
1. 2013-14 SY
Teacher Specific 2. 2014-15 SY
3. 2015-16 SY
Data, 15%
Other data as provided in Act 82
School Building
Data, 15%
Elective Data/SLOs
Elective
Data, 20%
Optional 2013-14 SY
Effective 2014-15 SY
District-Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
2
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Building Level Data
Teacher Observation & Practice
Effective 2013-14
Danielson Framework Domains
1. Planning and Preparation
2. Classroom Environment
3. Instruction
4. Professional Responsibilities
Effective 2013-14 SY
Indicators of Academic Achievement
Indicators of Closing the Achievement Gap, All Students
Indicators of Closing the Achievement Gap, Subgroups
Academic Growth PVAAS
Other Academic Indicators
Credit for Advanced Achievement
Building Level
Data, 15%
Elective Data/SLOs
Observation/
Practice,
50%
Elective Data,
35%
Optional 2013-14 SY
Effective 2014-15 SY
District-Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
3
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Non-Teaching Professional Employee
Effectiveness System in Act 82 of 2012
Effective 2014-15 SY
Observation & Practice
Danielson Framework Domains
1. Planning and Preparation
2. Educational Environment
3. Delivery of Service
4. Professional Development
Student
Performance
20%
Student Performance of All Students in the
School Building in which the Nonteaching
Professional Employee is Employed
District-Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
Observation/
Practice
80%
4
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Principal Effectiveness System in Act 82 of 2012
Effective 2014-2015 SY
Observation/ Evidence
Domains
1. Strategic/Cultural Leadership
2. Systems Leadership
3. Leadership for Learning
4. Professional and Community
Leadership
Building Level Data
Indicators of Academic Achievement
Indicators of Closing the Achievement Gap, All Students
Indicators of Closing the Achievement Gap, Subgroups
Academic Growth PVAAS
Other Academic Indicators
Credit for Advanced Achievement
Building
Level Data
15%
Observation
/ Evidence
50%
Correlation
between
Teacher PVAAS
scores and
Teacher
Danielson
rating
15%
Elective
Data/ SLOs
20%
Correlation Data Based on
Teacher Level Measures
PVAAS
Elective Data/SLOs
District-Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
School Building Data
www.education.state.pa.us
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Academic Performance Score
•
The academic performance score for a school is based
upon multiple measures, which define high-performing
schools.
•
The data elements that are combined to determine this
academic performance score represent the buildinglevel data used in the Teacher Effectiveness System.
•
The academic performance score is based upon 100
point scale.
7
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Academic Performance Score Components
• Indicators of Academic Achievement (40%)
• Indicators of Closing the Achievement Gap
All Students (5%)
• Indicators of Closing the Achievement Gap
Historically Underperforming Students (5%)
• Indicators of Academic Growth – PVAAS (40%)
• Other Academic Indicators (10%)
• Extra Credit for Advanced Achievement (up to 7
Points)
8
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Indicators of Academic Achievement (40%)
• PSSA/Keystone Exams Performance
• Industry Standards-Based Competency
Assessments (NOCTI/NIMS)
• Grade 3 Reading Proficiency
• SAT/ACT College Ready Benchmarks
9
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Indicators of Closing the Achievement Gap (10%)
• All Students (5%)
Based upon progress in moving all students to
proficiency (defined as 100%)
• Historically Underperforming Students (5%)
Based upon progress in moving historically
underperforming students to proficiency
(defined as 100%)
- Students with Disabilities
- English Language Learners
- Economically Disadvantaged Students
10
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Indicators of Academic Growth/PVAAS (40%)
Uses PVAAS Growth Index for:
–Math
–Reading
–Science
–Writing
11
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Other Academic Indicators (10%)
Cohort Graduation Rate
Promotion Rate
Attendance Rate
Advanced Placement or International
Baccalaureate or College Credit Offered
• PSAT/Plan Participation
•
•
•
•
12
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Extra Credit for Advanced Achievement
(up to 7 Points)
• Percent PSSA/Keystone Exams Advanced – Math
• Percent PSSA/Keystone Exams Advanced – Reading
• Percent PSSA/Keystone Exams Advanced – Science
• Percent PSSA/Keystone Exams Advanced – Writing
• Percent Advanced – Industry Standards-Based Competency
Assessments (NOCTI/NIMS)
• Percent of Grade 12 Students Scoring 3 or Higher on an AP
Exam
13
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Pennsylvania Value Added
Assessment System
(PVAAS)
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
What is PVAAS teacher-specific
reporting?
PVAAS teacher-specific reporting
estimates the effect of a teacher’s
performance on the academic growth
of a group of students.
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
PDE Guidance
• PDE’s policy and guidelines will provide a framework for
LEAs to make sure the right teachers are linked to the
right students for the right proportion of time for the
right tested course/grade/subject to yield PVAAS Teacher
Reporting.
Teacher
Proportion
of Time
Student
Course &
Grade/Subject
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Which Tested Courses/Subjects?
• PSSA: With/Without Accommodations
– Grades 4-8: Reading and Math
– Grades 4 & 8: Science
– Grades 5 & 8: Writing
• Future: Transition into ELA Assessment
• Keystone Exams: With/Without Accommodations
– Algebra I
– Literature
– Biology
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
PVAAS Teacher Reporting:
3-Year Rolling Average
• Included in Final Rating Form when a teacher has a 3year rolling average.
PILOT:
SY12-13
PVAAS
Report
SY13-14
PVAAS
Report
SY14-15
PVAAS
Report
SY15-16
PVAAS
Report
1st PVAAS
3-Year
Average
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Until a teacher receives a PVAAS
3-year average, what is used in
place of the 15% for PVAAS
teacher-specific reporting?
• The Observation/Evidence will be used
for the 15% portion in lieu of available
PVAAS teacher-specific data – a PVAAS
3-year rolling average.
19
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Other Variables Under
Consideration
• Demographic Variables
– Economically Disadvantaged
– English Language Learners
– Student with IEPs
• SAS EVAAS Analyses for PDE
– To determine if there is a need to make any
adjustments based on demographic variables
• Using actual PA teacher level data
– To identify and address any unintended consequences
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Student Learning Objectives
(as demonstrated through:)
District-Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Individual Teacher Developed Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local
Requirements
• The SLO process will be used regardless of the
elective tools chosen by the LEA
•
•
•
•
•
•
21
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
What is an SLO?
• A process to document a measure of
educator effectiveness based on student
achievement of content standards.
• An SLO statement is an objective developed
to guide instruction and examine changes
in student mastery and/or growth.
22
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Our Goal: Build Quality Control
Framework
1. Provide tools for developing, approving,
and scoring SLOs.
2. Provide training and guidance for the selection
or development of high quality assessments.
3. Train IU, LEA, PDE content advisors and others
professionals.
4. Ensure continuous improvement by refinements
based on feedback
23
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
Rating Tool
www.education.state.pa.us
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Alternative Approval Process:
Minimum Standards
• Uses multiple student
performance measures
as follows:
– Teacher-Specific
Data, at least 15%
– Building-Level
Specific Data, must
be greater than 0%
– Elective Data, must
be greater than 0%
Building Specific
Data, greater
than 0%
Teacher
Observation /
Practice,
50%
Teacher-Specific
Data, at least
15%
Elective Data,
greater than 0%
25
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Alternative Approval Process:
Minimum Standards
• Retains four (4) rating categories as follows:
– Distinguished;
– Proficient;
– Needs Improvement; and
– Failing
• Retains final performance rating of “Satisfactory”
or “Unsatisfactory”
• PDE approval valid for up to five (5) years
26
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Alternative Approval Process:
Technical Advisory Committee
(TAC)
• TAC review required when
percentages applied to any
student performance measures
change from the percentages
established in Pennsylvania’s
Educator Effectiveness System
27
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Differentiated Supervision
PDE supports differentiated supervision as part of a
LEA’s supervision system.
• Acknowledges the time commitment for the formal
observation process;
• Acknowledges the various levels of experiences of
teachers;
• Acknowledges the importance of collaboration for
continued professional growth
28
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
Differentiated Supervision
• PDE has developed guidelines to assist LEAs.
• PDE guidelines will require that a model leads to
increased teacher effectiveness and increased
student achievement.
• PDE guidelines will require professional staff to
cycle back into the formal observation mode.
29
Measuring Educator Effectiveness
Tom Corbett, Governor
▪
Ronald Tomalis, Secretary of Education
www.education.state.pa.us
30