Analysis of Student Work
Coordinator and Think
Tank Update
Broadcast: Wednesday, July 16
1:00 – 3:00 p.m.
ASW
Reality vs. Rumor
Activity
NC Professional Teaching Standards
Standard I: Teachers demonstrate leadership.
Standard II: Teachers establish a respectful environment for a
diverse population of students.
Standard III: Teachers know the content they teach.
Standard IV: Teachers facilitate learning for their students.
Standard V: Teachers reflect on their practice.
Standard VI: Teachers contribute to the academic success
of students.
NC Educator Evaluation System
Overview of Standard 6
1 2 3 4 5
Demonstrate
Leadership
Establish
Environment
Know
Content
5 Rating Categories
Not Demonstrated
Developing
Proficient
Accomplished
Distinguished
Facilitate
Learning
Reflect on
Practice
6
Contribute
to Academic
Success
3 Rating Categories
Does Not Meet Expected Growth
Meets Expected Growth
Exceeds Expected Growth
Overview of Standard 6
Contribute
to Academic
Success
6
End of Grade (EOG) or End of Course (EOC) tests
6
Career Technical Education Assessment
6
NC Final Exams
6
K-3 Checkpoints
6
Analysis of Student Work
Analysis of Student Work
In 2014-2015, ASW is the Standard 6 measure
for teachers in Advanced Placement, Arts
Education, Healthful Living, International
Baccalaureate, and World Languages.
Contribute
to Academic
Success
Growth is based on student work submitted
by teachers and rated by content experts in a
“blind review” process.
6
Analysis of Student Work
Analysis of Student Work Process
• Fall 2011 Design Groups
• Spring 2013 ASW Pilot
• 2013 – 2014 ASW Pilot
ASW 2014 Pilot Participants
Over 1100 NC Educators Representing
Regions
8
Advanced Placement
Arts Education
Healthful Living
International Baccalaureate
Content Areas
Occupational Preparation
7th Grade Social Studies
World History
World Languages
Questions about the previous section? Type
them in the question box now.
Overview of
ASW Process
Overview of the ASW Process
Teacher verifies schedule and chooses
objectives for each course
Teacher collects
TAs of student
work
Teacher
Uploads
Evidence
Collection to
Online
Platform
Reviewers rate
Evidence
Collections
Teacher receives category
rating for Standard 6
Overview of the ASW Process
Overview of the ASW Process
ASW Process: A Quick Guide
Overview of the ASW Process
Items needed to compile a
Timelapse Artifact (TA):
• A specific objective measured over
2 distinct points in time
• Work Sample Options:
Student or Whole Class
• Method(s) or tool(s) for collecting
• 2 work samples
• Context
Overview of the ASW Process
Objectives:
Using the Strands
and Standards
guidance charts, 5
objectives will be
chosen.
Questions about the previous section? Type
them in the question box now.
Overview of the ASW Process
Work Samples:
Option 1 –
Student Work Samples
Collect and keep 2 work
samples:
• for each class member
• for the objective
• at 2 separate points in time
Overview of the ASW Process
Work Samples:
Option 2 –
Whole Class Work Samples
2 work samples that
represent the entire class
• for the objective
• at 2 separate points in time
Overview of the ASW Process
Method(s) or tool(s) for collecting:
Overview of the ASW Process
Timelapse Artifact
Option 1 –
Student Work Samples
Online platform will select
3 students
The TA will be compiled using
the Student Work Samples from
these selected students.
TA 1
Overview of the ASW Process
Timelapse Artifact Option 1 –
Student Work Samples
If a student work sample
is unavailable, that student
will be reshuffled to create
another sampling.
TA 1
Overview of the ASW Process
Timelapse Artifact Option 1 –
Student Work Samples
Context for 1st work sample
How does this artifact
show where the student
is in relation to the
chosen clarifying
objective?
1
1
1
Overview of the ASW Process
Timelapse Artifact Option 1 –
Student Work Samples
Context for 2nd work sample
How does this artifact
show where the student
is in relation to the
chosen clarifying
objective?
2
2
2
Overview of the ASW Process
2
Timelapse Artifact Option 1 –
Student Work Samples
Context for Growth
Describe the growth
that occurred between
points one and two.
1
2
1
2
1
Overview of the ASW Process
Timelapse Artifact Option 1 –
Student Work Samples
2
1
2
1
Timelapse
Artifact
1
2
1
Overview of the ASW Process
Timelapse Artifact Option 2 –
Whole Class Work Samples
Be sure to keep the
Whole Class Work Samples
If the composition of your
class changes, do not worry,
submit your two work samples.
1
#2Timelapse
Artifact
Work
Sample
1
Work
Sample
2
Overview of the ASW Process
Timelapse Artifact Option 2 –
Whole Class Work Samples
Whole
Class
Work
Sample 1
1 Timelapse
Artifact
Whole
Class
Work
Sample 2
Overview of the ASW Process
TA 3
Student
Timelapse Artifacts will
be uploaded to the
online platform.
TA 1
Student
TA 4
Student
TA 2
Whole
Class
TA 5
Whole
Class
Questions about the previous section? Type
them in the question box now.
Principal’s Input
Ensure Teacher Participation
Principal’s Input
Principal meets with the teacher to ensure that the 5
objectives chosen use the parameters in the Strands &
Standards Guidance Chart
Some examples of meetings:
• PDPs
• teacher meetings
Principal’s Input
The Principal is notified
when a reshuffle is used
by a teacher.
TA 1
Overview of the ASW Process
Blind Review:
The Evidence Collection
will be reviewed by
2 content area specialists.
Reviewer #1
Reviewer #2
Overview of the ASW Process
Blind Review:
The platform sends the evidence collection to two
reviewers who have been matched to the teacher
because of their similar content area expertise.
Reviewer #1
Reviewer #2
Overview of the ASW Process
Blind Review:
If the category ratings from each reviewer are the same,
then the review process is complete and the Standard 6
rating will be posted for that year.
Meets
Expected
Growth
Category Rating:
Meets Expected Growth
Reviewer #1
Reviewer #2
Overview of the ASW Process
Blind Review:
If the category ratings from the two reviewers are not the
same, the Evidence Collection is automatically sent to a
3rd reviewer for an additional review to get a rating for
that year.
Reviewer #3
Exceeds
Expected
Growth
Reviewer #1
Meets
Expected
Growth
Reviewer #2
Overview of the ASW Process
2-Step ASW Process Review:
Evidence Collection Checklist
ASW Quality Rubric
Overview of the ASW Process
Evidence Collection Rating Form:
•
D = Does Not Meet Expected Growth
•
M = Meets Expected Growth
•
E = Exceeds Expected Growth
Transfer your rating for each TA from the quality rubric to the table below:
TA 1
TA 2
TA 3
TA 4
TA 5
Use this table to determine the overall rating for the evidence collection
Does Not Meet
DDDDD
DDDDE
DDDDM
DDDEE
DDDME
DDDMM
Meets
MMMMM
MMMME
DMMMM
MMMEE
DDMMM
DMMME
DDMME
DDMEE
DMMEE
Exceeds
EEEEE
MEEEE
MMEEE
DEEEE
DMEEE
DDEEE
Overall Rating for the entire Evidence Collection
Does Not Meet Expected Growth Meets Expected Growth
Exceeds Expected Growth
NC Educator Evaluation System
Overview of Standard 6
1 2 3 4 5
Demonstrate
Leadership
Establish
Environment
Know
Content
5 Rating Categories
Not Demonstrated
Developing
Proficient
Accomplished
Distinguished
Facilitate
Learning
Reflect on
Practice
Contribute
to
Academic
Success
6
3 Rating Categories
3-Year Rolling Average
Standard
Standard
6
Year 1
Standard
6
Year 2
6
Year 3
An educator receives an
effectiveness status only
after he or she has 3 years
of data on Standard 6
A 3-year rolling average of
growth data from
Standard 6 is used as part
of determining overall
status
Demonstration of 3-Year Rolling
Average for 2014-2017
Mr. NC’s 3-year rolling
average of growth data:
Standard
Standard
Standard
Year 1
2014-2015
Year 2
2015-2016
Year 3
2016-2017
Does Not Meet
Expected Growth
Meets
Expected Growth
Meets
Expected Growth
6
6
6
2014-15 Does Not Meet
(Year 1)
2015-16 Meets (Year 2)
+ 2016-17 Meets (Year 3)
Mr. NC’s 3-year rolling
average for 2014-2017
Contribute
Meets
Expected Growth
to Academic
Success
Effectiveness Status
Effectiv
for 2016 - 2017
e
2016 - 2017
Developing
Proficient
Standard 1
Demonstrate
leadership
X
Standard 2 Establish
Environment
X
Standard 3
Know Content
X
X
Standard 4
Facilitate Learning
Standard 5 Reflect on
Practice
Standard 6
Three year rolling
average
Accomplished
Distinguished
X
3 year rolling average for 2014 – 2017
Meets Expected Growth
ASW Wikispace
• Online Training Modules
• Important Forms
• Frequently Asked Questions
Visit the Wiki here:
http://ncasw.ncdpi.wikispaces.net/
Regional Training Schedule – August, 2014
(Known locations available on the ASW Wikispace)
Regions 1 & 2
Region 3
Region 4
Region 5
Region 6
Region 7
Region 8
Combined 7 &8
August 12
August 19
August 6
August 14
August 15
August 21
August 22
August 8
Questions about ASW Process
Jennifer DeNeal
Race to the Top Project Coordinator for
Educator Effectiveness
North Carolina Department of Public
Instruction
Have a question about educator
effectiveness?
Send an email to:
educatoreffectiveness@dpi.nc.gov
Questions about Educator
Effectiveness
North Carolina Department of Public
Instruction
Have a question about Educator
Effectiveness?
visit
www.ncpublicschools.org/
effectiveness-model
or
http://ncees.ncdpi.wikispaces.net/NC
EES+Wiki