Student Learning Objectives (SLO)

advertisement
Student Learning Objectives
(SLO)
Anthony Conti
Anthony.conti@miu4.org
Dr. Cathleen Cubelic
Cathleen.cubelic@miu4.org
Our Objectives
 Define an SLO
 Design, Build, and Review an SLO
 Interpret the SLO Template
 Consider Assessment Quality and Purpose
 View online tools
 Plan for implementation
LEA Responsibilities
1. To select a minimum group of 6-10 teachers, with
aligned principals, to implement the SLO process
(to receive training from the IU, using the PDE
materials, to design, build and review a minimum
of one SLO that is prepared using the online
template, and follow the implementation process
through the administrative review, monitor and
final evaluation stages. THE RESULTS OF
EVALUATION ARE NOT EXPECTEDTO BE USED AS A
PART OF THE TEACHER EVALUATION.)
LEA Responsibilities
2.
To assign an implementation team to be trained
by the IU and to subsequently train the teachers and
principals involved in the pilot, or train the entire
staff in preparation for next year. Implementation
team members should include, at minimum, but not
limited to:
a.
One administrator, preferably at the
curriculum level
b.
One principal, preferably one involved in the
pilot process
c.
Two teachers, preferably two involved in
the pilot process
LEA Responsibilities
3.
To allot one day for representatives from the
implementation team to meet with the authors of the
SLO process. (Substitute and travel
expenses
would be provided by PDE.)
4.
To provide information, in the form of surveys
and interviews, to a researcher who will evaluate
the SLO process.
Teacher Effectiveness System in Act 82 of 2012
Building Level Data/School Performance Profile
Teacher Observation & Practice
Effective 2013-2014 SY
Danielson Framework Domains
1. Planning and Preparation
2. Classroom Environment
3. Instruction
4. Professional Responsibilities
Effective 2013-2014 SY
Indicators of Academic Achievement
Indicators of Closing the Achievement Gap, All Students
Indicators of Closing the Achievement Gap, Subgroups
Academic Growth PVAAS
Other Academic Indicators
Credit for Advanced Achievement
Teacher Specific Data
PVAAS / Growth 3 Year Rolling Average
1. 2013-2014 SY
2. 2014-2015 SY
Teacher Specific 3. 2015-2016 SY
Data, 15%
Other data as provided in Act 82
Building Level
Data, 15%
Observation/
Practice, 50%
Elective Data/SLOs
Optional 2013-2014 SY
Effective 2014-2015 SY
Elective
Data, 20%
District Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
6
Teacher Effectiveness System in Act 82 of 2012
Building Level Data/School Performance Profile
Teacher Observation & Practice
Effective 2013-2014
Danielson Framework Domains
1.
2.
3.
4.
Planning and Preparation
Classroom Environment
Instruction
Professional Responsibilities
Effective 2013-2014 SY
Indicators of Academic Achievement
Indicators of Closing the Achievement Gap, All Students
Indicators of Closing the Achievement Gap, Subgroups
Academic Growth PVAAS
Other Academic Indicators
Credit for Advanced Achievement
Building Level
Data, 15%
Elective Data/SLOs
Observation/
Practice,
50%
Optional 2013-2014 SY
Effective 2014-2015 SY
Elective Data,
35%
District Designed Measures and Examinations
Nationally Recognized Standardized Tests
Industry Certification Examinations
Student Projects Pursuant to Local Requirements
Student Portfolios Pursuant to Local Requirements
7
The Rating Tool
[for teacher with Eligible PVAAS Data]
The SLO in PA is written in
relationship to a specific
teacher and a specific
class/course/content area
for which that teacher
provides instruction.
“The PSSA test doesn’t completely
measure my effectiveness.”
≠
SLO Definition
A process to
document a
measure of educator
effectiveness
based on student
achievement of
content standards.
SLO Process Components
The SLO process contains three (3)
action components:
1. Design (ing): thinking,
conceptualizing, organizing,
discussing, researching
2. Build (ing): selecting, developing,
sharing, completing
3. Review (ing): refining, checking,
updating, editing, testing, finalizing
12
SLO Process Components
DESIGN
• Thinking about what content
standards to measure
• Organizing standards and measures
• Discussing with colleagues
collective goals
• Researching what is needed for a
high quality SLO
13
SLO Process Components
BUILD
•
•
•
•
•
Selecting the performance measure(s)
Developing targets and expectations
Completing the template
Sharing the draft materials with other
colleagues
Developing/Documenting
performance task(s)
14
SLO Process Components
REVIEW
• Checking the drafted SLO (including the
performance measures for quality
• Refining measures and targets
• Editing text and preparing discussion
points/highlights for principal
• Finalizing materials
• Updating completed SLOs with performance
data
15
Activity
 Count off by 6 at your table.
 Each one take an “SLO should……”
statement. [next slide]
 Produce an “educator friendly” version of
that statement.
 Share within your group.
The SLO Should….
1. Represent student performance in a specific course/content area
taught by educator.
2. Reflect the diversity of students as learners.
3. Align to a target set of selected academic content standards that
represent the depth and breadth of the goal statement.
4. Use metrics based upon multiple events/data collection periods
to measure defined levels of student growth or “mastery”.
5. Be supported by verifiable data that can be collected and scored
in a standardized manner.
6. Include a set of independent performance measures directly
linked to the established goal.
Design
What is a Goal Statement?
Definition:
• Narrative articulating the “big idea” upon
which the SLO is built under which content
standards are directly aligned.
Characteristics:
• Encompasses the “enduring
understanding” of the standard
• Central to the content area
• Foundational concepts for later
19
subjects/courses
Goal Statement Example
• “Students will apply the concepts
and the competencies of nutrition,
eating habits, and safe food
preparation techniques to overall
health and wellness throughout the
life cycle at individual, family and
societal levels.”
20
SLO Goal
(Template #1)
Goal Statement addresses:
•
WHAT the “big idea” is in the
standards
Standards
•
HOW the skills and knowledge
support future learning
Rationale Statement:
•
21
WHY the “big idea” is a central,
enduring concept
http://pdesas.org/standard/PACore
More Considerations for
Goal Statements
 Do you have previous data to help
guide your goal?
 What does your growth and
achievement look like?
 Is there a building/district-wide
goal?
Activity:
Goal Statement (Template #1)
 Within your team, choose a discipline in
which you’d like to focus. Preferably,
choose a discipline that is taught by one
amongst you.
 Complete “Template #1 Goal Statement”
 We will post them for the entire group.
Build
Template
Section 1
Goal
 Goal statement should articulate an
appropriate “big idea”.
http://pdesas.org/standard/PACore
 Standards should be the appropriate Focus
Standards supporting the goal.
 Rationale statement should be reasons why
the Goal statement and the aligned Standards
address important concepts for this
class/course.
Template
Section 2
Performance Indicator
Definition: a description of the expected
level of student growth or achievement
based on the performance measure
Answers two questions……….
1)Does the indicator define student success?
2)What is the specific measure linked to the
indicator?
Examples of Performance
Indicator Targets
 Students will achieve Advanced or Proficient on all four criteria
of the Data Analysis Project rubric.
 Students will score an average of 3 or better on five different
constructed response questions regarding linear modeling
according to the general description of scoring
guidelines.(http://static.pdesas.org/Content/Documents/Keysto
ne%20Scoring%20Guidelines%20-%20Algebra%20I.pdf)
 Students will improve a minimum of 10% points from pre- to
post-test for material in each semester.
 Students will show “significant improvement” in the Domain of
Measurement on the Classroom Diagnostic Tools Mathematics
Grade 7 assessment from the first to the last administration.
Performance Indicator –
Focus student group
A description of the expected level of achievement for
each student in a subset of the SLO population (1F)
based on the scoring tools used for each performance
measure (4A).
Subset populations can be identified through prior
student achievement data or through content-specific
pretest data.
Examples of Performance
Indicator Targets: Focused
Student Group
 Students who scored below the 30th percentile on their
benchmark AIMSweb R-CBM probe will score above the
30th percentile by the end of the school year using the
national norms.
 Students who scored below a 2 on the pre-test will
improve a minimum of one level on the post-test.
Goal
Focus Standards
Performance Indicator(s)
and Measure(s)
Activity:
Growth and Mastery
 What assessments may be used as
growth, mastery or both?
Mastery
Growth
What are the characteristics
of a quality assessment?
 Write (3).
 Report out the summary from your table.
Good assessments have……
 A specific and defined
purpose
 A reasonable time limit
for completion
 A mixture of question
types
 An appropriate
readability level
 Items/tasks with
appropriate DOK levels
 Multiple methods of
student demonstration
 Items/tasks that are
Standards Aligned
 Validity and reliability
 A quality rubric
 A standardized scoring
method
 Academic Rigor
 Well-written directions
and administration
guidelines
 Cut scores for
performance categories
Academic Rigor
1.Standards-Aligned
2.Developmentally Appropriate
3.Focused on Higher-Order Thinking
Weighting, Linking, or Otherwise
1. Standard
You may consider each Performance Indicator equal in
importance.
2. Linked
You may link multiple Performance Indicators, if you
like. Do this for “pass before moving on” assessments.
3. Weighted
You may weight multiple Performance Indicators, if you
like. Do this when you believe one or more PI’s are
more complex or more important than others.
Standard Scenario
Name
Student
Proportion
Met Target
68
80
PI 1
Building a
Bridge Project
PI 2
Roller Coaster
Design
56
P1 3
Egg Parachute
40
𝑇𝑜𝑡𝑎𝑙 =
80
80
68 + 56 + 40
164
=
= 54.7%
100 + 100 + 100 300
Weighting Scenario
 Physics Class with (3) PI targets:
Name
Weight
Student
Proportion
Met Target
68
80
PI 1
Building a 50%
Bridge
Project
PI 2
Roller
Coaster
Design
25%
56
P1 3
Egg
25%
Parachute
40
80
80
Points
Acquired
42.5
17.5
12.5
Total Score = 72.5%
Template
Section 3
Goal-Indicator-Measure
GoalStandards
Indicator
Indicator
#1
SLO Goal
(Big Idea)
Indicator
#2
Performance
Measures
Assessment
#1a
Assessment
#1b
Assessment
#2
Goal-Indicator-Measure
GoalStandards
SLO Goal
(Big Idea)
Indicator
Performance
Measures
Indicator
#1
Assessment
#1
Indicator
#2
Assessment
#2
Performance Measure - Descriptions
 State the name of the assessment(s).
 List the type of measure.
 Explain the purpose, state what the Performance
Measure should measure.
 Identify the timeline and occurrence(s)
 Scoring Tools should indicate the solution key, rubric,
checklist, etc. that is being used to score the PM.
 Administration & Scoring Personnel should contain who
is giving the test and who is scoring it.
 Performance Reporting should state how others will
know which students met the Performance Indicator(s).
Template
Section 4
Expectations
PI Targets
Teacher
Expectations
Teacher Expectations
Definition: identifies each level (Failing, Needs
Improvement, Proficient, Distinguished) students are
meeting the Performance Indicator Targets.
 These reflect the continuum established by the teacher
prior to the evaluation period.
 Each level is populated with a percentage range so that
there is distribution of performance across levels.
 Based on the actual performance across all identified
Performance Indicators, the evaluator will determine one
of the four levels for the SLO.
Template
Section 5
Review
Tools for Review
 SLO Coherency Rubric
 School Leader’s SLO Checklist
 Assessment QA Checklist
Now you are an expert.
 Take 10-15 minutes to review this SLO example given
for a Family and Consumer Science Class.
 Please make notes on the document where you question
or disagree with what is stated and where you think
needs clarification.
 Also, note what suggestions may be given to this
instructor for improvement and questions you would ask
prior to approving this SLO for the teacher.
 Please take the first 5 minutes to do this silently on your
own.
 We will review each section and share with the group.
Be ready to discuss your thoughts.
The Online Tool
 http://www.pdesas.org/
 Use the Homeroom link at bottom right
 Click the RIA Homeroom site link in the top paragraph
 Register and log in.
Scavenger Hunt
1. Find the online and Word templates we use to complete
the SLO writing process.
2. Find the Performance Task Framework Template.
3. Find the handout that helps us define our goal and
rationale.
4. Find the Art Grade 8 SLO model SLO.
5. Find the PDF Power Point that discusses Reviewing SLOs
6. Find the Help Desk: Section 1 document
Homework
 Your group return with one SLO written having at least
one Performance Indicator/Measure.
 Complete the template using the MS WORD template
and email it to anthony.conti@miu4.org
 We plan to use these as exemplars at our December 12
meeting.
Next Time
 Assessment Literacy
 Vetting of Initial SLOs
 Planning
Download