What is assessment? - GeorgiaStandards.Org

advertisement
GEORGIA PERFORMANCE STANDARDS
Day 3: Assessment FOR Learning
Training Overview: Day Three
•
•
•
•
•
•
•
Introduction to Module
Introduction to Assessment
Balanced Assessment
Matching Assessments to Standards
Constructing Rubrics and Performance Assessments
Grading Student Work
Putting It All Together
Day Three Objectives
1.
2.
3.
4.
5.
6.
7.
Explain why assessment is Stage 2 in the Standards-Based
Education process.
Identify the purpose of assessment in the classroom.
Differentiate among different types of assessment and
assessment formats.
Given specific standards and a purpose for assessment, determine
which assessment methods would be most appropriate at various
times to increase student learning.
Determine guidelines for constructing performance assessments
and rubrics.
Explain the differences between assessment and grading.
Create a balanced assessment plan for a unit, including examples
of performance tasks and rubrics.
Essential Question (overarching)
• How do I determine appropriate and acceptable
evidence of learning?
OR
• How will I know if my students know it and/or can
do it?
Standards Based Education Model
Stage 1:
GPS
Standards
Above, plus
Elements
All Above, plus
Tasks
Student Work
Teacher
Commentary
All Above
Identify Desired Results
What do I want my students
to know and be able to do?
Big Ideas  Enduring Understandings 
Essential Questions
---------------------------------------
Skills and Knowledge
Stage 2:
Determine Acceptable Evidence
(Design Balanced Assessments)
How will I know if my students
know it and/or can do it?
(to assess student progress toward
desired results)
Stage 3:
Plan Learning Experiences and Instruction
What will need to be done to help my students learn the
required knowledge and skills?
(to support student success on assessments,
leading to desired results)
The Process of Instructional Planning
Traditional Practice
Select a topic from the curriculum
Standards-based Practice
Select standards from among those students need
to know
Design instructional activities
Design and give an assessment
Give grade or feedback
Move onto new topic
Design an assessment through which students will
have an opportunity to demonstrate those things
Decide what learning opportunities students will
need to learn those things and plan appropriate
instruction to assure that each student has
adequate opportunities to learn
Use data from assessment to give feedback,
reteach or move to next level
Stephen Covey Quote
• “To begin with the end in mind means to start with
a clear understanding of your destination. It means
to know where you’re going so that you better
understand where you are now so that the steps
you take are always in the right direction.”
What is assessment?
• What does assessment mean to
you?
• Working with a partner, combine
your words into one list.
• Sort the words on your combined
list into groups.
Types
Purposes
Assessment
Procedures
Planning
Formats
Types of Classroom Assessments
Screening
Types
Summative
Assessment
Formative
Diagnostic
Informal
Types of Classroom Assessments
Types
Assessment
Screening
 Determine students at
risk for difficulty
 Need additional
instruction or
intervention
Types of Classroom Assessments
Types
 In-depth
information about
students’ skills and
instructional needs
Assessment
Diagnostic
 Help teachers plan
instruction
Types of Classroom Assessments
Types
Assessment
 AKA “Progress
Monitoring”
 Provide feedback
to students and
teachers on
learning progress
Formative
Types of Classroom Assessments
Types
Summative
Assessment
 Bottom line evaluation of
effectiveness
 Assign grades at end of
instruction
Types of Classroom Assessments
Types
Assessment
 Provide
feedback to the
student and
teacher
 Not typically
scored or graded
Informal
Types of Classroom Assessments
Screening
Types
Summative
Assessment
Formative
Diagnostic
Informal
Types
Purposes
Assessment
Procedures
Planning
Formats
Reasons We Assess
• Placement in classes/courses, programs
• Provide feedback to students and teachers on
learning progress
• Identify students who may have learning gaps
• Determine specific areas of weakness of a
student
• Assign grades at end of instruction
• No single assessment
can meet all the purposes
of assessment or
information needs of
classroom teachers.
Types
Purposes
Assessment
Procedures
Planning
Formats
UbD’s
“Continuum of Assessments”
Stiggins’
Assessment Methods
•
•
•
•
Selected Response
Essay
Performance Assessment
Personal Communication
Marzano’s
Types of Assessment Items
•
•
•
•
•
•
•
Forced-Choice
Essay
Short Written Response
Oral Reports
Performance Tasks
Teacher Observation
Student Self-Assessment
Assessment Formats
•
•
•
•
Selected Response
Constructed Response
Performance Assessment
Informal Assessment
Adapted from Marzano, Stiggins, UbD
Constructed Response
Key Points
Examples
Self – Assessment Reflections
•
•
•
•
•
•
•
•
•
•
•
•
What do the survey results suggest?
What patterns do you notice?
Does your classroom practice reflect a balance of assessment types?
What do the survey results suggest?
What patterns do you notice?
Are you using one format more that others?
Are there types of assessment you use less frequently or not at all?
Are you collecting appropriate evidence for all the desired results?
Do you rely too heavily on those that are easiest to test and grade?
Which assessment formats might you add or use more frequently in order to
provide a more balanced picture of students’ knowledge, skills, and
understanding?
Which assessment formats might you use less frequently in order to provide
a more balanced picture of students’ knowledge, skills, and understanding?
How might you modify your classroom practice to better assess student
learning?
Constructed Response
Advantages
Disadvantages
Evaluating an Assessment Plan
• Is this assessment plan balanced?
• How does the assessment plan relate to the
standard(s)?
• How might we improve the individual
assessments?
• Could the addition of other assessments
provide a better, more complete picture of
student learning?
• What other assessments might we use to obtain
evidence of student learning for this unit?
Types
Purposes
Assessment
Procedures
Planning
Formats
Achievement Target Types
•
•
•
•
Informational (knowledge)
Process (skills)
Thinking and Reasoning
Communication
Adapted from Marzano
Thinking and Reasoning
• Compare and
contrast
• Analyzing
relationships
• Classifying
• Argumentation
• Induction
•
•
•
•
•
Deduction
Experimental inquiry
Investigation
Problem solving
Decision making
-Marzano
Communication Skills
• Communicates effectively in written form
• Communicates effectively in oral form
• Communicates effectively in a medium other
than writing or speaking
• Express ideas clearly
• Communicates with diverse audiences
• Communicates for a variety of purposes
-Marzano
Matching Assessments with Standards
ASSESSMENT FORMAT
ACHIEVEMENT
TARGET
Informational
(Knowledge)
Process
(Skills)
Thinking and
Reasoning
Communication
Other:
Selected
Response
Constructed
Response
Performance
Tasks
Can sample mastery
of elements of
knowledge
Essays can tap
understanding of
relationships among
elements of knowledge
Not a good choice
for this target; other
options preferred
Informal
Assessment
Teacher can ask questions,
evaluate answers, and
infer mastery; but timeconsuming
Matching Assessments with Standards
ASSESSMENT FORMAT
ACHIEVEMENT
TARGET
Selected
Response
Constructed
Response
Informational
(Knowledge)
Can sample mastery of
elements of knowledge
Essays can tap
understanding of
relationships among
elements of knowledge
Not a good choice for
this target; other
options preferred
Process
(Skills)
Can assess mastery of the knowledge prerequisites
to skillful performance, but cannot rely on these to
tap the skill itself.
Can observe and
evaluate skills as they
are being performed
Thinking and
Reasoning
Can assess application
of some patterns of
reasoning
Communication
Not a good choice for
this target; other
options preferred
Written descriptions of
complex problem solutions
can provide insight into
reasoning proficiency.
Not a good choice for
this target; other
options preferred
Performance
Tasks
Can watch students solve
some problems or examine
some products and infer
about reasoning proficiency
Can observe and
evaluate some skills,
such as oral
communication
Informal
Assessment
Teacher can ask questions,
evaluate answers, and infer
mastery; but timeconsuming
Strong match when
skill is oral
communication
Can ask students to “think
aloud” or can ask followup questions to probe
reasoning
Strong match with
some communication
skills
Other:
-Adapted from Marzano and Stiggins
Types
Purposes
Assessment
Procedures
Planning
Formats
Rubrics
Assessment
Procedures
Informal
Assessments
Constructed
Response
Selected
Response
Performance
Assessments
Etymology – Rubric (Latin for Red)
• Referred to notes and directions written in red in
the margins of liturgical books for conducting
religious services.
• Today a rubric is a guideline for scoring,
assessing, and evaluating student work and
performance.
A rubric is a set of rules that . . .
• Shows levels of quality.
• Communicates standards.
• Tells students expectations for assessment
task.
• Are NOT checklists (yes or no answers).
• Includes dimensions (criteria), indicators, and a
rating scale.
According to Grant Wiggins . . .
• “What is to be assessed must be clear and
explicit to all students:
• NO MORE SURPRISES!
• . . . Rubrics must accompany all major
assignments and assessments.”
Advantages of Using a Rubric
• Lowers students’ anxiety about what is expected of
them.
• Provides specific feedback about the quality of their
work.
• Provides a way to communicate expectations and
progress.
• Ensures all student work is judged by the same
standard.
• Disengages the “halo” effect and its reverse.
• Leads students toward quality work.
Analytic
Holistic
Rubrics
Assessment
Procedures
• Definition: One score or rating for
the entire product or performance.
• When to Use:
Holistic
•For a quick snapshot of overall
status or achievement
Rubrics
•When the skill or product to be
assessed is simple; when it has
only a single dimension.
• Disadvantages:
•Two students can get the same
score for vastly different
reasons
•Not as good for identifying
strengths and weaknesses and
planning instruction
Assessment
Procedures
•Not as useful for students to
use.
Template for Holistic Rubrics
Score
Description
5
Demonstrates complete understanding of the problem. All
requirements of task are included in response.
Demonstrates considerable understanding of the
problem. All requirements of task are included.
4
3
2
Demonstrates partial understanding of the problem. Most
requirements of task are included.
Demonstrates little understanding of the problem. Many
requirements of task are missing.
1
Demonstrates no understanding of the problem
0
No response/task not attempted
• Definition: Several scores or ratings for a
product or performance. Each score represents
an important dimension or trait of the
performance or product.
Analytical
• When to Use:
• Planning instruction – show relative
strengths and weaknesses.
• Teaching students the nature of a quality
product or performance – they need the
details.
Rubrics
• Detailed feedback to students or parents.
• For complicated skills, products, or
performances, for which several
dimensions need to be clear.
• Disadvantages:
• Scoring is slower.
• Takes longer to learn.
Assessment
Procedures
Template for Analytic Rubrics
Beginning
1
Developing
2
Accomplished
3
Exemplary
4
Criteria #1
Description
reflecting beginning
level of
performance
Description
reflecting
movement toward
mastery level of
performance
Description
reflecting
achievement of
mastery level of
performance
Description
reflecting highest
level of performance
Criteria #2
Description
reflecting beginning
level of
performance
Description
reflecting
movement toward
mastery level of
performance
Description
reflecting
achievement of
mastery level of
performance
Description
reflecting highest
level of performance
Criteria #3
Description
reflecting beginning
level of
performance
Description
reflecting
movement toward
mastery level of
performance
Description
reflecting
achievement of
mastery level of
performance
Description
reflecting highest
level of performance
Criteria #4
Description
reflecting beginning
level of
performance
Description
reflecting
movement toward
mastery level of
performance
Description
reflecting
achievement of
mastery level of
performance
Description
reflecting highest
level of performance
Score
Parts of a Rubric
• Dimensions, sometimes referred to as criteria,
encompass the knowledge, skills, and
understanding to be assessed.
• Indicators specify the evidence used to judge
the degree to which the dimension is mastered.
• Rating Scales discriminate among the various
levels of performance.
Basic Template
Scale
Criteria
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Indicator
Chocolate Chip Cookie Rubric
Developed by a group of nuns who baked cookies for profit
Size
Heavenly
Earthly
Chocolate
Chips
Huge!
Super size
At least 6”
Pure smooth
4” – 5”
Toll House
standard
Taste
MMMmmm
good!
Texture
Soft
Bends without
breaking
Okay in a
pinch
Crisp
without
brown
Purgatory
2” – 3”
Generic real
chocolate
Edible
Crispy with
burnt edges
Gone to
Hell
You gotta be
kidding!
Where are
they? Grainy,
carobs
Spit that
OUT!
Burnt
Workshop Consultant’s Rubric
18 possible points
Outstanding
Average
(underpaid)
(minimum wage)
Consultant from
Hell
3 points
2 points
(overpaid)
1 point
Appearance
&
background
Physically and visually
attractive
Different clothes each day
Clothes fit
Still in lots of classes
Dumpy appearance
Wears same clothes every
other day
Clothes too big
Was a teacher
Nerdy appearance
Wears same clothes every day
Clothes too tight
Was/Is an administrator
Workshop
(X 2)
Good cartoon overheads
Lots of chocolate candy
Kept us awake for 30 minutes
or more
Overheads too small to read
Gives out “Halls” candies
Speaks English but in
monotone
No visuals
Gives out scratch/sniff stickers
Speaks with accent/monotone
Gives homework
Activities
(X 3)
Starts late, leaves early
Lots of long breaks
Shows “Gone with the Wind”
Has a book to use after
workshop
Everything on time
Only 2 breaks, short
Shows “Kindergarten Cop”
Steals others’ ideas from
books
Starts at 8:00—goes to 4:10
No breaks
Shows “The Crucible”
Has not read a book in years
Quotes only Madeline Hunter
Workshop Participant’s
Enthusiasm Rubric
(16 points)
Facial
Expression
Thought
Process
Exemplary
Bright, lit up
Acceptable Needs Work
Bright, lit up
Eyes not blinking
Eyes sometimes
focused on
Focused on teacher
teacher
Wheels in high gear
Wheels in relaxed
motion
Movement
Quick, alert motions Casual motions
Oral
Participation
Non-stop on task
talking
Talks when
needed or told
Retire
Eyes glazed over
and bloodshot
Eyes closed;
Drooping
Wheels are rusty
and slow
Wheel isn’t
invented
Sluggish – an
occasional itch
Coma
Occasional
grunts
Drooling
No sound
Designing a Scoring Rubric
• Consider criteria to judge whether a restaurant
is great (for example, ambience)
• List specific indicators (for example, clean, pleasant)
• Make a rating scale of 1-4 with 4 being a great
restaurant and 1 being “wish I’d eaten
somewhere else!”
• Rate the place you dined.
Restaurant Rubric
1
2
3
4
Ugly Rubrics
• Too wordy so that no one can understand the
dimensions or indicators, let alone use them for
a fair grade
• Checklists – Have it, don’t have it
• Judge each work against other items of work
• Judge the wrong thing so student can just jump
through hoops to get a good grade.
Good Rubrics
•
•
•
•
•
•
•
Are tools
Show level of quality of a performance or task
Communicate standards clearly and specifically
Are given to students to set expectations
Show what to avoid and addresses misconceptions
Are consistent and reliable
Use content that matches standards and instructional
emphasis
Rubrics
Assessment
Procedures
Informal
Assessments
Constructed
Response
Selected
Response
Performance
Assessments
Performance Tasks & Assessments . . .
• Often occur over time.
• Result in a tangible product or observable
performance.
• Encourage self-evaluation and revision.
• Require judgment to score.
• Reveal degrees of proficiency based on criteria
established and made public prior to the performance.
• Sometimes involve students working with others.
Marzano, Pickering, McTighe
GRASPS
•
•
•
•
•
•
G
R
A
S
P
S
Real-world GOAL
Real-world ROLE
Real-world AUDIENCE
Real-world SITUATION
Real-world PRODUCT or PERFORMANCE
STANDARDS
Rubrics
Assessment
Procedures
Informal
Assessments
Constructed
Response
Selected
Response
Performance
Assessments
Selected Response Items
• Components
–
–
–
–
Stimulus or prompt (not all items require these)
Stem
Answer
Distractors
Selected Response Items
• Stimulus or Prompt
– True-False
• Statement
– Matching
• Two sets of information
– Multiple-Choice
• Prompt
Selected Response Items
• Stems
– Ensure directions are clear
– Include the central idea and most of the phrasing in
the stem
– Word the stem positively, when possible
Selected Response Items
• Distractors
– The “incorrect” choices
– Are attractive to students without mastery
– Focus on the skill assessed
Selected Response Items
• The emblem on the
sign was a
–
–
–
–
angel
elf
ship
owl
• The American Civil
War began in
–
–
–
–
1812
1778
1862
1861
Selected Response Items
• I have five ____ on
my hand.
– finger
– fingers
– nail
• Who was President
during the Civil War?
–
–
–
–
Santa
Lincoln
Brittney Spears
King George
Rubrics
Assessment
Procedures
Informal
Assessments
Constructed
Response
Selected
Response
Performance
Assessments
Constructed Response Items
• Components
–
–
–
–
Stimulus or prompt (not all items require these)
Stem
Answer space
Rubric (scoring criteria)
Constructed Response Items
• Clearly state problem and expectations
• Cannot be answered without reading / studying
the passage or prompt
• Requires a response of more than one or two
words
• Leads to a range of responses
• Leads to clearly defined scoring criteria
Constructed Response Items
• Would the meaning
of this story change
if it took place
somewhere else in
the world? Explain
why or why not.
• Dog food costs $0.83 per
pound. How much money will
it take to feed a dog who eats
20 pounds each week? For
one year? Remember, there
are 52 weeks in a year. Be sure
to show your work.
WORK SPACE
__ each week __ one year
Rubrics
Assessment
Procedures
Informal
Assessments
Constructed
Response
Selected
Response
Performance
Assessments
Informal Assessment
• Model using criteria to complete assignments
and rubrics to evaluate work
• Help students set clear goals and ask them to
critique their work
• Provide opportunities for students to share their
problem solving strategies
• Consider student-led parent conferences
The Distinction Between
Assessment and Grading
Assessment
 Continuous progress
 Provides feedback to improve
student learning
 May be formative or
summative
 Provides a means of collecting
evidence of student mastery
of the content standards
 Provides a photo album of
student progress through
which we can observe a
student’s growth
Grading
 A means of assigning
numerical or alphabetical
grade to a student’s work
 May be formative or summative
 Provides a means of collecting
evidence of student mastery of
the content standards
 Provides a photo album of
student progress through
which we can observe a
student’s growth
Characteristics of Exemplary
Assessment
•
•
•
•
•
•
•
•
•
Emphasizes learning process as well as product
Requires active construction of meaning
Assesses interdisciplinary and cross disciplinary skills
Helps students self monitor
Gives specific expectations for students
Emphasizes the application and use of knowledge
Has meaning and relevance to students
Emphasizes complex skills
Makes standards public and known in advance
Download