Reading Assessment: A Natural Fit for SLPs

advertisement
Reading Assessment: A
Natural Fit for SLPs
Pat Howard, Ph.D.
Director of Assessment Programs
phoward@fcrr.org
www.fcrr.org/assessment
Purposes of Assessment

To Make Decisions About Students
– Eligibility for Services
 Special Education
 ESOL
– Instructional Planning and Support Needs
 Screening for Early Identification of Needs
 Diagnostics to Identify Strengths and Weaknesses
 Development of Academic Improvement Plans/Individual
Educational Plans
– Determine Effectiveness of Services
 Progress Monitoring to Produce Growth Charts
 Outcome Measures to Provide End-of-Year Evaluation

To Make Decisions About the System
– Program Evaluation
– Determine Needs, Continuation and/or Revisions for
Future Implementation
What Questions Do You Have That Can
Be Answered With Data From Reading
Assessments?
Are we meeting our
Standards and
Benchmarks for all
students?
 Are we able to identify
students at risk of
reading failure
 Do we have a method
for determining the
effectiveness of our
Dr. Marilyn Jackson-Rahming
reading programs?
Principal, Pineview El.

5 Key Areas of Knowledge
and Skill in Reading
Phonemic Awareness
Phonics
Fluency
Vocabulary
Comprehension Strategies
Identifying words
accurately and
fluently
Constructing
meaning
once words
are identified
The 4 Critical
Assessments
 Screening:
“First Alert”
 Progress Monitoring: “Growth Charts”
 Diagnostics:
“In-depth View”
 Outcome Measures: “Reaching Our
Goals”
Screening and Progress Monitoring
Grade
Kindergarten
First
Second
Third – Fifth
Reading Component
Assessed
Reading Skill Measure
DIBELS and FORF
Phonemic Awareness
Initial Sound, Phoneme
Segmentation
Phonics
Letter Naming, Nonsense Words
Phonemic Awareness
Phoneme Segmentation
Phonics
Letter Naming, Nonsense Words
Reading Fluency
Oral Reading
Phonics
Nonsense Words
Reading Fluency
Oral Reading
Reading Fluency
Oral Reading
Sixth - Eighth Reading Fluency
Comprehension
Florida Oral Reading
Mazes
Overview of DIBELS
Measures
Letter Naming Fluency
 Intended for students in
kindergarten through the
fall of first grade
 Provides a measure of a
student’s proficiency in
naming upper and lower
case letters
 Primarily an indicator of
risk
 Students identified at risk
should be instructed in
phonological awareness
and alphabetic principle
Probe 1
c
c
N
u
Q M u
h
S
i
n
b
e
N
F
f
o
a
K
k
g
p
k
p
a
H C
e
G D
b
w
F
i
h
O
x
j
I
K
x
t
Y
q
L
d
f
T
g
v
T
V Q
o
w
P
J
t
B
X
Z
v
U
P
R
l
V C
l
W
R
J
m O
z
D G
y
Z
y
A m X
z
H
S M E
q
n
j
s
W r
d
s
B
r
A
E
L
c
N
u
Q M
c
U Y
I
Total: ____/110
Overview of
DIBELS Measures
Initial Sounds Fluency
 This measure assesses a
student’s ability to
recognize and produce
the beginning sound(s) in
an orally presented word
 Administered through the
late winter of
kindergarten
 Students performing
below expectations in this
measure will benefit from
instruction in
phonological awareness
Overview of
DIBELS Measures
Phoneme Segmentation
Fluency
 Measures ability to
segment three- and fourphoneme words into their
individual phonemes
 The student must produce
verbally the individual
sounds in words presented
by the examiner
 It is administered in
kindergarten and first
grades
 It is a good predictor of
later reading achievement
and strengthened by
phonological awareness
activities
Overview of
DIBELS Measures
 Nonsense Word Fluency
 It taps the student’s
knowledge of letter-sound
correspondence and ability
to blend letters into words
(test of the alphabetic
principle)
 This measure is provided in
kindergarten, first and
second grades
 Students performing below
expectations will benefit
from activities focusing on
decoding
kik
kaj
lan
yuf
bub
wuv
nif
suv
yaj
tig
woj
fek
nul
pos
dij
nij
vec
yig
zof
mak
sig
av
zem
vok
sij
pik
al
dit
um
sog
faj
zin
og
viv
vus
nok
boj
tum
vim
wot
yis
zez
nom
feg
tos
mot
nen
joj
vel
sav
Overview of DIBELS
Measures and FORF
 Oral Reading Fluency
 measure of fluency in
oral reading of
connected text.
 Students in grades
one, two and three
will be administered
three passages from
grade-level text
 Students who are
weak in reading
fluency will often
experience difficulty
in comprehending
what they read
There was a robin’s nest outside our kitchen window. The
nest was in a tall bush. The mother robin sat in the nest all day
long. One day when I was watching, the mother bird flew
away. I saw the eggs she was sitting on. There were four blue
eggs.
I watched and watched. The eggs moved. I watched some
more. The eggs started to crack. Finally, the eggs hatched. I
saw four baby birds. The baby birds opened their beaks wide.
I heard them peeping. Soon the mother bird came back. Then
the mother robin put worms in their mouths.
Every day I watched the baby birds and their mother.
Pretty soon the babies were so fat there was no room for the
mother. Then one morning the nest was gone from the bush.
Overview of Mazes
 Reading
Comprehension
 Measure of fluency in
selecting appropriate
word to complete text
 For students in grades
6-8
 Score also influenced
by reading rate
 Group administered
 Predicts performance
on FCAT equally as
well as ORF
Reading is the most critical academic
skill students will learn and one of the
best predictors of overall success in
school and society. Therefore, reading
continues to be a (cabbage / leading
/ thruway) topic at the national level
and (at / is / my) the school level.
There is no (snowshoe / question /
practical) that teaching all of our
students (or / me / to) read by the
end of third (grade / spoon / below),
as mandated under NCLB is a (following
/ challenge / paperclip). To
accomplish this task, assessments are
(belief / throws / needed) to help
educators efficiently…
Assessment Schedule
Kindergarten
Grade
Interval
1
2
3
4
First
1
2
3
Third -Eighth
Second
4
1
2
3
Initial Sounds
Fluency
Letter Naming
Fluency
Phoneme
Segmentation
Fluency
Nonsense Word
Fluency
Oral Reading
Fluency / Mazes
Assessments @ 45 day intervals
beginning with instructional days 20 - 29
4
1
2
-3 E 4
Screening and Progress Monitoring
Data Interpretation

Indicators of Effectiveness
– Effectiveness of core and interventions
Identification of schools that are “beating
the odds”
 Identification of greatest needs

– Individual, classroom, grade, school

Growth profiles –
– Individual, classroom, grade, school levels
Risk Status
Colors provide a quick indication of the student’s
progress and the risk that a student has of not
achieving the expected level of proficiency.
Low Risk
“Good to Go”
Moderate Risk
Caution
High Risk
DANGER!
Are We Meeting Our Reading Goals to…
1. Maintain students on grade level through effective core program, and
2. Decrease students in need of additional support through strong and
effective supplemental strategies and intensive interventions?
Beginning
Middle
End
The Results of Effective Core,
Supplemental, and Intensive Instruction
Assessment
1
2
3
4
Overall
Level of
Effectiveness
Indicator of Effectiveness
Paul
Maria
100%
Janet
Marcel
Gria
66%
Joseph
Carmen
Tabitha
Lilly
Johana
John
60%
The Progress Monitoring and
Reporting Network (PMRN)
 Reports
Targeted to Principals
– School Reports
 Assessment Calendar
 Recommended Level of Instruction
 School Status Report
 Student Instructional Level Report
How to Use the Calendar
• Avoid overlap of activities
during testing windows
• Plan for any training
associated with assessment
• Make sure all test materials
are on hand
Teacher A
Teacher B
Teacher C
Teacher D
Teacher E
How to Use Recommended Level
of Instruction Report
• Identify instructional support needs of
students by grade and teacher
• Determine additional resources needed
for grade levels or teachers
• Prioritize coaching services
How to Use the School Status Report
• Determine, by grade level, by measure,
student instructional needs
• Make decisions about areas on which
to focus professional development
• Determine probability of FCAT
performance by third graders
Student 1
Student 2
Student 3
Student 4
Student 5
Student 6
Student 7
Student 8
Student 9
Student 10
Student 11
Student 12
Student 13
Student 14
Student 15
Student 16
Student 17
Student 18
Student 19
Student 20
Student 21
Student 22
Student 23
Student 24
Grade
Status
Report
PMRN Examples
 Reports
Targeted to Coaches,
Teachers and SLP’s
– Class Reports
 Class Status Report
 Progress Tracking Tool
 Class Progress Monitoring Report
– Student Reports
 Student Progress Monitoring Report
Class Status Report
The Class Status Report is
the first report a teacher
sees.
It provides a “snapshot” or
quick indication of the class
progress and a quick
indication of each child’s
success. It also has links to
other reports.
The Class Status Report
helps answer the question
of who is at risk.
Recommended
Instructional Level
• Combination of
scores from each of
the individual
measures
Individual Measures
• Target, next
target, student
score, risk level
indicated in color
and notation
Progress Tracking Tool
The Progress Tracking Tool allows
the teacher to view the progress
of all of the students at one time.
From the graph, it is easily
determined which students are at
risk and which of them are not
making significant gains. The list
can be sorted in a variety of ways
and can exclude students who
have not been in the class for the
entire year.
This tool quickly identifies whether
other students are exhibiting
similar profiles.
Class Progress Monitoring Test
Report
The school’s Reading Coach
will assist teachers in reading
and interpreting the Box and
Whiskers graph.
This example shows the class
improved in nonsense word
fluency, but is not improving
at a rate to guarantee
success.
This report indicates whether
the students are making
adequate progress.
Student PMT Report
Compares
student
performance to
the classroom.
Using the PMRN for OPM
The 4 Critical
Assessments
 Progress
Monitoring: “Growth Charts”
 Screening: “First Alert”
 Diagnostics:
“In-depth View”
 Outcome Measures: “Reaching Our
Goals”
Diagnostic Tests

Purpose
– Provide additional, necessary diagnostic
information to plan effective instruction

An Integral Part of the Reading First
Assessment Plan
– Administered infrequently
– Used to supplement information from
screening, progress monitoring, and outcome
Diagnostic Tests

Instructional Utility
– Tests used to determine a reading learning disability do not
help to plan more effective instruction – ATI research
– Developing fluency in all aspects of the basic skills and
monitoring progress towards automaticity will alert
teachers to support needs of students
– Diagnostics should measure skills that can be directly
taught and that affect important reading outcomes: PA,
Phonics, Fluency, Vocabulary, and Comprehension
Strategies
– Other factors influencing reading outcomes: Motivation,
parental support – not assessed with diagnostics;
knowledge base, language ability, general intelligence –
not a specific part of reading instruction
Diagnostic Assessments of
Reading: 2nd Ed. (DAR)
Ages 5 – adult
 9 individually administered tests of the
components of reading and language
 No special qualifications to administer
 Untimed – approx. 40 min. per student
 Criterion referenced – mastery levels
 Materials: Teacher’s manual, response
record, student book

DAR – Information Provided







Word Meaning: oral vocabulary test as an estimate of
language and cognitive abilities; usually underestimates
student ability if they have a reading problem
Word Recognition, Word Analysis, Oral Reading,
Spelling: basic word reading skills
Print Awareness: basic concept in using printed word
Phonological Awareness: ability to hear sounds that
make up words
Letters and Sounds, Word Analysis, Spelling:
knowledge of letter-sound correspondences
Oral Reading: basic word reading skills, fluency, word
meanings, language, comprehension
Silent Reading Comprehension: basic word recognition
and analysis, background knowledge, language and
cognitive development
DAR and DIBELS
Area
DAR Measures
DIBELS Measures
Letter Identification
Naming Capital Letters; Naming Lower
Case Letters; Matching Letters;
Matching Words
Letter Naming Fluency
Phonological
Awareness
Rhyming words; Segmenting into
syllables; Initial and Final Consonant
Sounds; Auditory Blending of
phonemes
Initial Sound Fluency
Phoneme Segmentation
Fluency
Word Identification
Word Recognition
Decoding
Word Analysis
Consonant sounds and blends; short
vowel; silent E; digraphs; diphthongs;
etc.
Nonsense Word Fluency
Oral Reading
Oral Reading – accuracy & fluency
Oral Reading Fluency
Reading
Comprehension
Silent Reading Comprehension - retell
Spelling
Spelling Words
Vocabulary
Word Meaning
Fox in a Box (FIB)







Grades K - 3
4 Strands: Phonemic Awareness, Phonics,
Reading and Oral Expression, Listening and
Writing
Fall and spring administrations with same form
Teacher administration
Untimed – 35 minutes per child; 80 minutes per
class
Criterion referenced – benchmarked
Materials: Teacher’s guide, puppet, word lists,
books, student recording booklets
FIB Strands and Subtests

Phonemic Awareness – K
– Rhyme Recognition, Rhyme Generation, Syllable
Clapping, Initial Consonants, Final Consonants,
Blending, Segmenting

Phonics – K – 2
– Alphabet Recognition (Uppercase, Lowercase,
Vowels), Alphabet Writing, Spelling, Decoding (Real
and Non-words)

Reading and Oral Expression – K – 2
– Sight Words, Reading (Concepts of Print, Emergent
Reading, Accuracy, Comprehension, Oral Expression),
Reading Fluency (Rate, Expression)

Listening and Writing
– Listening Comprehension, Writing Development,
Writing Expression
Technically Adequate Diagnostic
Components*
K-1 K-2 1-1 1-2 2-1
2-2
Phonological Awareness
Yes
Yes
Phonics
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Word Recognition - Sight Words
Reading Comprehension
Yes
Text Reading Fluency
*As determined by reliability of .8 and above
Yes
Yes
FIB and DIBELS
Area
FIB Measures
DIBELS Measures
Phonemic
Awareness
Phonemic Awareness (K) Rhyme
Recognition, Rhyme Generation, Syllable
Clapping, Initial Consonants, Final
Consonants, Blending, Segmenting
Initial Sound Fluency
Phoneme
Segmentation Fluency
Phonics
Phonics (K – 2) Alphabet Recognition,
Alphabet Writing, Spelling, Decoding
Letter Naming Fluency
Nonsense Word
Fluency
Reading Fluency
Reading and Oral Expression: (K – 2)
Sight Words (K – 2)
Text Reading Fluency (2)
Oral Reading Fluency
Reading
Comprehension
Reading and Oral Expression: (K – 2)
Reading Comprehension (2)
Early Reading Diagnostic
Assessment: 2nd Ed. (ERDA)






Grades K - 3
5 Skill Clusters: Phonological Awareness,
Phonics, Fluency, Vocabulary, Comprehension
Norm-referenced – Emerging or Below Basic;
Basic; Proficient
Teacher administration: 15 – 110 minutes
Timed and untimed sections
Materials: Administration manual, technical
manual, stimulus book, record form, stopwatch,
parent report forms
ERDA Clusters and Subtests

Phonological Awareness
– Phonological Composite: Rhyming, Rimes, Phonemes,
Syllables

Phonics
– Letter Recognition, Pseudoword Decoding

Fluency
– Word Reading, Target Words in Context, RAN – Automaticity
Composite, Passage Fluency Composite: Narrative Composite,
Informational Composite

Vocabulary
– Vocabulary Composite: Receptive and Expressive, Word
Opposites, Synonyms, Word Definitions, Multiple Meanings

Comprehension
– Story Retell, Reading Comprehension, Listening
Comprehension
ERDA and DIBELS
Area
ERDA Measures
DIBELS Measures
Phonological
Awareness
Phonemic Awareness Composite:
Rhyming, Phonemes, Rimes, Syllables
Initial Sound Fluency
Phoneme
Segmentation Fluency
Phonics
Phonics
Letter Recognition, Pseudo-word Decoding
Letter Naming Fluency
Nonsense Word
Fluency
Fluency
Word Reading, Target Words in Context
RAN – Automaticity Composite
Passage Fluency Composite: Narrative
Composite, Informational Composite
Oral Reading Fluency
Vocabulary
Vocabulary Composite: Receptive and
Expressive, Word Opposites, Synonyms, Word
Definitions, Multiple Meanings
Reading
Comprehension
Comprehension
Story Retell, Reading Comprehension,
Listening Comprehension
Group Reading Assessment and
Diagnostic Evaluation (GRADE)






Grades PK – Adult: 11 Levels, on grade and out-of
level testing
5 Components: Pre-Reading, Reading Readiness,
Vocabulary, Comprehension, Oral Language
Norm-referenced – Standard Scores and Percentiles
available; Growth scale values
Group or individual administration; two alternate
forms
Untimed – 45 – 90 minutes
Materials: Administration manual for each level,
teacher’s scoring and interpretive manuals, technical
manual, answer sheets, handscoring templates
Components and Subtests

Pre-Reading
– Picture Matching, Picture Differences, Verbal Concepts,
Picture Categories

Reading Readiness
– Sound Matching, Rhyming, Print Awareness, Letter
Recognition, Same & Different Words, PhonemeGrapheme Correspondence

Vocabulary
– Word Reading, Word Meaning, Vocabulary

Comprehension
– Sentence Comprehension, Passage Comprehension

Oral Language
– Listening Comprehension
GRADE and DIBELS
Area
GRADE Measures
DIBELS Measures
Phonological
Awareness
Sound Matching
Rhyming
Initial Sound Fluency
Phoneme Segmentation
Fluency
Letter Identification
Letter Recognition
Letter Naming Fluency
Phonics
Phoneme-Grapheme
Correspondence
Word Reading
Letter Naming Fluency
Nonsense Word Fluency
Fluency
Oral Reading Fluency
Vocabulary
Word Meaning
Vocabulary
Reading
Comprehension
Sentence Comprehension
Passage Comprehension
Oral Language
Listening Comprehension
The 4 Critical
Assessments
 Progress
Monitoring: “Growth Charts”
 Screening: “First Alert”
 Diagnostics: “In-depth View”
 Outcome Measures: “Reaching Our
Goals”
Outcome Measures
Vocabulary and Comprehension
 PPVT-III,
Form B
– receptive vocabulary
 Gates
MacGinitie Reading Tests
– reading vocabulary
 Stanford
-10
– reading comprehension
Peabody Picture Vocabulary
Test (PPVT-III)
Oral receptive language test
 Provide word and student selects the
appropriate picture from 4 options
 Norm-referenced
 Individually administered: 15 – 20 min.
 Outcome measure for vocabulary along
with GMRT for reading vocabulary

Internet Resources

Risk Level Charts – DIBELS and FORF
– http://www.fcrr.org/assessment/pdffiles/k3_risk_levels.pdf
– http://www.fcrr.org/assessment/PDFfiles/45_RISK_LEVELS.pdf
– http://www.fcrr.org/assessment/PDFfiles/Risk-Levels6-8-FORF-FCRR.pdf

University of Oregon – DIBELS
– http://dibels.uoregon.edu

Coaches Guide - FCRR
– http://www.fcrr.org/assessment/pdf/coaches/coaches
guide2005.pdf
Download