Effective Use of
IDOE Resources
No-Cost State-Provided Resources
Summer 2007—Deanna Hendricks Wagoner
Why the
Center for Innovation in Assessment (CIA)?
• Indiana University (School of Ed)
• Roger Farr, founder
• Funded to create/develop/maintain:






CORE 40 tests
Standards
Indiana Reading Assessments/ROAR
Curriculum Frameworks
Classroom Assessments
ITRI
The main objective of the
Indiana Reading Diagnostic Assessments
is to be…
…tools for primary teachers to
gain information about the
developing reading skills of each
of their students
Components
Administration 1
August
Kindergarten
October
Grades 1 & 2
Components
What’s Inside the Booklets?
Kindergarten—
Initial Screening Tool
• Letter/Sound ID
Can be given two or
•more
Concepts
Print
timesabout
throughout
•the
Phonemic
Awareness
year to monitor
the
•progress
Environmental
of yourPrint
beginning
•students’
Decoding/Sight
Word
skills.
•reading
Beginning
Writing
Components
Administrations 2 & 3
January & April
Components
What’s Inside the Booklets?
Beginning Reading Booklets
• Phonemic Awareness
(optional at Grade 2)
• Phonics
• Vocabulary
• Comprehension
Listening (K)
Listening & Reading (1)
Reading (2)
Components
What’s Inside the Booklets?
Beginning Reading Booklets—
Kindergarten & Grade 1
Includes Story Comprehension
Assessment
• Actual storybook reprinted
• Includes open-ended
drawing/writing task
• Comprehension score
Components
What’s Inside the Booklets?
Beginning Reading Booklets—
Grade 2
Every story in the
Comprehension Section:
• Includes one short-answer task
Components
What’s Inside the Booklets?
Beginning Reading Booklets—
Grade 2
The last story in the
Comprehension Section:
• Also includes an
extended-response task
Components
What’s Inside the Booklets?
Beginning Reading Booklets
• Most sections are
administered in a
group setting
• Most items are
multiple-choice items
The Indiana Reading Diagnostic
Assessments are Standards-based
1.1.1
1.1.2
Answer keys in the
Teacher Manual
correlate each item
with the Standards
Indicators assessed
by that item
The Indiana Reading Diagnostic
Assessments are Standards-based
A more general
Standards coverage
can be found in the
Standards Coverage
Chart in the General
Information booklets
for each grade level.
The Indiana Reading Diagnostic
Assessments are also skills-based
The ROAR System
is the online score
entry and reports
component of the
Indiana Reading
Assessments
The Indiana Reading Diagnostic
Assessments are also skills-based
The ROAR System
provides reports
based on skills
identified by the
National Reading
Panel as key
skills…that
consistently relate
to reading
success”
The Indiana Reading Diagnostic
Assessments are also skills-based
Provides a variety of student & class reports
based on:
• Phonemic Awareness
• Vocabulary
• Phonics
• Comprehension
The Power of ROAR : REPORTS
Student Reports
For printing several
individual reports at one
click of the mouse
The Power of ROAR : REPORTS
Class Reports
The Power of ROAR : REPORTS
The Class Skills Report displays
the average skill levels of the class
Phonics
Vocabulary
Comprehension
Phonemic
Awareness
Expected
Skill Level
This report reveals that the
class needs to work on
comprehension skills
The Power of ROAR :
31
About 31% of the class met the
expected level for comprehension.
The Power of ROAR
Class Intervention Report
This group needs
to work on
Vocabulary skills
The Power of ROAR
Walt’s responses
Joel’s responses
Looking
closely at this
group’s
Tyrel’s responses
Vocabulary
section
reveals a need
for instruction
in Inflectional
Endings
The Power of ROAR
There is an
activity in the
Resource &
Intervention
Guide that
covers
Inflectional
Endings
The Power of ROAR :
Standards Mastery Report
The Power of ROAR
Use student
reports to
measure the
progress of
individual
students.
The Power of ROAR
Use student
reports to
measure the
progress of
individual
students.
The Power of ROAR
Jansen, Brian
Michaels, Rachel
Papavich, Ivan
Reardon, Winston
Terrell, Latisha
Young, Donnie
Identify groups
of students to
disaggregate
data.
The Power of ROAR
Skill Level
Disaggregated Group Data--Phonics
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
0
Compare groups
to assure
achievement
progress of all
students
Title I
ENL
All Grade 1
1
2
Administration
3
Other Reports for 2006-2007
• Parent Reports
• District Level Reports
• Auto-Grouping Based on Scores
The Indiana Reading Diagnostic
Assessments
Resource & Intervention Guide
•
Additional assessments for
Standard Indicators not
covered on Assessments
•
Classroom Activities for
instructional purposes
•
Correlation to Indiana
Academic Standards
Resource & Intervention Guide
Activities
Resource & Intervention Guide
Assessments
• Checklists
• Can be used for
retesting
• Fluency tests
• Correlates to state
Standards
Diagnostic
Value
IRDA-Online will allow ROAR
Reports by specific Standards
Indicators & links to resources.
How do I register for the
Indiana Reading Diagnostic Assessments?
– Order NOW by filling out an online
form on our Web site at
www.cia.indiana.edu
– Order any other time by contacting
the Center for Innovation in
Assessment:
800-377-1409
indianareading@cia.indiana.edu
How do I gain access to
the ROAR System?
Authorization through principals
– Sent to schools at the beginning of
each school year
– Must be signed and returned by
principal
– Users updated each year
Research Behind ITRI
CIA Staff Researched:
• Indiana-adopted textbooks
• Differences between textbooks
comparing different grade levels
• Differences between Social Studies
& Science textbooks
• Strategies proven to be effective
• Skills important for comprehension
Critical Differences:
Grade 3
vs.
Grade 4
Critical Differences:
Grade 3 vs. Grade 4 Textbooks
Vocabulary
100%
Increase
Social Studies
• Includes only words identified as
vocabulary words needed for tests
• 4th-graders must learn twice as
many vocabulary words per page in
Social Studies
Critical Differences:
Grade 3 vs. Grade 4 Textbooks
Difficult Words in Context
167%
Increase
Science
• Includes words defined or pronounced
within text but not identified as
vocabulary words
• 4th-graders must grapple with
nearly three times as many difficult
words in their Science textbooks
Critical Differences:
Grade 3 vs. Grade 4 Textbooks
Number of Words Per Page
77%
Increase
Social Studies
• As the number of words per page
increases, the font size and spacing decreases
• 4th-graders must read an additional
92 words per page in Social Studies
Critical Differences:
Grade 3 vs. Grade 4 Textbooks
Difficult Syntax
77%
Increase
Social Studies
• Difficult Syntax defined by the number
of complex and compound sentences
• Before learning the new concepts and
information in their Social Studies
textbooks, 4th-graders must
unravel a far greater number of
difficult sentences per page
Critical Differences:
Grade 3 vs. Grade 4 Textbooks
Left-embedded Text
135%
Increase
Social Studies
• Includes sentences beginning with
subordinate clauses, etc.
• 4th-graders must combat nearly 2 ½
times as many left-embedded
sentences per page in Social Studies
Critical Differences:
Grade 4
vs.
Grade 5
Critical Differences:
Grade 4 vs. Grade 5 Textbooks
Science Textbooks Increases
Vocabulary
45%
Difficult Words
51%
Left-Embedded Text
46%
Difficult Syntax
55%
18%
Words per Page
Critical Differences:
Grade 4 vs. Grade 5 Textbooks
Social Studies Textbooks Increases
Vocabulary
98%
Difficult Words
150%
Left-Embedded Text
129%
Difficult Syntax
97%
8%
Words per Page
Critical Differences:
Grade 2
vs.
Grade 3
Critical Differences:
Grade 2 vs. Grade 3 Textbooks
Differences need new categories:
• Complexity of vocabulary words
• Complexity of graphics
• Storybook format
Critical Differences:
Grade 2 vs. Grade 3 Textbooks
Social Studies Textbooks Increases
Vocabulary
33%
Difficult Words
0%
Left-Embedded Text
<1%
Difficult Syntax
34%
89%
Words per Page
Critical Differences:
Grade 2 vs. Grade 3 Textbooks
Science Textbooks Increases
Vocabulary
<1%
Difficult Words
150%
Left-Embedded Text
218%
Difficult Syntax
241%
171%
Words per Page
Grade 3 Reading Skills
Five Reading Skills:
• Text Features
• Main Idea
• Problems and Solutions
• Predicting
• Key Words
Grade 4 Reading Skills
Eight Reading Skills:
• Skimming & Predicting
• Main Idea & Details
• Difficult Words in
Context
• Vocabulary
• Compare &
Contrast
• Sequence
• Cause & Effect
• Graphics
Grade 5 Reading Skills
Six Reading Skills:
• Main Idea/Supporting Details
• Sequential Order
• Interpreting Graphics
• Making Inferences
• Fact & Opinion
• Word Knowledge
ITRI Materials
1
Diagnostic Assessment
2
Lessons
3
Follow-Up Assessment
1
Diagnostic Assessment
• 2-3 tools: 20 minutes each
• Can be given all in one day or over
the course of a few days
• Can be given to whole group or
small groups
• Use diagnostic information to
determine the areas where students
are still struggling
Assessment Tools
Content-areafocused tools
that assess a
student’s
development of
specific reading
skills.
Each reading skill is
covered by the
same item number
in each of the
diagnostic tools.
#2
#3
Graphics
Scoring Form:
Grade 4
5
includes
includesthree
four
questions per
reading skill
Difficult
Words
Assessment Tools
2
Lessons
• Reading Skill introduction
• 3-5 lessons per reading skill
(24-30 total w/Concluding Project
in Grade 5)
• Teachers set the pace
• Can be completed as a whole
group, small group, or individually
• Classroom discussion of answers
is key
Grade 4
Instructional
Tools include:
• an introduction to a reading skill,
• study skill/strategy lessons,
• and two content-focused lessons
Grade 5
Instructional
Tools include:
• an introduction to a reading skill,
• three content-area-focused lessons,
• a biography lesson,
• an activity,
• and an inquiry-based project
Grade 4
Content Areas:
• English/Language Arts
• Social Studies
• Science
• All Indiana-related
• Standards-based
Grade 5
Topic Sets:
Content
Areas:
• American
Indians Arts
English/Language
• Inventors
Social Studies
• Geography
Science
• The
MathExchange of
Goods & Services
• Health
• Explorers
• Standards-based
• Economics
Grade 5
Lesson Formats:
Traditional Format
Biography Format
Grade 5
Lesson Formats:
Activity Format
Math Application
Format
Standards Resources available at
www.indianastandardsresources.org
You will be asked
to choose subject
area, grade level,
and Standard
Click on the “View
Resources” link to
view resources
available for that
Standard Indicator
Standards Resources available at
www.indianastandardsresources.org
Click on the
NAME of the
resource to
view that
resource
Activities, Assessments, and Online
Lesson Plans
Curriculum Frameworks
Classroom Assessments
Activities, Assessments, and Online
Lesson Plans
And MarcoPolo Online Lesson Plans
Other Resources Available on the IDOE
Web site
www.doe.state.in.us
Click on
“Programs & Services”
Other Resources Available on the IDOE
Web site
www.doe.state.in.us
Click on
“Office of Program
Development”
Other Resources Available on the IDOE
Web site
Click on
“English/Language Arts”
Other Resources Available
Other Resources Available
Other Resources Available
Go to the IDOE Web site
Click on Programs & Services
Click on Office of Program
Development
Choose English/Language Arts
Other Standards-Based Resources
Available
www.smartdesktop.org
Search by
Standard
Other Standards-Based Resources
Available
www.smartdesktop.org
Other Standards-Based Resources
Available
www.smartdesktop.org
Or Search by:
• subject
• geographical area
• resource provider
• time period
• type of resource
• grade level
Other Standards-Based Resources
Available
www.smartdesktop.org
8,303
resources
from 45
different
providers
FREE Training Opportunities
Training for:


Indiana Reading Diagnostic Assessments

Scoring & Administration

Reports & Interventions
ITRI (all three grade levels)
FREE Training Opportunities
For schedule of workshops:
www.cia.indiana.edu/training.htm
For more information:
1-800-377-1409
indianareading@cia.indiana.edu
www.cia.indiana.edu