Intellectual Assessment The identification and Treatment of Learning

Interpreting PsychoEducational Reports
An overview of the purposes and content of typical
psycho-educational reports
Dr John Worthington
Educational Consultant and Psychologist
DEVELOPMENTAL LEARNING PROFILE (DLP)
Performance Comparisons (approximate)
140
126
113
120
100
100
90
103
95
95
93
80
80
116
73
75
94
88
88
80
84
74
74
76
76
88
84
80
76
68
66
60
52
60
48
48
52
40
20
0
P PV T-II I
C. Age
E VT
TA CL-R S I
TA CL-R S II I
TA CL-R S II
V MI -I V
TV P
WI AT -II WR
WI AT -II NO
WI AT -II M R
WI AT -II P D
WI AT -II S p
WI AT -II LC
Skill Areas Tested
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Aims of the Presentation

What is a psycho-educational report / assessment?

What elements should we first consider the report? (the who, when, where,
what, why and how of the process).

What is the typical structure of a ‘good’ psycho-educational report?

To refresh our understanding of the strengths and limitations of intellectual
assessment tools

To take an overview of the WISC-IV, its structure and its use in identifying
and supporting individuals with learning disability

Presenting different results in a Developmental Learning Profile (DLP)
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Just a Reminder of what learning
disability looks like?
(Learning Disability in the younger child)

Significant History: A general parental
concern prior to or shortly after the start
of formal schooling. Little or no interest
by the child in play reading or writing but
may like being read to. Slow to take on
and have an interest in letters (names
and or sounds) and may struggle to
distinguish between digits and letters,
and does not notice differenced in letter
orientation d/b/p/q etc.

Figure 1. Spelling / writing sample of
five year girl with possible (future)
Learning Disability.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
What is a psycho-educational
assessment?



Essentially psychological assessment involves testing the ‘mind’ usually ‘cognitive’
functioning, the ability of the mind to do certain things. Typically this means testing
intelligence but assessment may also be focused on functions such as auditory or
visual memory, short term memory and or working memory.
The educational part usually refers to academic skills (e.g. reading comprehension,
spelling, mathematics etc.) but often also includes elements of language skills (e.g.
receptive vocabulary), fine motor skills and visual perception. Many skills especially in
younger children such as phonemic awareness, fine motor and visual perception
skills, sit within both the educational and therapy models and sometimes in the
psychological model.
Clinical psychologist also do assessments involving higher level (executive)
functioning, personality types, ‘assessments’ of psychological disorders (e.g. OCD,
personality disorders, conduct disorders etc.)
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
What elements should we look for
in first considering the report?



While it might sound a little trite, psych-educational reports should be in
writing. My experience and reading makes it very clear oral reports by
parents and others, of psycho-educational assessments are not reliable.
This is because even in ideal circumstances parents are under stress when
listening to results, they can be selective about what they ‘choose’ to
remember and they are likely to forget and or confuse detail.
Check the report is actually about the child your are interested in (check at
least the full name and date of birth). How old in the information? check
when the assessment was done (DOA) and the date the report was written
and signed as sometimes there is a long gap.
The written report should be complete (numbered pages with no missing
pages or missing attached sheets), signed by the responsible professional
with their ‘title’ / position clearly indicated.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
What elements should we look for
in first considering the report?
(continued)




Make sure you have received the report in an ‘ethical’ way and that you
have an appropriate professional reason for reading it.
Check why the report written and the reasons leading to the assessment /
referral.
Look at the reasons for the assessment and look for the process that was
followed. This may parallel your need for understanding the child or be
completely different.
Remember psychological assessment is as much an art as a science the
precautionary notes and confidence intervals need to be considered.
Remember you don’t have an exact IQ you have a score representing
performance within a confidence range.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
What is the typical structure of a
‘good’ psycho-educational report?




Essentially a ‘good’ psycho-educational report should present as a
structured story.
The report should initially identify the person who wrote the report and the
person about whom the report was written (full name and DOB). There
should be additional sufficient information to allow the reader to know the
physical and professional source and how that place and organization can
be contacted.
After the identification there should be an introduction outlining the reasons
the report was written and its purpose.
There there should be a concise description of the process (of assessment),
the results and the conclusions.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Interpreting Psycho-Educational
Reports the Detail



Essentially psycho-educational reports summarize the results of
assessments typically standardized assessments. They should have an
introduction (often with a history) and details of any special features or
issues influencing the assessment and or the results.
There may also be detailed of different types of ‘observations’ of behaviour
and functioning.
Psycho-educational reports may link the psychological results (QI =
potential to learn academically) to academic results. Some reports may also
go on to identify which specific elements of the IQ testing (usually at the
subtest level) that are implicated in learning issues or learning styles.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
What is standardized assessment?



Standardized assessment forms one part of gaining an understanding of an
individuals functioning in one or more areas of ability, skills an behaviour.
Standardized test are highly structured instruments which allow the
observation of an individuals’ performance. The ‘result’ achieved is then
compared to the performance of a group judged to represent the
population (from which that individual has come).
The standardized test is the is the mainstay of the psycho-educational
assessment process along with an analysis of the history (including previous
assessments and reports) and clinical observations.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Some Assessment instruments focusing
on cognitive functioning

Wechsler Preschool and Primary Scale of Intelligence – Third Edition
Australian Standardisation (WPPSI-III) (Wechsler, 2004) (2y 6m to 3y 11m;
4y 0m to 7y 3m)

Wechsler Intelligence Scale for Children - Fourth Edition (WISC-IV) Australian
Language Adaptation (Wechsler, 2003) (6y-16y 11m)

Wechsler Adult Intelligence Scale-Third Edition (WAIS-III) (Wechsler, 1997)
(16y-89y)

Kaufman Brief Intelligence Test, (K-BIT) Australian Language Adaptation
(Kaufman & Kaufman, 1996)

Slosson Intelligence Test - Revised (SIT-R3) (Nicholson & Hibpshman, 2002)
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Wechsler Intelligence Scale for Children Fourth Edition (WISC-IV) (Australian
Language Adaptation) (Wechsler, 2003)


The WISC-IV is an individually administered instrument for assessing the
cognitive ability of children aged 6y 0m to 16y 11m. The WISC-IV has
resulted from a significant revision of the WISC-III (Wechsler, 1992). The
WISC-IV has ten subtests and five supplemental subtests and the results
provide subtest and composite scores that represent intellectual functioning
in four specific cognitive domains, as well as a composite that represents
general intellectual ability (i.e. Full Scale IQ) (Wechsler, 2003).
The WISC-IV and its sister tests the WPPSI-III and the WAIS-IV represent
the current generation of IQ tests typically in the American tradition. There
are other types of tests and other families of tests which typically evolve
over time. This evolution is driven by research and cognitive theory and the
fact that over time specific elements in tests become either ‘easier’ or
outdated.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
WISC-IV Presentation of the results

Full Scale IQ Standard Score (Mean 100 SD 15); Four Index Standard
Scores (Mean 100 SD 15) and Subtest Scaled Scores (Mean 10 SD 3)

All levels of results can be reported in percentile ranks (%ile) while the
subtest results can also be reported in Age Equivalents

Remember the confidence intervals are important especially near the ‘ends’
of particular classifications

In this new generation of tests certain requirements need to be met before
a FSIQ can be calculated

Most QI tests now have computer programs which ‘write’ most of the report
in a split second. While such reports are likely to be relatively more accurate
in terms of scoring they can lack a practical specificity in the detail, be long
and full of precautionary statements. The report should state clearly if such
a tool has been used in full or in part
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Reading the Results


The test manual provides qualitative descriptions for the WISC-IV Full Scale
Scores which include "Very Superior 130 and above, “Superior” 120-129,
“High Average” 110-119; “Average” 90-109 and “Low Average” 80-89,
“Borderline” 70-79 and "Extremely Low" 69 and below.
The subtest scaled scores for an individual's same age peers have a metric
mean of 10 and a SD (i.e. standard deviation) of 3. Thus scaled scores of 7
(16 %ile) and 13 (84 %ile) are 1 SD below and above the mean
respectively, while scaled scores 4 (2 %ile) and 16 (98 %ile) are 2 SD's
below and above the mean respectively.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
The structure of the WISC-IV
The WISC-IV has four specific cognitive domains (Indexes) which together
contribute to the Full Scale IQ
FULL Scale IQ
Verbal
Comprehension
Perceptual
Reasoning
Working
Memory
Processing
Speed
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
The structure of the WISC-IV
Each of the four Index scores is derived from a number of subtest scores.
There are five supplemental subtests which can be substituted for a specified
number of core subtests if needed.
WISC-IV Full Scale IQ
Verbal Comprehension
Index
Perceptual Reasoning
Index
SI
BD
VC
CO
PCn
MR
Working Memory
Index
DS
LN
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Processing Speed
Index
CD
SS
Verbal Comprehension Subtests





SIMILARITIES (SI)
Individuals are presented with two words that represent common objects or
concepts and asked to say how they are similar.
VOCABULARY (VC)
Younger individuals are shown pictures and asked to name them. Then
individuals are asked to give definitions for words presented orally and
visually.
COMPREHENSION (CO)
Individuals are asked to respond to questions requiring an understanding of
social situations, reflecting common sense, social judgment, behaviour and
conventional standards.
INFORMATION (IN) (Supplemental subtest)
Individuals answer questions that address a broad range of general
knowledge topics.
WORD REASONING (WR) (Supplemental subtest)
Individuals are asked to identify the common concept
described in a series of clues.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Perceptual Reasoning Subtests




BLOCK DESIGN (BD)
Individuals use up to nine red and white blocks to re-create a model or a
picture of a design within a specific time limit.
PICTURE CONCEPTS (PCn)
The individual is presented with two or three rows of pictures and choose
one picture from each row with common characteristics.
MATRIX REASONING (MR)
Individuals look at an incomplete matrix (made up of pictures or designs)
and selects the missing item from five options.
PICTURE COMPLETION (PCm) (Supplemental subtest)
Individuals have to point to or name an important part missing from a
picture within a specific time.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Working Memory Subtests



DIGIT SPAN (DS)
Digit Span requires the individual to do two distinct tasks, the first
repeat orally numbers presented in the same order. Then the individual
is asked to repeat orally presented numbers in reverse order.
LETTER-NUMBERING SEQUENCING (LN)
Individuals are read a sequence of numbers and letters and are asked to
recall the numbers in ascending order and the letters in alphabetical order.
ARITHMETIC (AR) (Supplemental subtest)
Individuals solve a series of orally presented arithmetic problems within a
specific time limit.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Processing Speed Subtests



CODING (CD)
Individuals copy symbols that are paired with simple
geometric shapes or numbers within a specific time limit.
SYMBOL SEARCH (SS)
Individuals scan a search group (of abstract symbols) and
indicate if a target symbol/s matches any of the symbols in
the search group within a specific time limit.
CANCELLATION (CA) (Supplemental subtest)
Individuals scan both a random and structured arrangement of
pictures and marks target pictures within a specific time limit.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Understanding the WISC-IV Subtests



Now the structure of the WISC-IV is clear it is time to consider how to
‘understand’ what the results are saying about an individuals overall
learning potential (FSIQ), different areas of cognitive ability (Index Scores)
and specific areas of functioning (Subtests).
As interpretation moves from the FSIQ to the subtest level the more specific
the observation but the less reliable that specific performance (on a
subtest) on a specific occasion will be.
The test manual provides numerous ways to compare and contrast an
individuals performance at the Index and subtest levels. Such advanced
analysis can be useful when there is a high (or even a significant) degree of
variation between specific scores at particular level.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
WISC-IV Subtests (The fine detail)



Children with learning delays will usually have an unusual (read variable)
subtest profile, the overall result (FSIQ) will be the first clue, the Index
scores the next and the subtest results the final evidence.
From my experience the Working Memory Index and the Processing Speed
Index scores are often implicated in learning difficulties (dyslexic) profiles.
Within Working Memory the differences between digits forwards, digits
reversed and letter numbering sequencing needs close examination. The
Processing Speed can identify children who are referred for ‘not being able
to get their ideas down’.
Remember that while instruments like the WISC-IV can be a source of
valuable information about an individuals cognition and to a lesser extent
learning style, IQ tests are not designed to identify dyslexia or diagnose
general or specific learning difficulties. They are tests of cognitive
functioning and any link between any part of a WISC-IV ‘result’ and a
learning issue needs careful consideration.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
WISC-IV / WPPSI-III /WAIS-III
and the WIAT-II


There are tests of academic skills which can provide a direct relationship
between measured intelligence (QI) (seen as a good measure of the
potential to learn academic skills) and academic attainments (academic
skills).
Comparisons between ‘predicted’ learning levels and measured learning
levels now provides an additional tool to measure and understand delays in
specific learning and to track learning over time and relative to measured
ability.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Profiling Results
The Developmental Learning Profile
(DLP)



In describing and ‘reading’ the patterns of results from different types of
assessments it is possible in an approximate way to present an overall
picture by plotting scores which are on the same scale.
In my practice by way of summarizing results I use age equivalent scores
and present them with ‘predicted scores’.
These DLP’s can be used to help diagnose different types of learning delays
(or acceleration) and over time combined as one way of tracking a child’s
learning development.
Learning Disability in the younger child
DEVELOPMENTAL LEARNING PROFILE (DLP)
Performance Compari sons (approximate)
100
85
80
84
77
70
72
72
68
66
61
60
60
60
57
48
40
20
0
SIT-R3
C. Age
EVT
PPVT-III
TACL-R SII
VMI-IV
TACL-R SI
TACL-R SIII
TVP
WIAT-II LC
WIAT-II MR
WIAT-II WR
WIAT-II NO
Skill Areas Tested
Figure 1. Developmental Learning Profile of 5 year girl with indications of Learning Disability.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
L D in middle and high school
DEVELOPMENTAL LEARNING PROFILE (DLP)
Performance Compari sons (approximate)
160
155
146
142
140
135
127
129
120
120
117
107
116
108
104
104
100
91
80
68
60
40
20
0
K-BIT Vocab
PPVT-III
TACL-R SI+
TACL-R SIII
C. Age
K-BIT Matrices
EVT
TACL-R SII
VMI-IV
TVP
WIAT-II WR
WIAT-II Sp
WIAT-II PD
WIAT-II RC
WIAT-II NO
Skill Areas Tested
Figure 2. Developmental Learning Profile of 12 year 2 months old boy with evidence of Learning
Disability.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
The learning disabled adult
DEVELOPMENTAL LEARNING PROFILE (DLP)
Performanc e Comparisons (approx imate)
300
269
250
200
150
134
100
100
105
107
108
110
116
116
107
96
84
96
88
50
0
K-BIT Matrices
EVT
TACL-R SII
VMI-IV
C. Age
PPVT-III
TACL-R SI+
TACL-R SIII+
TVP
WIAT-II PD
WIAT-II RC
WIAT-II MR
WIAT-II WR
WIAT-II Sp
Skill Areas Tested
Figure 3. Developmental Learning Profile of woman aged 22 year 5month showing consequences
of mild intellectual impairment and Learning Disability
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Predictive Scoring WISC-IV and
WIAT-II
DEVELOPMENTAL LEARNING PROFILE (DLP)
Performance Comparisons (approxi mate)
99
100
95
85
80
80
79
72
72
72
73
70
64
68
64
64
60
48
40
20
0
PPVT-III
C. Age
TACL-R SI
EVT
VMI-IV
TACL-R SII
WIAT-II PD
TVP
WIAT-II Sp
WIAT-II WR
Skill Areas Tested
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
WIAT-II MR
Complex Developmental Learning
profile (DLP)
Full DLP data for David acadenic and non academic
Group Mean Age
Chronological Age Peter
WIAT BR Mean Age Equ
WIAT BR Age Equivalent Peter
WIAT RC Mean Age Equ
WIAT RC Age Equivalent Peter
WIAT Sp Mean Age Equ
WIAT Sp Age Equivalent Peter
WIAT MR Mean Age Equ
WIAT MR Age Equivalent Peter
Daberon-2 Mean Age Equ
Daberon-2 Age Equ David
PPVT-III Mean Age Equ
PPVT-III Age Equ David
EVT Mean Age Equ
EVT Age Equ David
TACL-R Mean Age Equ
TACL-R Age Equ David
VMI-IV Mean Age Equ
VMI-IV Age Equ David
130
120
110
100
Age equivalents
in months
90
80
70
60
1
5
50
9
Regular observation
Stages
Figure 6.5 Co mplete Develo pmental Learning P ro file (DLP ) o f academic and no n academic skills (David). Data are displayed in co lo ur co lumns, the first two
co lumns o n the left sho ws the gro up mean chro no lo gical age Stages 1-12 and David'schro no lo gical age Stages 1-12. The remaining co lumns sho w the mean age
equivalent sco res in mo nths fo r the gro up Stages 1-9 and David's age equivalent sco res fo r the assessments listed in the table abo ve. No te the sco res at Stages
10 and 11 have been estimated using the actual sco res at Stage 9 and 12.
© Text, format, graphics and data Copyright Dr John Worthington all rights reserved 2004 ©
www.jweducation.com
Conclusions

We have looked at what makes up a psycho-educational report /
assessment?

We have seen there needs to be consideration of the who, when, where,
what, why and how of the report and the overall process.

We have looked at the structure of a ‘good’ psycho-educational report.

We have refreshed our understanding of the strengths and limitations of
intellectual assessment tools

We have taken an overview of the WISC-IV, its structure and its use in
identifying and supporting individuals with learning disability

We have looked at one way for presenting different results in a
Developmental Learning Profile (DLP)