Guidelines for Documentation, Assessment, and

advertisement
Disability Guidelines 1
Alberta Guidelines for Documentation, Assessment, and Services for
Students with Learning Difficulties in Post-secondary Studies1
These guidelines were created to promote a shared understanding and greater consistency among
disability service providers (DSPs) in post-secondary institutions, psychologists, and funding
bodies involved in assessment of and support services for students encountering learning
difficulties2. These guidelines are suggested best practice to assist post-secondary institutions to
provide appropriate assessments and supports3.
CONSIDERATIONS FOR ASSESSMENT REFERRALS
1. Assessments completed after the student reaches the age of 18 are considered current. Partial
or full reassessment may be considered if information is needed to support the student in the
current learning environment or if the student’s health or other circumstances have changed.
2. Assessments may be considered to be full or partial, depending on missing documentation
(see Appendix 1).
3. Full assessments are required when assessments provided are out of date for reasons of age
of the assessments or change of circumstances. Updated assessments may be needed if prior
assessments were completed five or more years prior to onset of requested service (i.e., if the
student is now 19 years of age and the assessment was completed at age 14) or as required by
specific program licensing bodies (e.g., Nursing, Accounting).
4. Partial assessments are required when current documentation is missing any of the following
components:
• Diagnosis or diagnostic statements by an appropriately qualified member of a College of
Psychologists,
• Information on functional limitations in the current setting,
• Recommendations applicable to the current setting,
• Data related to the Learning Disabilities Association of Canada (LDAC) definition (e.g.,
missing data on thinking and reasoning abilities, psychological processing, and/or
academic functioning).
5. Assessment can be prioritized based on urgency:
Priority: High
• Current assessment information is not available
1
Prepared for Postsecondary Service Providers to Students with Disabilities - Alberta by Teddi Doupe, University
of Alberta and Marilyn Samuels, University of Calgary. Please send comments to Teddi at teddi.doupe@ualberta.ca
or Marilyn at msamuels@ucalgary.ca
2
The term learning difficulties is used to describe the student’s presenting concerns. These concerns may lead to a
diagnosis of a Learning Disability, Attention Deficit Hyperactivity Disorder, or other disability.
3
Portions of this document were adapted from “Learning Disability Documentation and Services Provided”, College
Committee on Disability Issues, Ontario, 2005.
D:\106739541.doc
Disability Guidelines 2
•
•
Screening tools and/or interview suggest a Learning Disability
Potential need for services and supports (e.g., reader or scribe, technology, tutor,
academic strategist)
• Intake completed late in the program and the student requires accommodations for
licensing exams
• Enrolment in program of short duration (e.g., apprenticeship programs or in a field
placement setting)
• High risk of failure
Note: Assessment to be completed as soon as possible (ideally within one month).
Priority: Medium
• Formal assessments have never been completed or assessments are incomplete
• The assessment is no longer current
• The DSP has sufficient information to provide temporary support for student
• Additional funding (e.g., DRES, CSG) is not required
Note: Assessment to be completed within four months.
Priority: Low
• Information on supports is needed
• Currently, low use of disability support services
• Satisfactory academic performance with minimal accommodations
• Nearing end of academic program
Note: Assessment to be completed within six months.
RECOMMENDATIONS FOR LEVEL OF SERVICES RELATED TO TYPE OF
DOCUMENTATION
Level 1 Documentation (No diagnosis)
 Historical evidence of a Learning Disability; this could include a screening tool, IEP/IPP
or medical records
 Educational assessments provide evidence of academic difficulties
 Partial reports that do not include a clear diagnosis
At this level, services are temporary or interim and based on the student’s demonstrated need.
An interim period is ideally one term/semester (dependent upon the time frame of the postsecondary program). Services are selected in the interest of student success, based on evidence of
learning difficulties as supported by partial documentation.
Recommended services as required to meet the student's needs:
 Full assessment
 General exam accommodations (e.g., additional time, private room, computer)
 Learning strategies through general student services
 Content tutoring through general student services
 Note taking supports through photocopying/NCR copies of classmates’ notes
D:\106739541.doc
Disability Guidelines 3
Note: The following are not recommended, as they require the disability office to “verify” the
student’s disability:
 Canada Study Grant (CSG) for students with permanent disabilities
 Application for Disability Related Employment Supports (DRES) funding for additional
services and equipment purchases
 Specific exam accommodations (e. g., reader, scribe, technology)
Level 2 Documentation (diagnosis, but further assessment required)
Psychological assessments contain diagnostic statements but further assessment is needed for
reasons of age of the documentation, partial, or insufficient data.
At this level, services are temporary or interim and based on the student’s demonstrated need.
An interim period is ideally one term/semester (dependent upon the time frame of the postsecondary program). Services are selected in the interest of student success, based on evidence
of learning difficulties as supported by partial documentation.
Recommended services as required to meet student's needs:
 Full or partial assessment
 General exam accommodations (e.g., additional time, private room, computer)
 Specific exam accommodations (e.g., technology)
 Learning strategies through general student services or Disability Services
 Content tutoring through general student services
 Note taking supports through photocopying/NCR copies of classmates’ notes
 Lab access (including scanning textbooks)
 Reduced course load (Canada Student Loan reduced course load – 40% full-time
recognition)
Note: When diagnosis is questionable due to age of the documentation or insufficient data:
 Provide students with a letter of understanding that, should the updated assessment not
support the diagnosis, interim services may be adjusted.
 Provide students with a letter of understanding that, should they not pursue the
assessment in a timely manner, interim services may be terminated
Level 3 Documentation
Current and full psychological assessments that meets all diagnostic and documentation criteria.
At this level, services are permanent and based on the student’s demonstrated need. The student
is eligible for a full range of appropriate and reasonable disability-related services. The process
to determine appropriate accommodations and services “A Process for Determining
Accommodations & Services” (Appendix 3) should be considered.
Recommended services as required to meet student's needs:
 Examination and classroom accommodations
 Assistive technology assessment and training and lab access (including scanning
textbooks)
D:\106739541.doc
Disability Guidelines 4







Reading materials prepared in appropriate alternate formats.
Instruction in conversion of some materials to alternate format
Learning strategies instruction and support
Disability-related content tutoring
Note taking supports through photocopying/NCR copies of classmates’ notes or
classroom note taker
Application for CSG or DRES funding for additional services and equipment purchases
Recommendation for reduced course load and support for student being recognized as
full-time student by Canada Study Loan based on 40% full courseload criterion.
Suggested steps when reasons for difficulties remain unclear following assessment
1. The assessment report indicates that the student does not have a disability.
a. Does the assessment contain information about the reasons for which the student is
encountering difficulties and what he/she needs to do to address those difficulties?
b. Does the assessment contain evidence of another disability but no diagnosis?
c. Is further referral warranted (e.g., counseling, other assessment)?
The DSP may need to contact the assessing psychologist for clarification4.
2. The assessment report does not indicate that the student has a disability but contains
recommendations for services.
The DSP needs to contact the assessing psychologist to clarify the reasons for which he/she
made recommendations if no disability is present.
3. The assessment report contains a diagnosis of disability but no description of functional
limitations and/or recommendations.
The DSP needs to contact the assessing psychologist and request information about functional
limitations or impact of disability and recommended supports within the current academic
setting.
4. The assessment report contains a diagnosis of psychiatric disability but no description of
functional limitations or impact of disability and/or recommendations.
The DSP needs to contact the assessing psychologist and request information about functional
limitations and recommended supports within the current academic setting. Referral to a
psychiatrist for further documentation may be required.
4
DSPs must have written consent from the student to contact the psychologist.
D:\106739541.doc
Disability Guidelines 5
APPENDIX 1
Documentation Requirements
The following checklist outlines post-secondary documentation requirements. Full reports of
this type are most useful in guiding support services and assisting students to develop self advocacy skills.
Documentation Criteria Checklist
Relevant background information.
Statement regarding the overall validity of the present assessment.
Behavioral observations during assessment.
Description of individual strengths and needs based on formal test results
(thinking and reasoning and academic achievement).
Documented evidence of the cause of the learning difficulties (psychological
processing deficits).
Indication that the observed pattern of both abilities and achievement
demonstrates the presence of a specific Learning Disability or other disability.
A clear diagnosis of the disability.
A description of the functional limitations of the disability (including the impact
in the current academic environment).
Recommendations specifically linked to the assessment data (strengths and
deficits) relevant to post-secondary settings.
Signature of an appropriately qualified member of a College of Psychologists,
and/or College of Physicians and Surgeons.
D:\106739541.doc
Disability Guidelines 6
APPENDIX 2
For Disability Service Providers: Reviewing Documentation
Questions to ask when reviewing assessments about which concerns have arisen (e.g., unclear,
incomplete):
Is the assessment multi-modal and based on multiple sources of information?
Does the assessment reflect and focus upon the processes and strategies used by the
student and not just on the numbers?
Does the assessment answer the referral questions?
Was the student provided with sufficient opportunity to demonstrate knowledge, skills,
attitudes, or behaviors being assessed? (Being assessed all in one day may not allow
this.)
Does the assessment data correspond to the student’s performance in the academic
setting? (e.g., A student may score poorly on a test of written language but manages
written requirements through technology; a student may score well on a test of reading
but reports investment of an inordinate effort to meet the post-secondary reading
demands; a student may score in the average range on tests of processing speed but
reports an inability to finish exams.)
Do the summary and interpretation of the assessment results yield an accurate and
informative representation of the student’s performance in relation to the goals and
objectives of the program?
D:\106739541.doc
Disability Guidelines 7
APPENDIX 3
A Process for Determining Accommodations & Services5
1. Clarify what the student understands about his/her disability and what has been helpful in
the past.
2. Identify the academic areas in which difficulties exist.
3. Determine the functional impact(s) of the disability from documentation and by speaking
with the student (e.g., How do attention difficulties impact learning/performance?)
4. Collect or request additional data to determine the functional impact. (Use of valid test
data is critical!)
5. Compare the functional impact of the disability with the construct and format of the
course or test demands.
6. Evaluate severity to determine the extent of time accommodation or distraction reduction.
7. Evaluate unique factors.
8. Collect or request additional information to determine whether a requested or
recommended accommodation or service is likely to be effective. Dynamic assessment
may be useful here; student input is essential.
9. An appropriate accommodation or service should minimize the impact of the disability
while maintaining academic integrity.
5
This process can be used by Disability Service Providers and Psychologists as appropriate. The above is adapted
from Ofiesh, N. S. & Scott, S. S. (2004). Extended test time and postsecondary students with learning disabilities: A
model for decision making. Learning Disabilities Research and Practice, 19(1), 57-70.
D:\106739541.doc
Disability Guidelines 8
APPENDIX 4
For Disability Service Providers: Assessment ABCs
Assessment is a Process
•
•
•
•
•
•
•
Assessment is always done to understand and support the needs of the student.
Standardized test results are only one piece of the process.
The student must be seen in the context of his/her life, not just in terms of what the
“numbers” say.
Multiple sources of information need to be used.
Assessment tools must be valid in terms of the student’s current context.
A diagnosis is often the result of an assessment process but, in itself, is not enough. The
functional limitations of the disability must be described and recommendations for
supports, services, and further development must be provided.
A person is never defined in terms of his/her disability – we see the person, not the
disability.
Basics of Tests
• Standardized tests
Standardized tests can be either norm referenced or criterion referenced.
A norm referenced test provides a direct measure of the student's performance on specified
tasks under specific conditions. It compares the student's performance to others of similar
age/grade. Tests such as the Wechsler scales and the Woodcock Johnson tests are examples
of norm referenced tests.
A criterion referenced test is a direct measure of the student's performance on specific tasks
under specific conditions, with specific criteria for success. Criterion referenced tests are
seldom used in psychological assessments. They may be used in licensing examinations to
determine whether the student has the essential competencies for the profession.
• Dynamic assessment
This informal assessment approach examines the student's performance before, during, and
after intervention. This approach is particularly useful for students with attention and other
emotional issues to determine the ways in which these factors impact upon academic
performance. It is also a useful approach for students with atypical educational histories.
• Informal assessment
Informal assessment can provide information on a student's performance in specific
curriculum areas. It can provide direction for planning of support services.
• Checklists, rating scales, interviews, and questionnaires
These tools are useful for gathering information about the student’s past and present
performance. At the post-secondary level, they are generally self-report measures and, as
such, must be used in conjunction with other information. Some rating scales are norm
referenced (e.g., CAARS).
D:\106739541.doc
Disability Guidelines 9
• Observations
Observations during the process of assessment provide direct measures of the student's
behavior. As behavior can vary from day to day, observations across several sessions are
useful.
Categories of Assessment Tools
• Intelligence Tests
The intelligence test most frequently used with post-secondary students is the Wechsler
Adult Intelligence Scale-III (WAIS-III). It is a norm referenced test that needs to be
administered and interpreted by a registered psychologist.
• Thinking and Reasoning Tests
A number of tests purport to assess thinking and reasoning. The WAIS-III measures some
aspects of thinking and reasoning. The Woodcock Johnson cognitive battery is also used.
• Executive Functioning Tests
Tests such as the Delis-Kaplan Executive Function System and the Rey Complex Figure Test
assess aspects of executive function. Executive functioning is critical to self-controlled
learning. The main components are task analysis, strategy selection and revision, and
monitoring6
• Psychological Processing Tests
These tests examine visual and/or auditory processing of information. Memory tests, such as
the Wechsler Memory Scales, are also included.
• Achievement Tests
Achievement tests commonly used with adults include the Wechsler Adult Achievement
Test-II and the Woodcock Johnson Achievement Test. Validity may be a concern with both,
as the results may not relate to how the student performs in school. For example, the student
is required to hand write an essay for 15 minutes to assess written expression. Few students
hand write these days (especially students with learning disabilities) and 15 minutes cannot
reflect what it takes to write a research paper. Similarly, reading comprehension on a short
passage may differ greatly from reading and understanding information in a textbook.
• Emotional Tests
Emotional concerns are investigated through self-report scales, interviews, and observations.
Some scales have been standardized and have strong psychometric properties (valid in that
they test what they purport to test, reliable in that they would produce the same results two
days running – they are not easily faked).
Discrepancy Analysis
This refers to a mathematical calculation to compare differences in scores obtained on tests of
intellectual functioning and achievement tests. It is assumed that most people who do well on a
test of intelligence will also do well on a test of achievement. This assumption holds only if the
two tests were developed and normed on the same population and show a high correlation
between sets of scores. A discrepancy of two or more standard deviations was once considered
critical for diagnosing a Learning Disability. This is no longer the case (but is still believed in
some circles). In adults, it is often hard to find a difference of two standard deviations. Of more
6
(Borkowski, J. G. & Nicholson, J. (2004). Executive Functioning: Toward a research agenda on higher level
cognitive skills. Journal of Cognitive Education and Psychology, 4, 2, 188-198.)
D:\106739541.doc
Disability Guidelines 10
interest is whether the difference is clinically significant. For example, the discrepancies among
scores on the WAIS-III and WIAT-II can be calculated to determine whether the discrepancy is
statistically significant; however, the more important distinction relates to the frequency with
which a discrepancy of this size occurs in the population. A difference may be statistically
significant but, if it is seen in more than 10% of the population, it is not clinically significant. It
is also important to determine whether the discrepancy is meaningful. A student may have a
score in the superior range on perceptual organization and in the average range on the reading
composite of the WIAT-II. Even though this is a significant difference, it may constitute normal
variation, not a disability.
In contrast, Response to Instruction is a relatively new term being used in the LD field. It refers
to how difficult it is for someone to learn. A student may achieve passing or even high grades
but must invest inordinate amounts of work to gain and retain knowledge. Few tests assess
response to instruction in children or adults, so at present this is determined by past performance
and self-report. When someone has had opportunities to learn, has been motivated to learn, and
has put in good effort, yet still does not achieve as expected, this may be indicative of a Learning
Disability even if no significant discrepancy between intelligence and achievement scores is
present. Psychological processing scores will likely indicate some difficulties.
Effect of the Disability
A functional limitation refers to the effect of the disability on learning, behaviour, or
performance. A Learning Disability in mathematics is not likely to affect reading
comprehension but may make it difficult to do basic calculations without a calculator. A person
with Attention Deficit Hyperactivity Disorder may not need any exam accommodations but may
need support for organization and planning written work. The functional limitation in this case is
the difficulty with organization and planning.
Validity
“The validity of a test refers to the extent to which a test measures what it is supposed to measure
and, therefore, the appropriateness with which we can make inferences based on the test
results.”7
Criterion-related validity is the type of validity of most concern in psycho-educational reports of
students with disabilities. It is defined as the relationship between test scores and some type of
criteria such as ratings, classifications, or other test scores.
 Concurrent Validity – the relationship between test scores and some currently available
criterion measure (e.g., test scores and current grades)
 Predictive Validity - relationship between test scores and future performance on a
relevant criterion
Predictive validity does not mean predicting a person’s success or failure in a specific degree
program or career. We do not have tests that can predict success or failure in a program or
career. Even tests such as the LSAT, MCAT, etc., designed to be predictive of success, show
only moderate correlations. Predictions are never warranted.
7
Sattler, J. (2001). Assessment of Children: Cognitive Applications. San Diego: Jerome Sattler Publishing, p. 115.
D:\106739541.doc
Disability Guidelines 11
A Valid Assessment
When a psychologist indicates that “this is a valid assessment”, he/she usually is referring to the
student’s attention and willingness to engage in the assessment process, not to whether the tests
used were valid in terms of their relationship to other measures such as performance in school.
D:\106739541.doc
Disability Guidelines 12
APPENDIX 5
For Psychologists
To best support students in a post-secondary environment, please consider the following when
doing assessments:
1. Clearly answer the referral questions.
2. Consider requirements for documentation.
 For Alberta post-secondary institutions, a Learning Disability should be
diagnosed based on current research and the definition of the Learning
Disability Association of Canada. The DSM-IV may be helpful but note that
a two standard deviations discrepancy is a guide, not a criterion that must be
met.
 The DSM-IV is generally used to diagnose ADHD. However, recent research
suggests that girls and women present differently, and this research must be
taken into account before ruling out ADHD based on the criteria of the DSMIV.
 Professional organizations (e.g., Law Society, Public Service) may have
specific requirements for documentation of a Learning Disability for licensing
or entrance examinations. The assessment should meet those requirements
(e.g., Is a reading test given under standard and extended time required to
obtain accommodations for extra time on a licensing examination?).
3. Avoid conclusions that limit opportunities for students and predictions about how
students will do in a program (e.g., the student will not be successful in graduate school).
Recommendations about what a student will need to do to be successful in their chosen
path are more helpful.
4. Avoid general statements such as “Typically, individuals with this FSIQ tend to be
successful at the two year college diploma level”. Rather, indicate what the student will
need to be successful in his/her program. Predictive statements are not helpful.
Psychologists are not fortune tellers.
5. Use assessment tools that are valid for the post-secondary population. For example,
reading passages need to be written at a level parallel to the requirements of postsecondary reading. Types of responses required also need to be similar to what is
encountered at the post-secondary level (e.g., multiple choice). Written language
assessment needs to take into account that students generally use computers rather than
handwriting. In addition, writing requirements in university are generally lengthy.
6. For reliable outcomes and optimal performance, assessment sessions should be short
(two-three hours maximum) and conducted over several days.
7. Results (the numbers) must be interpreted within the context of the student’s history, past
education, current education and performance, and other mitigating factors. Concurrent
validity of results must be established.
8. When a student performs poorly, even on one or two subtests, follow-up to understand
the underlying reasons is important. Asking the student what was difficult, doing further
testing, and interpreting the results in light of other information is critical. Ignoring those
D:\106739541.doc
Disability Guidelines 13
results is not helpful. Similarly, ignoring uncharacteristically strong performance short
changes the student.
9. Base recommendations on the data and the diagnosis.
• The link must be clear to the student and service provider.
• Recommendations must be appropriate for the post-secondary environment (i.e.,
cognizant of timelines of programs, demands of the academic environment).
• If specific strategies or technologies are recommended, focus upon description of
the issue and the desired outcome (e.g., strategies to be learned, content to be
learned, type and/or purpose of technology) rather than on ‘brand’ names.
• If you are unable to determine the specific supports needed, providing in depth
descriptions of the student’s strengths, difficulties, and functional limitations and
recommending a referral for further specific assessment (e.g., strategies, adaptive
technology, medication) is helpful. It may also be helpful to speak with the
Disability Service Provider about possible supports.
• If a diagnosis is not made, an explanation for the student’s current difficulties
must still be provided and recommendations about ways in which the student
might address them must still be made. Recommendations for accommodations
or other disability-related supports should not be made without a diagnosis of a
disability.
10. Adding a qualifying statement in the report such as the one below emphasizes the
collaboration between psychologist and service provider.
The following recommendations should be utilized as part of the collaborative
process between the student and the Disability Office for determining the most
appropriate accommodations and support strategies, given the student’s abilities and
essential program requirements.8
11. The most useful assessment reports are clear, accurate, and of practical value to the
audiences for whom they are intended.
Morel, Pam & Holmes, Alana, “LD documentation and recommended accommodations for post-secondary
students with learning disabilities” Canadian Psychological Association, June 2006 (Northern Ontario Assessment
and Resource Centre, Sudbury, ON).
8
D:\106739541.doc
Disability Guidelines 14
APPENDIX 6
Referrals for Specialized Assessments
(Often through Alberta Human Resources & Employment)
In all cases, the following questions need to be answered.
 “If there is a disability(ies), what are the functional limitations of this disability(ies) and
how do they relate to the supports being recommended?”
 “If no disability is diagnosed, what is the reason/cause for this student’s difficulties and
what can be done to help the student?”
Several key questions also need to be answered, given the requirements of a particular case.
1. When referring a student who has not been previously diagnosed with a disability:
 “Why is this student encountering difficulty in his/her post-secondary program?”
 “Is it due to a Learning Disability or to another disability?”
2. When an updated assessment is being requested:
 “Does this student still require supports for his/her disability?”
3. When a partial assessment is being requested:
 “How does this information help to better understand this student’s difficulties?”
 “Is a diagnosis of Learning Disability or other disability warranted given the
additional information?”
Debriefing following the assessment is a key part of the assessment process. The initial
debriefing session should be between the student and psychologist only (except where the
student requests that others be present). Further collaborative consultation regarding the
assessment results and recommendations with other involved professionals (e.g., DSP, funding
representatives, physician, strategists, etc.) is highly recommended.
D:\106739541.doc
Download