Sample Assessment Review - Illinois State University

advertisement
Sample Assessment Review
2/04 - sk
Title of Assessment (and abbreviation):
Mundy Recreation Inventory for the Trainable Mentally Retarded (Mundy).
Target Population:
Youth ages 8-15 years who have moderate to severe mental retardation with IQs of 30-55
and are ambulatory. (Cannon, et al., n.d.)
[I converted the term trainable mentally retarded to how it is often classified now.]
References Used in Review:
Cannon, F. C., Moffett, W. W., & Moffett, L. O. (n.d.). Diagnostically designed
recreation program for trainable mentally retarded children. Therapeutic Recreation
Journal, 93-103.
Mundy, J. (1966). The Mundy recreation inventory for the trainable mentally retarded.
Tallahassee, FL: Florida State University. Unpublished manuscript.
Stumbo, N. J. (1991). Selected assessment resources: A review of instruments and
references. Annual in Therapeutic Recreation, 2, 8-24.
Stumbo, N. J. (2002). Client assessment in therapeutic recreation services. State College,
PA: Venture Publishing, Inc.
Ordering Information (publisher, address, cost):
Jean Mundy
Leisure Services/Studies
215 Stone Building
Florida State University
Tallahassee, FL 32306
[I got this from Stumbo, 1991. Another place to look for information on some assessments
is the Idyll Arbor website]
Cost is not available.
Specific Agency Assessment Used In:
The Mundy is often part of the Florida State University (FSU) Diagnostic Battery of
Recreative Functioning for the Trainable Mentally Retarded. The Purdue Perceptual
Motor Survey is also part of the FSU battery. The battery was used at the Sunland
Training Center for the Mentally Retarded in Marianna, FL. (Cannon, et al., n.d.)
General Description of the Instrument Content:
A. Leisure Ability Content: Functional Intervention – physical and cognitive as
prerequisites to recreation participation (e.g. physical = walk; cognitive = identify
left foot).
1
B. Category: Stumbo (2002) classified Mundy as “functional abilities.”
Description of Instrument Format and Type of Questions:
Mundy’s format is a structured observation. There are 96 items on the assessment. The
assessment has 6 sections. Following are the sections and sample items:
1. Object identification (9 items) – “Show me the box.” “Show me the block.”
2. Action concepts (9 items) – “Give me the box.” “Push the toy.”
3. Amount, position, direction, place, and space
a. Section A (17 items) – “Point to the top of the box.” “Put the block in
the box.”
b. Section B (5 items) – “Take one bead.” “Take four beads.”
c. Section C (8 items) – “Show me the blue card.” “Show me the black
card.”
d. Section D (8 items) – “Take a step.” “Walk fast to me.”
e. Section E (7 items) – “Walk to the back of the chair.” “Show me your
left hand.”
f. Section F (4 items) – “Step in the circle.” “Walk to the center of the
circle.”
g. Section G (4 items) – “Watch and then do what I do. Walk in to the
center of the circle, turn, and walk out to your starting point.”
4. Rhythm (6 items) – “The examiner should clap a slow 4/4 beat.” “Have the
subject march to a fast 4/4 beat.”
5. Manipulative skills (6 items) – “Have the subject trace the circle, square, and
triangle.” “Have the subject string the large beads.”
6. Motor skills
a. Catching (7 items) – “Throw the ball to the subject waist high.” “Left
quadrant.”
b. Throwing (2 items) – “Have the subject throw the ball overhanded.”
“Underhanded.”
c. Kicking (3 items) – “Roll the ball and say, Kick the ball to me.” “Kick
the ball with your right foot.” (Mundy, 1966)
Clarity of Instructions for Administration:
Mundy is administered by 2 people (1 administers and 1 scores). Time to administer will
depend on how familiar the person conducting the assessment is with the assessment.
Although not specifically stated, it appears that the assessment should be conducted in a
room free of distractions that has a table and chairs. The assessment notes that section 6
should be conducted outdoors or in a gymnasium. Staff qualifications are not specified.
The instructions are very detailed (Mundy, 1966).
Supplies needed for the assessment include: cigar box, jumbo beads, small beads, painted
yard stick, wooden block, wooden match sticks without heads, match boxes, crayons,
scissors, needle, thread, rubber ball, softball, table, chairs, masking tape, pencil, push-pull
toy, square color cards (Mundy, 1966).
2
Clarity of Instructions for Scoring:
Scoring is not described in the assessment text. A score sheet is included and indicates
items 1-77 and 83 are marked as either correct or incorrect. Items 78-80 have 4 samples
of subject’s responses which are coded as 0, 1, 2, or 3. Items 81-82, 84-96 provide 4
responses (e.g., #91. Move left. 3. Completes task. 2. Moves left and grasps but misses. 1.
Grasps but does not move left. 0. No attempt.). There are also places for comments on the
score sheet. Mundy (1966) noted, “Although it is possible to determine a composite
numerical score on the inventory, it is suggested that a summary sheet of the subject’s
strengths and weaknesses be utilized” (p. 3). It is assumed that the score sheet and a
writing utensil are all that is needed to score. Time and staff qualifications are not
indicated.
Clarity of Instructions for Interpretation:
Interpretation is not described in the assessment text. A sample inventory summary sheet
is provided. It appears that salient results are grouped into 3 areas: definite weakness,
functioning but needs improvement, and definite strengths. It is not clear what scores are
needed to be placed in these groups. It is assumed that low scores or scores of 0 will
indicate weaknesses, and high scores will indicate strengths. Goals and objectives are
developed from the items in the 3 areas. There is no mention of the specific programs to
go along with the assessment.
Validity:
A. Face: The items appear to go together. I question if someone has to have rhythm
as a prerequisite skill for recreation involvement. What about social or emotional
skills? It seems to me that these skills often serve as leisure barriers to youth with
developmental disabilities but they are not included in the assessment.
B. Content: Not overtly mentioned, but Cannon, et al. (n.d.) noted the assessment
was presented in detail at a conference sponsored by the American Association of
Health, Physical Education, and Recreation that led to the assessment being used
in their facilities. This might be an indication of review by an expert panel and
pilot testing.
C. Criterion-related
a. Predictive: Not reported.
b. Concurrent: Cannon, et al. (n.d.) reported a high correlation between
judges’ scores of observed recreation performance and the FSU Battery
suggests the FSU Battery was addressing recreative functioning. It also
showed high correlation between the judges and the Mundy.
D. Construct: Cannon, et al. (n.d.) discuss various correlations that might indicate
some work was conducted on construct validity.
Reliability:
A.
Stability: Cannon, et al. (n.d.) reported that the FSU Battery was reliable over
a one to two week period based on test-retest scores.
B.
Equivalency: Not reported and not needed. There are no equivalent forms.
C.
Internal consistency: No mention of split-half, Cronbach’s alpha, etc.
3
D.
Interrater reliability: Not reported. Because assessment is based on
observation, it could be important.
Applicability to Therapeutic Recreation Services (including usability):
The instrument is not readily available. You must contact the author. Since cost is not
available, it is unknown if the assessment is affordable. If one follows and practices with
the detailed directions that are provided with the assessment, it should be easy to
administer. Limited information on scoring and interpretation would make program
placement hard. Time to administer is not reported, however, needing to use two people
to complete the assessment really increases the time demands and staff demands. Since
the protocol is not very detailed in the items discussed above, it would be hard to train
staff and interns (Stumbo, 2002).
How Assessment Works in Practice:
It is difficult to have two people available to conduct the assessment. Directions were
detailed and fairly easy to follow. It was difficult for me to make the required beats. I
wanted to know what I do with the results and had to guess.
Student’s Overall Evaluative Comments:
A. Strengths: The assessment is fairly comprehensive with physical skills, especially
when it is part of the FSU Battery. The Mundy has an accompanying manual, and
instructions for administration are clear. The test has the quality of play so it
might hold the client’s attention. Reliability and validity are reported. Equipment
is clearly delineated and is not expensive. The assessment is designed for youth
who are fairly low functioning.
B. Weaknesses: The assessment only covers physical and cognitive skills, and
cognitive skills are only minimally addressed. Since it does not cover social or
emotional skills, I believe additional assessments would be necessary to design a
comprehensive program that addresses habilitative needs. The assessment is not
published so access to it is limited. The assessment requires 2 staff to administer
which is not always a good use of staff time and may not be possible if there is
only one CTRS in an agency. Without instructions for scoring or interpretation, it
is difficult to determine appropriate program placement. The language of the
instrument is very old and does not comply with person first terminology.
Other Notes:
A. How improve: A complete protocol needs to be designed that uses person first
terminology. I would like to review assessments and developmental scales to see
if items are missing. I would also like to have a panel of experts review the items.
Both of these actions would assist with content reliability. Content validity is
minimally required for any TR assessment, and I am not comfortable with the
content validity that is reported. I would also conduct some interrater reliability if
the assessment continues to use 2 people at each administration, or if I would
recommend only one person complete the assessment and scoring I would
conduct intrarater reliability.
4
B. Where search for additional information: Although I did not feel I needed
additional information to complete this review, I checked Stumbo (1991) to see if
other references were available. There were none reported.
C. What type programs match assessment content: Programs would need to focus
primarily on physical functional intervention, and secondarily on cognitive
functional intervention.
5
Download