A Narrative Review of Dexterity Assessments JHT R C A

advertisement
SCIENTIFIC/CLINICAL ARTICLE
JHT READ
FOR
CREDIT ARTICLE #133.
A Narrative Review of Dexterity Assessments
Katie E. Yancosek, MS, OTR/L, CHT
Department of Rehabilitation Sciences, University of
Kentucky, Lexington, Kentucky
Dana Howell, PhD, OTD, OTR/L
Eastern Kentucky University, Richmond, Kentucky
This article is a comparison of the psychometric
properties (reliability and validity) and other characteristics (cost, administration time, and year of publication) of commercially available adult dexterity
assessments used in research and clinical practice for
adults. Dexterity is defined as ‘‘fine, voluntary movements used to manipulate small objects during a specific task’’1 and is typically an integral part of a
thorough evaluation of the hand. An examination of
dexterity provides a unique way of evaluating the neuromotor function of the entire hand because sensation
and intrinsic hand strength combine to produce the
manipulative skills that facilitate dextrous movements. Dexterity may be further described by two related terms—manual dexterity, which is the ability to
handle objects with the hand and fine motor dexterity,
which refers to in-hand manipulations as separate
skills from the gross motor grasp and release skills associated with manual dexterity.1 The results of assessments for both manual and fine motor dexterity may be
This article was not adapted from a presentation at a meeting and
no grant monies are associated with its execution.
Correspondence and reprint requests to Katie E. Yancosek, MS, OTR/
L, CHT, 923 Forest Lake Drive, Lexington, KY 40515; e-mail:
<Kathleen.yancosek@us.army.mil>.
0894-1130/$ e see front matter. Published by Hanley & Belfus, an
imprint of Elsevier Inc.
doi:10.1016/j.jht.2008.11.004
258
JOURNAL OF HAND THERAPY
ABSTRACT
Narrative Review:
This article is a narrative review of the psychometric properties
(reliability and validity) and other characteristics (cost, time to
administer, and year of publication) of commercially available
manual and finger dexterity assessments used for adults in
the United States. Complete research articles related to dexterity
assessments were gathered from online database searches and
individually critiqued for scientific rigor based on reliability
and validity. Articles relating to 14 dexterity assessments were reviewed. All but three tools had established reliability, seven tools
had all five forms of validity established, and two had only face
and content validity. The results of this review provide information
to those interested in fine motor skill acquisition, impairment, or
functional recovery after injury. Therapists may use this information to choose the best assessment instrument to evaluate a patient’s recovery of function over time. This review adds to the
evidence-based, best-practice literature related to assessment and
outcome measurements of patients with limited dexterity function
participating in rehabilitation.
J HAND THER. 2009;22:258–70.
used to quantify and predict both ability and disability
by gauging a person’s speed and quality of movement
as the hand interfaces with objects and tools related to
self-care, work, or leisure pursuits.2 A study conducted
by Williams et al.3 demonstrated that dexterity was the
best predictor of independence in activities of daily living (ADL) within a cohort of geriatric females.
Outcome measures related to dexterity are important to detect clinically significant changes in an
injured patient population, to provide vocational
placement recommendations, to assess patients after
a work-related injury as part of a functional capacity
evaluation (FCE), to provide evidence of (dys)function in workman’s compensation cases, and to evaluate and compare dexterity levels among various
injured and uninjured populations.4 Assessing dexterity is critical because dexterity is a central component of hand function. Currently, over 20 different
dexterity assessments are available. According to
Rudman and Hannah,5 selection of an appropriate
assessment is often based on a variety of factors,
including financial and time costs; availability, familiarity, or practicality; and applicability to a given
patient or research population. Importantly, they
note that attention should also be directed toward
the psychometric soundness of the assessment
instrument, which is the focus of this article.
BACKGROUND
Reliability and validity make up an assessment’s
psychometric properties. Validity refers to an assessment’s ability to accurately measure the construct it
seeks to measure. Reliability refers to an assessment’s
ability to reproduce similar results with sequential
administrations.6 There are three types of reliability.
They are commonly referred to, and therefore most
often recognized and understood, by the methods
used to examine them. The first type of reliability is
called stability. The familiar method is to collect
testeretest data on an instrument given by one examiner at two different times. It is reported by a stability
coefficient such as Pearson’s r. Stability is commonly
known as intrarater reliability. The second type of
reliability is called internal consistency. The two familiar methods to examine internal consistency are a
split-half technique and a Cronbach’s alpha.6 In these
methods, the researcher is asking if items on an instrument ‘‘consistently’’ measure the same concept. In the
split-half technique, the outcomes of the instrument
are divided and compared for consistent results. In
the Cronbach’s alpha method, each item is separately
compared with others, looking for the degree of correlation between items. The third type of reliability is
equivalence. The familiar method is to compare score
results obtained by two examiners administering the
same test. Equivalence is commonly known as ‘‘interrater’’ reliability. It should be noted that stability
(intrarater reliability) of an assessment must be established before equivalence (interrater reliability) because stability means the instrument is dependable
in measuring a construct over time. Similarly, reliability of an instrument must precede validity.6
Validity is related to how true an assessment is in
capturing the construct it seeks to measure.5,6 There
are five types of validity. The first type of validity,
which is the simplest type, is face validity. It describes
how the instrument appears to measure the construct. The second type of validity is content
validity—it explores if an instrument captures all
the meaningful elements of a construct. Face validity
can be ascertained by an amateur, whereas content
validity should be established by a subject matter expert. The third type of validity is construct validity.
This is how logical an instrument is in measuring a
concept. Construct validity can be established
through divergent and convergent methods of evaluating how well an instrument measures a theory or
construct; however, it can never be truly proved but
rather disproved. The fourth type of validity is discriminate validity. This is a type of validity that seeks
to explore how well an instrument can discriminate
between groups of people. The final type of validity
is criterion validity. It seeks to establish a relationship
between the assessment and another factor (criterion). There are two methods of establishing criterion
validity. As with reliability types, the data collection
and comparison methods often serve as names for
criterion validity. The methods (names) are concurrent and predictive validity. In concurrent validity,
data are collected at the same time (concurrently)
and assessment scores are compared to examine correlation. In predictive validity, data are collected first
on the test instrument and then later on another
assessment and compared for correlation.
The purpose of this review is to compare dexterity
assessments based on published research related to
the tests’ reliability, validity, and other factors, including cost, availability, time to administer, and bilateral
hand use.
METHODS
A critical review was conducted by one reviewer
using the method proposed by Wright et al.7 The research question was ‘‘What are the psychometric properties of commercially available, adult dexterity
assessments in the United States?’’ Before searching
the evidence, a research protocol was created that specified inclusion and exclusion criteria. Only Englishlanguage studies, Level 2b or higher on the hierarchy
of evidence, that examined the psychometric properties of adult, commercially available dexterity assessments were included. Level 2b evidence was selected
because it is the level of investigation associated with
exploratory cohort studies that provide meaningful results, which are more generalizable compared with
case studies.8 Exclusion criteria were set as pediatric
and geriatric studies, non-English studies, client selfassessment questionnaires related to hand use, and
dexterity assessments that are unavailable for purchase
or replication within the United States. Additionally,
dexterity assessments were excluded if the review
failed to find any literature on the instrument.
The literature was searched with a date range from
1920 to 2007. The databases that were individually
searched through EBSCOHost portal included the
following: Medline, PubMed, CINAHL, PsychINFO,
and Pre-CINAHL. Google Scholar was also searched.
Terms used in each database search included the
following: dexterity OR coordination AND adult
AND assessment OR instrument OR evaluation,
AND psychometric properties AND therapy assessment. The databases were also searched using specific names of the dexterity assessments found in a
textbook on physical dysfunction rehabilitation.9
Lastly, the reference citations of the studies obtained
were examined to find additional studies to include
in the review.
Data were extracted and placed into a matrix to
provide a detailed description of the sample (size,
JulyeSeptember 2009 259
sex, and population), study purpose, analysis, and
statistical results. These data provide a comprehensive overview based on available literature related to
each dexterity assessment.
RESULTS
Fourteen dexterity assessments were identified
that met the inclusion criteria. Table 1 provides a
summary of the number of published research studies found per dexterity assessment and the subsequent types of reliability and validity established.
Table 2 includes information about each assessment
such as the original publication date of the instrument, vendor, and cost, whether or not the test assesses bilateral hand use, tool use, manual versus
finger dexterity (or both), and the time taken to
administer the test.
TABLE 1. Summary of Subgroup Analysis Based on Each
Dexterity Assessment
Numbers of
Studies
with Level
2b or .
Evidence
Established
Reliabilitya
Established
Validityb
BBT
5
RET, INTER
Crawford
Small Parts
FDT
1
CR, CON,
DIS, F, CNT
F, CNT
1
RET, INTER
Grooved
Pegboard
JHFT
2
RET
2
RET
MMDT
MRMT
2
6
RET
IC, RET
Moberg PickUp Test
NHP
O’Connor
FDT
PP
4
INTER
3
1
RET, INTER
6
RET
SODA
3
IC, RET
WMFT
4
INTER, IC
Dexterity
Assessment
CR, CON,
DIS, F, CNT
F, CNT
CR, CON,
DIS, F, CNT
CR, CON, F
CR, CON,
DIS, F, CNT
CR, CON,
DIS, F, CNT
CR, F, CNT
DIS, F, CNT
CR, CON,
DIS, F, CNT
CR, CON, F,
CNT
CR, CON,
DIS, F, CNT
BBT ¼ Box and Block test; FDT ¼ Functional Dexterity Test;
JHFT ¼ JebseneTaylor Test of Hand Function; MMDT ¼ Minnesota Manual Dexterity Test; MRMT ¼ Minnesota Rate of Manipulation Test; NHP ¼ Nine-Hole Peg Test; FDT ¼ Finger Dexterity
Test; PP ¼ Purdue Pegboard; SODA ¼ Sequential Occupational
Therapy Dexterity Assessment; WMFT ¼ Wolf Motor Function
Test.
a
RET ¼ retest; INTER ¼ interrater; IC ¼ internal consistency.
b
CR ¼ criterion; CON ¼ construct, DIS ¼ discriminate, F ¼ face,
CNT ¼content.
260
JOURNAL OF HAND THERAPY
A total of 67 research studies related to the 14 assessments were found, 40 of which met the inclusion
criteria. Research related to the reliability and validity of each assessment, and a history of the research
done to date, is presented in Table 3. Because of the
vast amount of data uncovered in this review, the following narrative is an overview of each assessment
instrument and the details of the statistical findings
from each study are placed in Table 3.
NARRATIVE DISCUSSION OF
TEST-SPECIFIC RESULTS
Box and Block Test
The Box and Block test (BBT) is a measure of manual
dexterity that requires repeatedly moving 1-inch blocks
from one side of a box to another in 60 seconds.
Mathiowetz et al.10 first provided normative data on a
large sample size from a seven-county sample in the
Milwaukee area. Additionally, four other Level 2b
studies on this assessment were examined.10e13 Three
studies were completed on patient populations that
established validity of use with various diagnoses. The
BBT shows very high interrater and testeretest
reliability
(intraclass
correlation
coefficient
[ICC] ¼ 0.99). All studies were well designed, free
of bias, and demonstrate reliability and validity of the
BBT.
Crawford Small Parts Dexterity Test
The Crawford Small Parts Dexterity Test is a timed
test of both manual and finger dexterity that requires
use of tweezers and a screwdriver for a series of tasks
on an assembly plate. Although this test has face
validity, and presumably content validity, the literature is void of studies establishing solid psychometric
properties on this instrument. Only one Level 2b
study was found; the purpose of that study by
Burger14 was to question the original reference values
because changes had been made in the testing materials and yet the normative data were not reassessed.
This study used a small convenience sample of
healthy volunteers to evaluate differences between
scores on the two test versions. There was not a statistically significant difference between Part I of the test,
but there was a large difference (t ¼ 5.5, p , 0.001) in
Part II. This assessment is therefore in need of reevaluation for psychometric soundness.
Functional Dexterity Test
The Functional Dexterity Test (FDT) is a timed
measure of manual dexterity that involves turning
sixteen wooden pegs over and reinserting them into
the pegboard. It was constructed over a 20-year period
TABLE 2. Properties of Dexterity Assessments
Dexterity
Assessment
BBT
Crawford small
parts
FDT
JHFTa
MMDT
MRMT
Moberg Pick-Up
Test
NHP
O’Connor Tweezer
FDTa
PP
SODAa
WMFT
Year Published
Available From
1985
1949
Sammons Preston
Harcourt
assessment
2003
North coast medical
1969
Sammons Preston
1991
Lafayette
Instrument Co.,
1946, updated
Best priced
in 1957, 1969
products, Inc.,
1958
Not Available for
purchase but
reproducible
1971
Sammons Preston
1958
Lafayette
Instrument Co.,
1948
Lafayette
Instrument Co.,
1996, short version Not available but
in 1999
reproducible
2001
Not available for
purchase but
reproducible
Assesses
Bilateral Hand
Use
Cost
Time to
Manual, Fine
Administer (min) Dexterity, or Both
N
Y
$189.95 5
$567.00 30
M
B
N
N
Y
$127.95 5
$289.95 30
$200.00 30
M
B
M
Y
$247.49 30
M
N
N/A
5
B
N
N
$72.95 5
$105.00 5
F
B
N
$110.00 8e10
F
Y
N/A
Y
N/A
SODA ¼ 30 and
SODA-S ¼ 15
30e45
B
M
BBT ¼ Box and Block test; FDT ¼ Functional Dexterity Test; JHFT ¼ JebseneTaylor; MMDT ¼ Minnesota Manual Dexterity Test;
MRMT ¼ Minnesota Rate of Manipulation Test; NHP ¼ Nine-Hole Peg Test; FDT ¼ Finger Dexterity Test; PP ¼ Purdue Pegboard;
SODA ¼ Sequential Occupational Therapy Dexterity; WMFT ¼ Wolf Motor Function Test; M ¼ Manual dexterity, F ¼ Finger Dexterity,
B ¼ Both.
a
Test incorporates evaluation of tool use. Eating utensils and writing instruments are considered tools.
by many therapists at Texas Woman’s University and
several unpublished articles have been written on its
development and utility. The first and only published
study available for review was the original article.15
This article shared the summative data collected on
the assessment and provided reference values based
on age and hand dominance. Intrarater reliability
was shown to be excellent (ICC ¼ 0.91) and construct
validity was established. Further validation of the test
is recommended by the study’s authors.
Grooved Pegboard
The Grooved Pegboard is a unique dexterity assessment in that each peg has a ridge on one side and
therefore must be oriented correctly to fit into a hole
on the pegboard. This lock-and-key feature of the peg
and pegboard necessitates visual attention to task
and thumb and index finger manipulation of the peg.
This feature makes it a test of interest to many
investigators and clinicians.16 Because the Grooved
Pegboard is one part of neuropsychological batteries,
only two Level 2b studies16,17 were found that solely
examined the assessment’s psychometric properties.
Bryden and Roy16 investigated the influence of gender and hand dominance on manual dexterity, and
also provided normative data for the performance
of 153 healthy adult subjects. The study also provides
an alternate use for the test by providing normative
data on the amount of time it takes to remove the
grooved pegs from the holes. The authors suggest
that this method of test administration could be
used as a motor speed assessment, although no
attempt was made to validate it with another established assessment of motor speed. A study by Ruff
and Parker17 used the Grooved Pegboard with 360
healthy adults to establish gender- and age-specific
reference values, as well as to provide evidence of
retest reliability at a statistically significant level of
p , 0.01. Both studies on the Grooved Pegboard are
robust studies with adequate sample sizes, sound
methodologies, and similar findings related to
gender and hand dominance on dexterity.
JebseneTaylor Test of Hand Function
The JebseneTaylor Test of Hand Function (JHFT)
assesses both fine and manual finger dexterity through
seven timed subtests related to functional tasks, such as
picking up common objects, eating, and writing. This
instrument was developed in 1969 by Jebsen et al.18
Two Level 2b studies18,19 were reviewed on the JHFT,
including the original normative data that were collected on 300 healthy and 60 impaired individuals
across the age span. This original study established reliability, validity, and reference values based on age.
The second Level 2b study19 established criterion validity (r ¼ 0.635, p , 0.01) with 18 traumatic spinal
cord injured patients by correlating the scores on the
JHFT to scores on the KleineBell ADL scale.
JulyeSeptember 2009 261
262
JOURNAL OF HAND THERAPY
1988
1985
Goodkin et al.26
Mathiowetz et al.10
1993
1989
1969
Ruff and Parker17
Lynch and Bridle19
Jebsen et al.18a
JHFT
N ¼ 153; 106F, 47M
2005
Bryden and Roy16
Grooved pegboard
N ¼ 300 (30F and 30M in age
categories 20e29, 30e39,
40e49, 50e59, and 60e94)
N ¼ 18
N ¼ 360
N ¼ 339. Study based on 5
different combined studies
Aaron and Stegnik Jensen15 2003
N ¼ 24
N ¼ 628; 318F, 310M
(age range 20e94)
FDTa
1985
1994
Desrosiers et al.13
N ¼ 35 healthy adults, N ¼ 34
impaired adults, N ¼ 104
impaired adults (for the
construct validity test), and
N ¼ 360 (for the norming)
N ¼ 228
N ¼ 56
2005
Platz et al.12
Year
N ¼ 20; 11F, 9M
Authors
Number and
Sex of
Subjects
Svensson and Hager-Ross11 2006
Crawford small parts Burger14
BBT
Dexterity
Assessment
300 Healthy adults
and 60 patients
Traumatic SCI patients
Healthy adults from 3
geographical locations
Students, workers, uninjured
and injured hands of hand
therapy patients
Healthy college students
Healthy adults
Volunteers from 7 different
counties in Milwaukee area
Patients with MS
Patients older than 60 yr with
and without UE impairment
Adults with CharcoteMariee
Tooth disease
Neurologically
impaired adults
Population
Purpose
Compare JebseneTaylor to
KleineBell ADL Scale for
construct validity
Establish reference values for 7
subtests according to age and
gender; establish
discriminate validity with
patient population
Establish reliability of a new
administration method
Evaluated changes with hand
dominance, gender,
education, and age
Establish validity, reliability
reference values
Establish reliability between
two versions of the
assessment instrument
Compared BBT and NHP
with typical MS disability
ratings
Interrater reliability
Establish reliability with
patient population
Interrater reliability
testeretest reliability,
construct validity between
Fugl-Meyer test, ARA,
and BBT
Establish reference values,
construct validity, and
reliability
TABLE 3. Summary of Literature on Available Dexterity Assessment
Pearson coefficient for retest
reliability r ¼ 0.60e0.99,
Good discriminate validity
using SDs: patients were
greater than 2 SD away from
normative reference values
Interrater reliability Pearson
r ¼ 1.00 for right hand and
r ¼ 0.999 for left hands
Paired t tests showed no
difference on Part I of the test
t ¼ 0.5 but differences were
found on part II t ¼ 5.5,
p , 0.001
Interrater reliability
ICC ¼ 0.82e0.93, intrarater
reliability ICC ¼ 0.91
F values were significant at
p , 0.001 level
Age, education, and gender
differences were noted,
p , 0.01. Reliability: Pearson
r coefficient dominant hand
r ¼ 0.72 and nondominant
hand r ¼ 0.74
Pearson r ¼ 0.635, p , 0.01
Correlation between BBT and
NHP, r ¼ 0.70
ICC ¼ 0.89 and 0.97, validity
matched with ARA using
Pearson r ¼ 0.80 and 0.82
Retest ICC for right
hand ¼ 0.95, left hand ¼ 0.96
ICCs and Spearman rho
all . 0.95
Statistical Results
JulyeSeptember 2009 263
Moberg Pick-Up
Test
MRMT
MMDT
2003
1997
1984
1982
1978
1959
2007
Surrey et al.20
Maiden and Dyson21
Clopton et al.22
Gloss and Wardle23
Shanthamani24
Drussell25
Amirjani et al.29
Ng et al.31
2003
1997
Desrosiers et al.27
Jerosch-Herold30
2003
Surrey et al.20
N ¼ 100; 47F, 53M
N ¼ 23; 4F, 19M
N ¼ 116; 87 F, 29M
N ¼ 32; 9F, 22M
N ¼ 60; 22F, 38M
N ¼ 118; 22F, 96M
N ¼ 90; 36F, 54M
N ¼ 25
N ¼ 223
N ¼ 247
N ¼ 223
(Continued on next page)
t-Tests were statistically
significant at the p , 0.001 for
placing and turning subtests
and for overall scores
Healthy elderly
Establish criterion validity by
ICC ¼ 0.79e0.87 for retest
comparing MMDT with
reliability; ICC between
MRMT (N ¼ 45), BBT, and PP
MMDT and MRMT ¼ 0.85e
testeretest reliability
0.95; ICC with BBT ¼ 0.63
(N ¼ 35); establish retest
and ICC with PP ¼ 0.67
reliability
College students and airline
Examine the difference in
t-Tests were statistically
passengers
performance on the MRMT
significant at the p , 0.001 for
and the MMDT
placing and turning subtests
and for overall scores
15 Healthy subjects, 10 injured Establish reliability of
Pearson r ¼ 0.95
clients
assessment instrument
between standing and sitting
conditions
College students
Establish reliability of
Scores between standing and
assessment administration
sitting did not differ at the
between standing and sitting
p ¼ , 0.05 level
conditions
Adults with permanent hand
Establish predictive validity by Pearson r ¼ 0.266e0.814
impairment
correlating scores
between MRMT and
disability rating
Government factory workers
Establish predictive validity by Pearson r ¼ 0.50
correlating performance
scores with gender,
education, and field
experience
Adults with cerebral palsy who Establish criterion validity of
Pearson’s r ¼ 0.68
worked in manual labor jobs
the MRMT (placing subtest
in Los Angeles
only) with the USES
Healthy subjects in 3 groups:
Establish reference values
Age had a significant impact
ages 20e39 (N ¼ 34) 40e59
based on age, gender, and
on performance (p , 0.01);
(N ¼ 35), 60 and older
hand dominance
vision had a significant
(N ¼ 47)
impact on performance
(p , 0.05); and females were
faster compared with men
(p , 0.05)
Median nerve lac/repair
Establish validity by measuring Cohen’s d effect size ¼ 0.80
the assessment instrument’s
responsiveness to clinical
change
Healthy adult volunteers from Establish reference values
Paired t-tests between visual
a variety of occupations
based on gender and hand
status, hand dominance, and
dominance; interrater
genders: all results were
reliability tested on 14 of 100
significant with p , 0.01.
subjects
Pearson’s coefficient for
interrater reliability, r ¼ 0.60
Examine the difference in
performance on the MRMT
and the MMDT
Moberg
Authors
1981
2003
2003
1997
1980
1979
1948
Gloss and Wardle37
Gallus and Mathiowetz2
Buddenberg et al.38
Maiden and Dyson21
Hamm and Curtis39
Shanthamani24
Tiffin et al.
O’Connor FDT
PP
N ¼ 7814; 4530F, 3284M
N ¼ 60; 22F, 38M
N ¼ 340; 164F, 176M
N ¼ 25
N ¼ 47; 33F, 14M
N ¼ 25; 22F, 3M
N ¼ 96; 18F, 78M
N ¼ 644
Design a measure as a
functional sensory test
Establish reliability of test with
patients
Establish interrater reliability,
retest reliability, and
normative reference values
Purpose
Statistical Results
Retest ICC for right
hand ¼ 0.99, left hand ¼ 0.80
Pearson r: Right: r ¼ 0.984, left:
r ¼ 0.993. Testeretest
reliability Pearson r
coefficient: right r ¼ 0.459,
left r ¼ 0.442
26 female OT students, and 618 Establish reference values,
Concurrent validity: right:
volunteers
concurrent validity with the
Pearson r ¼ 0.61 left:
PP, and reliability (retest and
Pearson r ¼ 0.53; retest
interrater)
reliability: right r ¼ 0.69, left
r ¼ 0.43; interrater reliability:
right r ¼ 0.97, left r ¼ 0.99
Adults with permanent UE
Establish predictive validity by Pearson r ¼ 0.69 for disability
impairment
correlating on O’Connor FDT
and 0.88 for ADL subscale
and disability rating and
ADL subscale
Patients with MS
Examine retest reliability for
ICC for 1 trial ¼ 0.850.90, ICC
1 and 3 trial administration
for 3 trial ¼ 0.920.96
methods
College Students
Examine retest reliability for
ICC for 1 trial ¼ 0.370.70, ICC
1 and 3 trial administration
for 3 trial ¼ 0.81.89
methods
Healthy adults and 10 injured
Positive correlation
Pearson r ¼ 0.95
clients
Candidates for vocational
Establish reference values for a All Z tests were statistically
rehabilitation
clinical population;
significant p , 0.05. Authors
performed correlation
recommend using clinical
analysis using Z tests (on
reference values
means) between 1968 norms
and clinical sample
Government factory workers
Establish validity correlation of Pearson r ¼ 0.80
performance with gender
and education
College students, veterans, and Establish reference values,
Pearson r ¼ 0.60e0.76 for 1-trial
industrial job applicants
retest reliability and validity
scores, and r ¼ 0.82e0.91 for
3-trial scores (estimates
extrapolated by Spearmane
Brown prophecy formula)
1985
NHP
Mathiowetz et al.10a
N ¼ 20; 11F, 9M
Population
2003
1958
Year
Grice et al.34
28a
Number and
Sex of
Subjects
Swedish adults with Charcote
MarieeTooth disease
N ¼ 25 (for reliability tests) and College students and
N ¼ 703; 389F, 314M for
community volunteers
norming (ages 21e71 yr)
Dexterity
Assessment
JOURNAL OF HAND THERAPY
Svensson and Hager-Ross11 2006
Table 3 (continued)
264
JulyeSeptember 2009 265
N ¼ 229
N ¼ 45; 29F, 16M
1996
2001
2001
2005
2006
Van Lankeveld et al.41
Morris et al.45
Wolf et al.46
Wolf et al.47
Hui Yung Ang
and Wai Kwong48
N ¼ 38
N ¼ 24
N ¼ 109
N ¼ 25; 14F, 11M
1999
O’Connor et al.42
N ¼ 109; 62F, 42M
1999
Van Lankeveld et al.43
Establish interrater and retest
reliability, establish reliability
(internal consistency)
Establish validity and
reliability (interrater and
retest)
Establish validity and retest
and interrater reliability
(reliability done on N ¼ 22)
19 adults after stroke, 19 health Establish interrater and retest
controls
reliability, establish criterion
validity with FMA and
construct validity with
control case
Adults after sroke (3e9 months Establish criterion and
poststroke)
construct validity with FMA
Adults after stroke
Establish construct validity
between FMA, FIM,
Brunnstrom’s recovery
stages, and scale
Adults after stroke with motor
impairment
Adults with RA being seen at
outpatient rehabilitation
center in Australia
Adults with RA
Establish reliablity (internal
consistency)
Spearman’s rho correlation
coefficients all .0.896. No
correlation found with FIM
(numbers not given)
ICC ¼ 0.97e0.99
Pearson’s r ¼ 0.71 for
correlation with ROM and
grip, Pearson’s r ¼ 0.65 with
Dutch health status
questionnaire, Pearson’s
r ¼ 0.41 with VAS for pain,
Pearson’s r ¼ 0.34 for disease
status using disease
assessment score. Retest
reliability r ¼ 0.93 interrater
reliability r ¼ 0.78
Interrater reliability, ICC ¼ 0.97
and 0.88; retest reliability
ICC ¼ 0.90 and 0.95 for
performance time and
functional ability score,
respectively. Internal
consistency was .0.86 for both
test administrations
ICC ¼ 0.95e0.99
Cronbach’s alpha; SODA ¼ 0.91,
SODA-S ¼ 0.81 HAQ VAS
pain correlation between
Sollerman hand function and
SODA r ¼ 0.79 and r ¼ 0.75 for
SODA & VAS and r ¼ 0.052
for SODA and self-reported
disability
Retest Pearson r ¼ 0.93,
intrarater Pearson r ¼ 0.78
BBT ¼ Box and Block test; ICC ¼ intraclass correlation coefficient; UE ¼ upper extremity; MS ¼ multiple sclerosis; NHP ¼ Nine-Hole Peg Test; FDT ¼ Functional Dexterity Test; JHFT ¼ Jebsene
Taylor Test of Hand Function; SCI ¼ spinal cord injured; ADL ¼ activities of daily living; SD ¼ standard deviation; MMDT ¼ Minnesota Manual Dexterity Test; MRMT ¼ Minnesota Rate of
Manipulation Test; USES ¼ United States Employment Services Descriptive Rating Scale; PP ¼ Purdue Pegboard; FMA ¼ Fugl-Meyer Motor Assessment; SODA ¼ Sequential Occupational
Therapy Dexterity Assessment; RA ¼ rheumatoid arthritis; ROM ¼ range of motion; ARA = Action Research Arm Test; FIM ¼ Functional Independence Measure; SODA-S ¼ SODA-Short
form; HAQ ¼ Health Assessment Questionnaire; VAS ¼ Visual Analogue Scale.
ICC, Pearson r, Spearman’s Rho, and Cohen’s d all estimate correlation and effect of variables in relationship to one another.
Interpreting correlation coefficients: .0.8 ¼ large correlation, .0.5 ¼ moderate correlation, and .0.2 ¼ small correlation.
aOriginal article on assessment instrument.
WMFT
SODA
Minnesota Rate of Manipulation Test
The Minnesota Rate of Manipulation Test (MRMT)
and the Minnesota Manual Dexterity Test (MMDT)
are two versions of a similar assessment tool. The
MRMT is no longer produced but can be purchased
through Internet sources. Both versions consist of five
timed subtests that assess manual dexterity needed
to turn and/or place 60 short, round blocks with one
or both hands. A distinction between the two versions is that MRMT contains two boards, whereas
MMDT uses a single board. Six Level 2b studies20e25
were reviewed on the MRMT and two on the
MMDT.26,27 Both assessments have undergone
research to establish reliability and all five types of
validity. However, Surrey et al.20 raise legitimate concern for the use of the MMDT based on their results
that revealed significant differences in scores
between the placing and turning subtests between
the two test versions (p , 0.001). Furthermore, they
point out that the MMDT uses the normative values
and instructions established for the 1957 version of
the MRMT. Given their findings, research to establish
new norms and evaluate psychometric properties
should be done related to the currently available
version of the MMDT.
Moberg Pick-Up Test
The Moberg Pick-Up Test is a timed measure of both
manual and fine motor dexterity that involves picking
up 12 small items. It was first described by Moberg in
1958.28 It was originally designed as a functional sensory test of the hand, but adequately captures the related components of object manipulation and offers
a valuable score of vision-occluded dexterity. In addition to the original, descriptive article, three Level 2b
studies were reviewed.28e30 In 1999, Ng et al.31 examined 100 healthy adults with the Moberg Pick-Up Test.
They established reference values; however, 53% of
their subjects ranged from ages 20 to 29 years. They
demonstrated a statistically significant influence
(p , 0.01) of gender and hand dominance on dexterity. Fourteen of the 100 subjects were randomly retested by an additional examiner. The interrater
correlations were statistically significant at the
p , 0.01 level. Based on the limitations of the Ng
et al. study, Amirjani et al.29 conducted a study in
Canada with a minimum of 34 healthy subjects in
one of three age categories—young (20e39 yr),
middle aged (40e59 yr), and old (60þ yr). This study
provided reference values based on age, gender, hand
dominance, and eyes open and closed testing conditions. The final study30 reviewed on the Moberg was
of 23 patients who had undergone median nerve laceration and repair. The study established
discriminate validity of the Moberg by demonstrating
its ability to be responsive to clinical change. The
266
JOURNAL OF HAND THERAPY
Moberg test is not available for purchase, but can be
reproduced using the provided specifications.
Nine-Hole Peg Test
The Nine-Hole Peg (NHP) Test is a timed measure
of fine dexterity and involves placing and removing
nine pegs in a pegboard. Three studies were reviewed on the NHP. The NHP was first described by
Kellor et al.32 in 1971. The study provided normative
references based on a sample of 250 subjects. There
was a description of the test pegboard and the pegs
but no description of the container. No reliability or
validity was reported until Mathiowetz et al.33 conducted new research in Wisconsin with a large
sample of volunteers. This study examined validity
of the test through a comparison with the Purdue
Pegboard (PP) test. The results showed a moderate
correlation between the two assessments. In 2003,
Grice et al.34 used a sample of college students and
community volunteers to establish new reference
values and evaluate reliability. Both reviewed studies
used large samples and provided reference values
based on gender and age. A Swedish study examined
the use of the NHP within a small sample of patients
with CharcoteMarieeTooth Syndrome, the retest
reliability was found to be high (ICC ¼ 0.99).11
O’Connor Finger Dexterity Test
The O’Connor Finger Dexterity Test (FDT) is a
timed test of both manual and fine dexterity that
dates back to 1926. It involves manipulating and
placing small pins, three at a time, into 100 small
holes of a pegboard. The original test construction
and validation were published in the testing manual,
but results were not published in a scholarly journal.
The test is also available in a modified version that
includes the use of tweezers to place a single pin in a
hole of the pegboard. Both tests are used today for
screening job applicants for various jobs that require
fine finger and tweezer dexterity skills35,36 but only
one Level 2b study was found that examined psychometric properties.37 This study correlated the scores
on the O’Connor FDT with disability ratings and
ADL subscale scores on the disability rating. The
sample was 96 adults with permanent impairment
to the upper extremity. The Pearson correlation ratings were 0.69 and 0.88 for the disability rating and
the ADL subscale, respectively. These results represent moderate to high correlation and therefore demonstrate good-to-excellent predictive validity. No
Level 2b studies were found on the tweezer version
of the O’Connor dexterity assessment. Based on limited data to support either assessment instrument,
caution should be taken when considering these
instruments.
Purdue Pegboard
DISCUSSION
The Purdue Pegboard (PP) is a test of fine dexterity
that has been widely used in both clinical and research
settings.2 This assessment involves a series of four
subtests that consist of placing small pins into holes
on a pegboard and assembling pins and washers.
Including the original article on this assessment, six
Level 2b studies were reviewed.2,15,20,38e40 Validity
and reliability are well established through abundant
research in healthy and patient populations. The original reference values from 1948 were obtained on the
large sample (N ¼ 7,814) of college students, veterans,
and industrial applicants and were revised in 1968 for
specific personnel selection tasks, such as electronics
production, general factory work, and assembly
jobs. Reference values have also been established for
clinical populations in subsequent studies. The studies that examined retest reliability found better results
with the three-trial administration.
This critical review of dexterity assessments and
research related to the psychometric soundness of
these instruments yielded information essential to
those interested in patients with dexterity limitations.
Three of the reviewed assessments (the MRMT, PP,
and BBT) demonstrated solid psychometric properties through evidence from more than five Level 2b
studies. Six studies collectively established reliability
as well as criterion, construct, discriminate, and content validity of the MRMT and PP, whereas five Level
2b studies established reliability and all types of
validity of the BBT. Based on these results, the BBT
and MRMT are recommended as assessments of
choice to evaluate manual dexterity, and the PP is
recommended to assess fine finger dexterity. Because
the BBT evaluates unilateral dexterity, the MRMT
evaluates bilateral manual dexterity, and the PP evaluates fine finger dexterity, clinicians and researchers
need to further consider the specific needs of a patient
population or a given research investigation before
selecting an assessment tool.
Sequential Occupational Therapy Dexterity
Assessment
The Sequential Occupational Therapy Dexterity
Assessment (SODA) is a test specifically designed
for patients with rheumatoid arthritis (RA) that involves ten bilateral and two unilateral tasks. This is a
unique dexterity assessment because it does not use
time as a measure of performance but rather evaluates
the quality of movement. It measures both manual
and fine dexterity. It was introduced in 1996 in the
Netherlands.41 Three Level 2b studies were reviewed.
The SODA was used in an RA patient population in
Australia to assess validity and reliability.42 In 1999,
a shortened version was created using the original
study population to correlate findings and establish
validity.43 This study demonstrated a correlation coefficient of 0.93 (high) between the SODA and the
revised, shortened version, SODA-S. All studies demonstrated criterion validity by showing high correlation with other established and acceptable measures
of disease and pain.
Wolf Motor Function Test
The Wolf Motor Function Test (WMFT), formerly
called the Emory Motor Test44 is a functional dexterity test that has been shown to be reliable and valid
within acute and subacute stroke patient populations. It is a measure of manual dexterity that requires
completion of six upper extremity movements and
nine functional tasks; both segments are timed.
There were four Level 2b studies reviewed45e48 that
collectively demonstrate reliability and validity of
use within a stroke population. When criterion and
construct validity were evaluated, the ICC values
ranged between 0.97 and 0.99 (high).47
Three of the reviewed assessments, the O’Connor
FDT, Grooved Pegboard, and Crawford Small Parts,
should be used cautiously. These three assessments
had few published studies examining their reliability
or validity, which limited examination to the original
research data and suggests a need for additional
research to evaluate these instruments.
Several assessments in this review have unique
characteristics that may also influence a clinician’s
decision to select an assessment. The Moberg serves
as the only assessment that incorporates a visually
blinded testing condition. The Grooved Pegboard is
unique for its additional obstacle of having a ridge on
the side of each peg and thereby demanding high levels
of visual attention. The WMFT is used specifically for
evaluating stroke patients, and the SODA is used
specifically for patients with RA. The SODA is also
the only test that does not measure dexterity performance based on time. Another separation among the
assessments is those that require the use of tweezers.
These assessments are the O’Connor Tweezer
Dexterity Assessment and the Crawford Small Parts.
These two assessments, however, have no established
reliability data, and should undergo evaluation before
continued use by clinicians or researchers.
LIMITATIONS
Both authors established criteria for data extraction
at the start of the review; however, only one reviewer
searched the literature and extracted data. Another
notable limitation is that this review focused only on
adult dexterity assessments, to the exclusion of pediatric and geriatric assessment tools. Further
JulyeSeptember 2009 267
investigation into assessments specific to these populations is warranted. Finally, perhaps the pervasive
reliance on technology, such as computers, cellular
telephones, pagers, I-pods, and MP3 players has
affected baseline dexterity values in all populations.
Dexterity abilities may have improved radically due
to the increased use, or declined based on the automation of work processes that were previously reliant
on manual skills. Either way, research is needed to
update the reference values of all 14 assessments from
those values established in the 1900s. Additionally,
research exploring how dexterity assessments are
used across clinical practice is necessary. The sampling methods of studies related to dexterity hand
function assessments need not be limited to convenience samples, as they were in most of the studies
presented in this review, given the increasing professional network connections and the use of Internet
and other technologies.
CONCLUSIONS
This review summarized decades of research done
on commercially available dexterity assessments. The
focus was on the psychometric properties and other
defining characteristics of dexterity assessments with
the goal of helping clinicians and researchers make
informed selections of appropriate dexterity assessment instruments to compliment a full evaluation of
the function of the upper limb. The MRMT, PP, and
BBT demonstrated solid psychometric properties
through evidence from more than five Level 2b studies. The BBT and MRMT are therefore recommended
as assessments of choice to evaluate manual dexterity,
and the PP is recommended to assess fine finger
dexterity. This review highlighted psychometric
soundness as a critical factor in decisions regarding
selection of a dexterity assessment. This review may
also provoke new research ideas based on gaps in the
literature or the changing needs of therapy fields.
REFERENCES
1. Backman C, Cork S, Gibson G, Parsons J. Assessment of hand
function: the relationship between pegboard dexterity and
applied dexterity. Can J Occup Ther. 1992;59:208–13.
2. Gallus J, Mathiowetz V. Test-retest reliability of the Purdue
Pegboard for persons with multiple sclerosis. Am J Occup
Ther. 2003;57:108–11.
3. Williams ME, Hadler NM, Earp JL. Manual ability as a marker of
dependency in geriatric women. J Chronic Dis. 1982;35:115–22.
4. Greenhalgh J, Long AF, Brettle AJ, Grant MJ. Reviewing and
selecting outcome measures for use in routine practice. J Eval
Clin Prac. 1998;4:339–50.
5. Rudman D, Hannah S. An instrument evaluation framework:
description and application to assessments of hand function.
J Hand Ther. 1998;11:266–77.
6. Rosenthal R, Rosnow RL. Essentials of Behavioral Research:
Methods and Data Analysis. 2nd ed. New York: McGrawHill, 1991.
268
JOURNAL OF HAND THERAPY
7. Wright RW, Brand RA, Dunn W, Spindler KP. How to write a
systematic review. Clin Orthop. 2007;455:23–9.
8. Philips B, Sackett D, Badenoch D, Straus S, Haynes B, Dawes
M. Oxford Centre for evidence-based medicine levels of
evidence Available at:http://www.cebm.net/index May 2001.
9. Trombly C. Occupational Therapy for Physical Dysfunction.
4th ed. Baltimore, MD: Williams & Wilkins, 1995.
10. Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms
for box and block test of manual dexterity. Am J Occup Ther.
1985;39:386–91.
11. Svensson E, Hager-Ross C. Hand function in Charcot-Marie
Tooth: test-retest reliability of some measurements. Clin Rehabil. 2006;20:896–908.
12. Platz T, Pinkowski C, van Wijck F, Kim I, diBella P, Johnson G.
Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research
Arm Test and Box And Block Test: a multicentre study. Clin Rehabil. 2005;19:404–11.
13. Desrosiers J, Bravo G, Hebert R, Dutil E, Mercier L. Validation
of the Box and Block Test as a measure of dexterity in elderly
people: reliability, validity, and norm study. Arch Phys Med
Rehabil. 1994;75:751–5.
14. Berger Y. Does the Crawford Small Parts Dexterity Test require
new norms? Percept Motor Skills. 1985;60:948–50.
15. Aaron DH, Stegnik Jensen CW. Development of the Functional
Dexterity Test (FDT): construction, validity, reliability, and
normative data. J Hand Ther. 2003;16:12–21.
16. Bryden PJ, Roy EA. A new method of administering the
Grooved Pegboard Test: performance as a function of handedness and sex. Brain Cogn. 2005;58:258–68.
17. Ruff RM, Parker SB. Gender and age-specific changes in motor
speed and eye-hand coordination in adults: normative values
for the finger tapping and Grooved Pegboard Tests. Percept
Motor Skills. 1993;76:1219–30.
18. Jebsen RH, Taylor N, Trieschmann RB, Trotter MJ, Howard LA.
An objective and standardized test of hand function. Arch
Phys Med Rehabil. 1969;50:311–9.
19. Lynch KB, Bridle MJ. Validity of the Jebsen-Taylor Hand Function Test in predicting activities of daily living. Occup Ther J
Res. 1989;9(5):316–9.
20. Surrey LR, Nelson K, Delelio C, et al. A comparison of performance outcomes between the Minnesota Rate of Manipulation
Test and the Minnesota Manual Dexterity Test. Work. 2003;20:
97–102.
21. Maiden D, Dyson M. An examination of the validity of the
Morrisby Manual Dexterity Test. Aust Occup Ther J. 1997;44:
177–85.
22. Clopton N, Schafer S, Clopton JR, Winer JL. Examinee position
and performance on the Minnesota Rate of Manipulation Test.
J Rehabil. 1984;1:46–8.
23. Gloss DS, Wardle MG. Use of the Minnesota Rate of Manipulation Test for disability evaluation. Percept Mot Skills. 1982;55:
527–32.
24. Shanthamani VS. Industrial use of dexterity test. J Psychol Res.
1979;23(3):200–5.
25. Drussell RD. Relationship of the Minnesota Rate of Manipulation Test with the industrial work performance of the adult
cerebral palsied. Am J Occup Ther. 1959;13:93–6.
26. Goodkin DE, Hertsgaard D, Seminary J. Upper extremity function in multiple sclerosis: improving assessment sensitivity
with Box-and-Block and Nine-Hole Peg Tests. Arch Phys
Med Rehabil. 1988;69:850–4.
27. Desrosiers J, Rochette A, Hebert R, Bravo G. The Minnesota
Manual Dexterity Test: reliability, validity and reference values
studies with healthy elderly people. Can J Occup Ther. 1997;64:
270–6.
28. Moberg E. Objective methods for determining the functional
value of sensibility in the hand. J Bone Joint Surg [Br]. 1958;
40:454–76.
29. Amirjani N, Ashworth NL, Gordon T, Edwards DC, Chan M.
Normative values and the effects of age, gender, and handedness on the Moberg Pick-Up Test. Muscle Nerve. 2007;35:
788–92.
30. Jerosch-Herold C. A study of the relative responsiveness of five
sensibility tests for assessment of recovery after median nerve
injury and repair. J Hand Surg. 2003;3:255–60.
31. Ng CL, Ho DD, Chow SP. The Moberg Pick-Up Test: results of
testing with a standard protocol. J Hand Ther. 1999;12:
309–12.
32. Kellor M, Frost J, Silberberg N, Iversen I, Cummings R. Hand
strength and dexterity: norms for clinical use. Am J Occup
Ther. 1971;25(2):77–83.
33. Mathiowetz V, Weber K, Kashman N, Volland G. Adult norms
for Nine Hole Peg Test of finger dexterity. Occup Ther J Res.
1985;5(1):24–38.
34. Grice KO, Vogel K, Le V, Mitchell A, Muniz S, Vollmer MA.
Adult norms for a commercially available Nine Hole Peg
Test for finger dexterity. Am J Occup Ther. 2003;57:570–3.
35. Brandy DA. The O’Connor Tweezer Dexterity Test as a screening tool for hiring surgical hair restoration assistants. J Cosmet
Surg. 1995;12:313–6.
36. Corlett EN, Salvendy G, Seymour WD. Selecting operators
for fine manual tasks: a study of the O’Connor Finger Dexterity Test and the Purdue Pegboard. Occup Psychol. 1971;45:
57–65.
37. Gloss DS, Wardle MG. Use of a test of psychomotor ability in
an expanded role. Percept Mot Skills. 1981;53:659–62.
38. Buddenberg L, Davis C. Test-retest reliability of the Purdue
Pegboard Test. Am J Occup Ther. 2000;54:555–8.
39. Hamm NH, Curtis D. Normative data for the Purdue Pegboard
on a sample of adult candidates for vocational rehabilitation.
Percept Mot Skills. 1980;50:309–10.
40. Tiffin J, Asher EJ. The Purdue Pegboard: norms and studies of
reliability and validity. J Appl Psychol. 1948;32:234–47.
41. Van Lankveld W, van’t Pad Bosch PJ, Bakker J, Terwindt S,
Franssen M, van Riel P. Sequential occupational dexterity assessment (SODA): a new test to measure hand disability.
J Hand Ther. 1996;9:27–32.
42. O’Connor D, Kortman B, Smith A, Ahern M, Smith M,
Krishnan J. Correlation between objective and subjective measures of hand function in patients with rheumatoid arthritis. J
Hand Ther. 1999;12:323–9.
43. Van Lankeveld W, Graff MJL, van’t Pad Bosch PJ. The short
version of the sequential occupational dexterity assessment
based on individual tasks’ sensitivity to change. Arthr Care
Res. 1999;12:417–24.
44. Whitall J, Savin DN Jr, Harris-Love M, McCombe Waller S.
Psychometric properties of a Modified Wolf Motor Function
Test for people with mild and moderate upper extremity
hemiparesis. Arch Phys Med Rehabil. 2006;87:656–60.
45. Morris DM, Uswatte G, Crago JE, Cook EW, Taub E. The reliability of the Wolf Motor Function Test for assessing upper
extremity function after stroke. Arch Phys Med Rehabil.
2001;82:750–5.
46. Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf Motor Function Test as outcome
measure for research in patients after stroke. Stroke. 2001;
32:1635–9.
47. Wolf SL, Thompson PA, Morris DM, et al. The EXCITE trial: attributes of the Wolf Motor Function Test in patients with subacute stroke. Neurorehabil Neural Repair. 2005;19(3):194–204.
48. Hui Yung Ang J, Wai Kwong MD. The discriminative power of
the Wolf Motor Function Test in assessing upper extremity
functions in persons with stroke. Int J Rehabil Res. 2006;29:
357–61.
JulyeSeptember 2009 269
JHT Read for Credit
Quiz: Article # 133
Record your answers on the Return Answer Form
found on the tear-out coupon at the back of this
issue. There is only one best answer for each
question.
#1. The design of this study is
a. an RCT
b. a case series
c. a systematic review
d. a narrative review
#2. The study primarily evaluates tests of
a. hand function
b. digital strength
c. finger dexterity
d. digital sensibility
#3. The authors refer to the following as psychometric properties of testing instruments
a. validity and reliability
b. sensitivity and specificity
c. positive and negative predictive values
270
JOURNAL OF HAND THERAPY
d. selectivity and reactivity
#4. The research design was based on data extracted
from
a. manufacturers’ printed instructions
b. a review of a series of articles from the
literature
c. questionnaires returned by CHTs
d. interviews of patients at the conclusion of their
treatment (discharge from service)
#5. The authors recommend the following test(s) for
their psychometric properties
a. Jebsen Hand Function Test
b. BBT, MRMT, and PP
c. Sollerman Hand Function Test
d. Moberg Pick Up Test and the 9 Hole Peg Board
When submitting to the HTCC for re-certification,
please batch your JHT RFC certificates in groups
of 3 or more to get full credit.
Download