Uploaded by JingXi Ng

Zarit Burden Interview Short Forms: Validity in Advanced Conditions

advertisement
Journal of Clinical Epidemiology 63 (2010) 535e542
ORIGINAL ARTICLE
Short-form Zarit Caregiver Burden Interviews were valid
in advanced conditions
Irene J. Higginsona,*, Wei Gaoa, Diana Jacksona, Joanna Murrayb, Richard Hardinga
a
King’s College London, Department of Palliative Care, Policy and Rehabilitation, School of Medicine at Guy’s, King’s College and St Thomas’ Hospitals,
London, United Kingdom
b
King’s College London, Health Service and Population Research Department, Institute of Psychiatry, David Goldberg Centre, London, United Kingdom
Accepted 3 June 2009
Abstract
Objectives: To assess six short-form versions of Zarit Burden Interview (ZBI-12, ZBI-8, ZBI-7, ZBI-6, ZBI-4, and ZBI-1) among three
caregiving populations.
Study Design and Setting: Secondary analysis of carers’ surveys in advanced cancer (n 5 105), dementia (n 5 131), and acquired
brain injury (n 5 215). All completed demographic information and the ZBI-22 were used. Validity was assessed by Spearman correlations
and internal consistency using Cronbach’s alpha. Overall discrimination ability was evaluated using the area under the receiver operating
characteristic curve (AUC).
Results: All short-form versions, except the ZBI-1 in advanced cancer (rho 5 0.63), displayed good correlations (rho 5 0.74e0.97)
with the ZBI-22. Cronbach’s alphas suggested high internal consistency (range: 0.69e0.89) even for the ZBI-4. Discriminative ability
was good for all short forms (AUC range: 0.90e0.99); the best AUC was for ZBI-12 (0.99; 95% confidence interval [CI]: 0.98e0.99)
and the second best for ZBI-7 (0.98; 95% CI: 0.96e0.98) and ZBI-6 (0.98; 95% CI: 0.97e0.99).
Conclusions: All six short-form ZBI have very good validity, internal consistency, and discriminative ability. ZBI-12 is endorsed as the
best short-form version; ZBI-7 and ZBI-6 show almost equal properties and are suitable when a fewer-question version is needed. ZBI-4 and
ZBI-1 are suitable for screening, but ZBI-1 may be less valid in cancer. Ó 2010 Elsevier Inc. All rights reserved.
Keywords: Carer; Outcome; Palliative; Burden; Aging; Validity
1. Background
Informal carers are the primary resource for patient care
and are known to have high needs for support and psychological morbidity [1e4]. Although there are many suggested interventions seeking to improve their overall
well-being, there is little evaluative research into the
efficacy of such interventions [5,6]. Measurement of appropriate carer outcomes is essential for such studies. Although
there are many measures to assess caregiver burden, strain,
well-being, or other outcomes in specific disease, such as
stroke or mental illness [7,8], there are fewer measures
targeted for the carers of patients with advanced disease.
Mularski et al. in a major systematic review of measures
Competing interests: None.
* Corresponding author. Department of Palliative Care, Policy and Rehabilitation, School of Medicine at Guy’s, King’s College and St Thomas’
Hospitals, King’s College London, Weston Education Centre, 3rd Floor,
Cutcombe Road, Denmark Hill, London SE5 9RJ, United Kingdom.
Tel.: þ44-0-20-7848-5516; fax: þ44-0-20-7848-5517.
E-mail address: irene.higginson@kcl.ac.uk (I.J. Higginson).
0895-4356/10/$ e see front matter Ó 2010 Elsevier Inc. All rights reserved.
doi: 10.1016/j.jclinepi.2009.06.014
for use toward the end of life for the National Institute of
Health (USA) highlighted ‘‘significant gaps’’ in measuring
caregiver outcomes, identifying only two measures in their
literature search of 24,423 citations [9].
Caregiver burden is closely aligned to the goals of many
interventions and is associated with negative health outcomes in carers of people with common conditions, such
as dementia, stroke, and cancer [8,10,11]. Moreover, perceived burden had been shown to predict anxiety and
depression in carers of patients with these conditions
[12e14]. Caregiver burden had been defined as a contextspecific negative affective outcome, occurring as a result
of perceived inability to contend with role demands [15].
There is general agreement that caregiver burden is a multidimensional concept affected by objective elements related
to the nature and time of the practical tasks undertaken by
carers and subjective elements arising from the perceived
emotional, social, and relationship stresses that can accompany this role [8,16]. Therefore, it would seem appropriate
to measure caregiver burden as an outcome in advanced
disease.
536
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
2. Data and methods
What is new?
Key findings
The 12-item Zarit Burden Interview (ZBI-12) was
suitable in all situations; the ZBI-7 and the ZBI-6
were almost equally good and may be suitable for
palliative care settings; the ZBI-4 and ZBI-1 were
useful when a very short screening instrument was
needed.
What was known?
The ZBI-22 is a widely used outcome measure of
caregiver burden and has been validated in diverse
caregiving samples. Several short-form versions of
ZBI have been developed, but little is known about
how well they perform in diverse populations.
What does this study add?
For the first time, six short-form versions of ZBI have
been comprehensively and systematically evaluated
in diverse populations. Evidence-based recommendations have been provided for choosing the best shortform version in various settings. The ZBI-6, a further
improvement to the ZBI-7, has been developed for
palliative care settings.
What is the implication and what should change
now?
Stop using the ZBI-8; use ZBI-6 in palliative care;
consider using the ZBI-1 when rapid screening is
needed.
Although there are other measures, the 22-item Zarit
Burden Interview (ZBI) is the most widely used tool for
measuring the level of subjective burden among carers
[17,18]. Several shorter versions of the ZBI have been developed, including Bedard et al.’s 12-, 8-, 7-, and 4-item
screening versions [19e21]. However, the factorial structures of ZBI were established among the carers of patients
with dementia whose concerns may be different from carers
of patients with cancer or sudden onset illness. Analysis of
four abridged versions of the ZBI in 503 carers of people
with dementia suggested that the 12-item version was optimal [15]. However, in some clinical settings, such as intensive care units, palliative care, and care of older people, the
12-item ZBI can still be a heavy assessment burden. There
is a need to test shorter forms of the ZBI with the carers of
people with advanced or progressive illness. Therefore, we
designed this study to investigate the validity and internal
consistency of six shorter forms of ZBI (ZBI-12, ZBI-8,
ZBI-7, ZBI-6, ZBI-4, and ZBI-1) among informal carers
of patients with three different conditions compared with
the 22-item version as the gold standard.
2.1. Design and data sources
This is a secondary analysis using data pooled from four
studies.
1. Baseline data from a multicenter evaluation of palliative day care for cancer patients involving six centers
across the south of England [22,23];
2. Baseline data from a two-center evaluation of the ‘‘90
Minute Group,’’ a supportive intervention for the
carers of cancer palliative care patients [6];
3. A national postal questionnaire survey of caregiver
experiences of acquired brain injury (ABI) [24]; and
4. Baseline data from a prospective longitudinal cohort
study of caregiver burden in dementia involving
participants from South East London [25].
All studies collected data from informal carers using the
self-reported 22-item ZBI (ZBI-22), with interviewers present in the cancer and dementia studies to provide support to
respondents during data collection if needed. In addition to
ZBI, the data set contains basic demographic data, including age, sex, and relationship, and clinical data regarding
the patients.
2.2. Short-form versions of the Zarit Burden Interview
Several short-form versions have been developed. The
three most common short-form versions of ZBI are the
12-item version (ZBI-12) by Bedard et al. [19], the eightitem version (ZBI-8) by Arai et al. [21], and the four-item
version (ZBI-4) by Bedard et al. [19]. The ZBI-12 and the
ZBI-4 were reported in the same study [19]. The ZBI-22
data were factor analyzed using a principal component
analysis and revealed a two-factor structure. The items
for the ZBI-12 were selected through a combination of high
factor loading and high itemetotal correlations across all
six situations, and the ZBI-4 screening items were selected
based on the itemetotal correlations while keeping the
three-to-one item ratio between factors 1 and 2 [19]. The
ZBI-8 items were chosen in terms of their factor loadings
(>0.65) on a two-factor structure [21].
A new seven-item version (ZBI-7) proposed specifically
for palliative care was included for evaluation; the items
extracted were decided by an expert committee [20]. However, ZBI-7 included item 22 of the full scale, a global
question to assess overall subjective burden. This is
unusual, because short-form versions do not usually contain
the global question, especially for the measures of subjective burden [8,16,26]. Therefore, we derived a six-item version of ZBI (ZBI-6), excluding this global question. We
also tested item 22 on its own (ZBI-1) to understand
whether the single global question (‘‘Overall how burdened
do you feel’’) would be useful as a screening tool. Items included in each of the short-item versions are listed in Table
1. The responses to every item are in 5-point Likert scale
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
537
Table 1
Items included in the short-form ZBI
Item
Q1
Q2
Q3
Q4
Q5
Q6
Q7
Q8
Q9
Q10
Q11
Q12
Q13
Q14
Q15
Q16
Q17
Q18
Q19
Q20
Q21
Q22
Question (do
you feel/wish.)
Your relative asks for more
help than he/she needs?
You don’t have enough time
for yourself?
Stressed between caring and
meeting other
responsibilities?
Embarrassed over behaviors?
Angry when around your
relative?
Your relative affects your
relationship with others in
a negative way?
Afraid of what the future
holds for relative?
Your relative is dependent on
you?
Strained when are around
your relative?
Your health has suffered
because of your
involvement with your
relative?
You don’t have as much
privacy as you would like,
because of your relative?
Your social life has suffered
because you are caring for
your relative?
Uncomfortable about having
friends over because of
your relative?
Your relative seems to expect
you to take care of him/her,
as if you were the only one
he/she could depend on?
You don’t have enough
money to care for your
relative, in addition to the
rest of your expenses?
You will be unable to take
care of your relative much
longer?
You have lost control of your
life since your relative’s
illness?
You could just leave the care
of your relative to someone
else?
Uncertain about what to do
about relative?
You should be doing more for
your relative?
You could do a better job in
caring for your relative?
Overall, how burdened do
you feel in caring for your
relative?
Gort et al.’s
ZBI-7 [20]
Higginson
et al.’s ZBI-6
(this paper)
Bedard et al.’s
ZBI-4 [19]
Y
Y
Y
Y
Y
Y
Y
Y
Bedard et al.’s
ZBI-12 [19]
Arai et al.’s
ZBI-8 [21]
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Higginson
et al.’s ZBI-1
(this paper)
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Possible responses to Q1eQ21: 0, never; 1, rarely; 2, sometimes; 3, quite frequently; 4, nearly always.
Possible responses to Q22: 0, not at all; 1, a little; 2, moderately; 3, quite a bit; 4, extremely.
Abbreviations: ZBI, Zarit Burden Interview; Y, yes.
Y
538
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
from 0 (never) to 4 (nearly always). The overall burden is
assessed by the total score of all items, with a higher score
representing a greater caregiver burden.
2.3. Data analysis
Demographic characteristics were described, and differences between diagnostic groups were compared using oneway ANOVA (for age) and chi-square test (for sex and
relationship to patient). Total scores of ZBI-22, ZBI-12,
ZBI-8, ZBI-7, ZBI-6, ZBI-4, and ZBI-1 were summarized
using descriptive statistics. The score differences between
three diagnoses were examined for overall differences using KruskaleWallis test followed by Wilcoxon two-sample
test if the overall difference was significant. The Bonferroni
procedure was used to adjust raw P values (multiplying 3)
to control the type 1 error in multiple testing [27].
We planned to examine the subscales of ZBI, but found inconsistencies in the literature regarding the content of the
subscales. For example, the original article by Whitlatch
et al. [28] presented two subscales: role and personal strain
with six and 12 items, respectively. Hebert et al. [29] used
these in their factor analysis producing a 12-item version.
However, Knight et al. [30], Bedard et al. [19], and O’Rourke
et al. [31], when conducting exploratory and confirmatory
factor analysis, revealed that different items were included
in the role and personal subscales, even though they gave
them the same names. Because of the inconsistencies, we
did not proceed with the subscale analysis.
Validity was assessed by testing for correlations of the
ZBI-12, ZBI-8, ZBI-7, ZBI-6, ZBI-4, and ZBI-1 with the
ZBI-22 (as the gold standard) using Spearman rank order correlation. Terwee et al. [32] suggest that correlations of 0.7 or
more are required. Internal consistency was examined with
Cronbach’s alpha, and a value in the range of 0.7e0.9 is good
[32]. An alpha value of greater than 0.9 suggests redundant
items. For small scales (e.g., four items), values of 0.6 are
good, because alpha tends to underestimate internal consistency when the number of items is small [32,33].
Using a total burden score of 21 on the ZBI-22 as the cutoff
point for high burden [18], the discriminatory performance of
various short-form versions of ZBI was assessed and compared with the receiver operating characteristic (ROC) curve
[34], which was constructed by plotting sensitivity against
1 specificity. Each point in the ROC plot represents a sensitivity/1 specificity pair corresponding to a particular cutoff
value. A test with perfect discrimination has an ROC plot that
passes through the upper-left corner (100% sensitivity and
100% specificity). Therefore, the closer a ROC plot is to
the upper-left corner, the higher the overall accuracy of the
test. The point closest to (0, 1) on the curve was used to determine the most optimal combination of sensitivity and
specificity [34]. The areas under the curves (AUC) were calculated using the trapezoidal method [34,35]. The AUC represents the overall discriminative ability of a test, that is, the
ability to correctly classify those with and without burden.
The range of the AUC is 0.5e1.0. A discriminative test is
considered perfect if AUC 5 1.0, good if AUC 5 0.8e1.0,
moderate if AUC 5 0.6e0.8, and poor if AUC 5 0.5e0.6;
an area of 0.5 reflects a random rating model [35]. 95% Confidence intervals of AUCs were computed. A P value below
0.05 was considered as statistically significant. All analyses
were carried out using SAS 9.1 package (SAS Institute
Inc., Cary, NC, USA).
3. Results
One hundred and five, 131, and 215 informal carers for
patients with advanced cancer, dementia, and ABI respectively, were recruited, making a total sample of 451. Most
carers were womend81% for ABI, 72% for cancer, and
72% for dementia (c2df52 5 5.50, P 5 0.06). The carers of
ABI patients were the youngestdmean age (standard deviation) of 54 (11) compared with 66 (12) for cancer and
62 (13) for dementia (F(2,448) 5 42.8, P ! 0.0001).
Spouse/partner carers were the most commond59% for
ABI, 82% for cancer, 37% for dementiadfollowed by parent (37% for ABI, 4% for cancer, and 0% for dementia) or
son/daughter (44% for dementia, 11% for cancer, and 0%
for ABI) (c26 5 227.6, P ! 0.0001).
Table 2 shows the descriptive statistics of the total score
for various short-form versions of ZBI in each diagnostic
group. All scores showed highly significant overall difference across three groups (all P values ! 0.001). In all
groups, there was a wide range of burden scores. The disease-specific burden pattern reflected in the full-scale ZBI
was well captured by all short-form versions. Subjective
caregiver burden were lowest for the carers of cancer patients and highest for those of patients with ABI. However,
the significance of the difference shown in ZBI-22 (ABI vs.
cancer: z 5 7.66, Padj ! 0.0001; ABI vs. dementia:
z 5 5.62, Padj ! 0.0001; cancer vs. dementia: z 5 2.03,
Padj 5 0.12) was only satisfactorily revealed by ZBI-12,
ZBI-6, and ZBI-4. ZBI-1 was among the worst in all the
short-form versions for misjudging two pairwise comparisons of ABI vs. dementia (z 5 2.15, Padj 5 0.10) and cancer
vs. dementia (z 5 4.30, P ! 0.0001), whereas ZBI-7
(z 5 2.76, Padj 5 0.018) and ZBI-8 (z 5 4.24, P ! 0.0001)
did not reflect the difference in comparing cancer with
dementia, as was the case in ZBI-22.
High correlation coefficients were found between the
full version and short forms (Table 3), with correlations
well above our criteria (O0.7) for the full scale (range:
0.88e0.97) using all short-form versions except for the
ZBI-1. Even with the one-item version (ZBI-1), satisfactory
correlation with ZBI-22 was obtained in dementia
(rho 5 0.74) and ABI (rho 5 0.78) groups. The full ZBI
showed a high Cronbach’s alpha in all three diagnostic
groups, ranging from 0.88 to 0.93. The alpha values met
our internal consistency criteria of good for all the shortform versions, ranging from 0.69 (for a four-item scale in
cancer) to 0.90. Correlations and internal consistencies
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
539
Table 2
Descriptive statistics of scores for six short-form and full-scale versions of the ZBI
Diagnosis
a
Version
Statistics
Cancer
Dementia
ABI
Multiple comparisonsb
ZBI-12
Mean (SD)**
95% CI
Median (min, max)
12.0 (8.5)
10.4e13.7
10 (0, 36)
15.1 (10.0)
13.4e16.8
15 (0, 43)
21.7 (10.1)
20.4e23.1
22 (0, 46)
B**, C**
ZBI-8
Mean (SD)**
95% CI
Median (min, max)
5.5 (4.7)
4.6e6.4
4 (0, 24)
8.8 (6.1)
7.7e9.8
9 (0, 28)
11.5 (7.2)
10.5e12.4
11 (0, 31)
A**, B**, C**
ZBI-7
Mean (SD)**
95% CI
Median (min, max)
7.4 (5.6)
6.3e8.5
7 (0, 21)
9.9 (6.8)
8.7e11.1
10 (0, 27)
14.3 (7.0)
13.4e15.3
14 (0, 28)
A*, B**, C**
ZBI-6
Mean (SD)**
95% CI
Median (min, max)
6.4 (4.9)
5.4e7.3
6 (0, 19)
8.2 (5.8)
7.2e9.2
8 (0, 23)
12.3 (6.0)
11.5e13.1
13 (0, 24)
B**, C**
ZBI-4
Mean (SD)**
95% CI
Median (min, max)
4.8 (3.5)
4.2e5.5
5 (0, 12)
6.1 (4.1)
5.4e6.8
6 (0, 16)
7.9 (3.8)
7.3e8.4
8 (0, 16)
B**, C**
ZBI-1
Mean (SD)**
95% CI
Median (min, max)
1.0 (1.2)
0.8e1.3
1 (0, 4)
1.7 (1.3)
1.5e2.0
2 (0, 4)
2.1 (1.3)
1.9e2.2
2 (0, 4)
A**, C**
ZBI-22
Mean (SD)**
95% CI
Median (min, max)
23.2 (13.4)
20.7e25.8
22 (0, 66)
27.9 (16.4)
25.0e30.7
26 (0, 73)
39.1 (17.3)
36.8e41.4
39 (5, 80)
B**, C**
*P ! 0.05, **P ! 0.01.
Abbreviations: ABI, acquired brain injury; SD, standard deviation; CI, confidence interval; min, minimum; max, maximum;
a
The mean difference between three groups was tested using KruskaleWallis nonparametric ANOVA.
b
Multiple comparisons were made by Wilcoxon two-sample test, and type 1 error was controlled using Bonferroni method. A: cancer vs. dementia;
B: cancer vs. ABI; C: dementia vs. ABI; only significant pairwise differences were presented.
were similar to those in Table 3 separately for men and
women, for those older and younger than 70 years, and
for higher and lower burdened carers.
The most optimal combination of sensitivity and specificity, as visualized from ROC curves (Fig. 1), was 92% and
94% for ZBI-12 (cutoff score: 12), 82% and 92% for ZBI-8
(cutoff score: 6), 95% and 86% for ZBI-7 (cutoff score: 7),
91% and 91% for ZBI-6 (cutoff score: 6), 88% and 85% for
ZBI-4 (cutoff score: 4), and 91% and 53% for ZBI-1 (cutoff
score: 1). All shorter versions were overall successful in differentiating low- and high-burden individuals with all AUCs
well above 0.90. The short-form version with the best discriminative ability was ZBI-12 and that with the lowest
was ZBI-1. ZBI-6 performed slightly better than ZBI-8 and
to the same level as the ZBI-7.
4. Discussion
We tested and validated six short forms of the ZBI in
three caregiving populations. In all groups, there was a wide
range of scores for the ZBI-22; therefore, the short forms
were tested in samples reporting varying caregiver burden.
However, the highest burden scores were in the dementia
and the ABI groups, and we were not able to test burden
scores above 34 in the advanced cancer group. It may be
that caregiver burden using ZBI was lower in advanced cancer compared with dementia and ABI because of the lower
levels of cognitive disturbance or greater specialist palliative support for the cancer carers (the cancer carers were
sampled from palliative care services) [4,22,24,25]. However, it may equally be because of ZBI failing to measure
some aspects of caregiver burden in advanced cancer. Caregiver burden is a complex construct. It has been described
as having physical, social, financial, and emotional components, as well as leading to relationship and personal strain
[16]. Some measures seek to capture ‘‘burden’’ and others
‘‘strain’’ [7e9]. More recently measures to capture carer
positivity and satisfaction have been developed [36]. Which
components of burden are present and whether these are
different across different conditions are important questions
and need to be the subject of future research.
Three key findings emerge from our analysis. First, we
found high levels of validity (with correlations ranging
from 0.74 to 0.97) for all the short forms compared with
ZBI-22 in three diagnostic groups with the only exception
of the one-item version in cancer. The ZBI-12 has the highest validity (rho 5 0.95e0.97), and this is consistent across
advanced cancer, dementia, and ABI samples. In our populations, the performance of the ZBI-8 and the ZBI-4 are almost identical and slightly worse than that of ZBI-6 in both
540
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
Table 3
Spearman correlation coefficients (95% CI) between full and short-form versions of ZBI and Cronbach’s alpha of all versions of ZBI
Cancer
Dementia
ABI
Version
Rho (95% CI)
Alpha
Rho (95% CI)
Alpha
Rho (95% CI)
Alpha
ZBI-12
ZBI-8
ZBI-7
ZBI-6
ZBI-4
ZBI-1
ZBI-22
0.95 (0.92e0.96)
0.86 (0.80e0.90)
0.90 (0.86e0.93)
0.89 (0.84e0.93)
0.88 (0.82e0.91)
0.63 (0.50e0.73)
d
0.85
0.74
0.82
0.78
0.69
NA
0.88
0.96 (0.94e0.97)
0.90 (0.87e0.93)
0.94 (0.92e0.96)
0.94 (0.91e0.95)
0.89 (0.85e0.92)
0.74 (0.66e0.81)
d
0.87
0.80
0.86
0.83
0.78
NA
0.91
0.97(0.97e0.98)
0.93 (0.90e0.94)
0.95 (0.94e0.96)
0.95 (0.93e0.96)
0.92 (0.89e0.93)
0.78 (0.73e0.83)
d
0.89
0.89
0.90
0.88
0.79
NA
0.93
Abbreviation: NA, not applicable.
correlation and ROC analysis. Although the correlations
between short and long forms appeared to be slightly and
consistently stronger for the ABI group, and lowest in the
advanced cancer group, the differences were marginal,
not significant, and could be an artifact of the narrow range
of scores for the cancer group.
Second, we found high internal consistency of all versions of the ZBI, suggesting that some items are redundant
and short forms can be used. Only the ZBI-4 had lower, but
still good internal consistency (Cronbach’s alpha:
0.69e0.79) in the cancer group. Third, as we planned our
analysis, we found confusions in the categorization of the
role and personal strain subscales. Given the variability regarding the subscales and the high internal consistency of
the full Zarit scale and all the short forms, we doubt that
using the ‘‘personal’’ and ‘‘role’’ strain subscales has either
face or psychometric validity [30].
The choice of ZBI version should be based on the specific aims of the research. For most situations, 12-item ZBI
should have comparable performance with the full version
with the differentiating capacity close to 1. For situations
requiring rapid identification of caregiver burden, for example, screening for assessment or referral, four-item and
even one-item versions will be the ideal choice, given their
simplicity and optimal combination of high sensitivity
(O80%) and high specificity (O50%) as evident by the
ROC curves. Given that burden is multidimensional, the
success of the single- and four-item versions surprised us.
Although the ZBI-8 has more items, it did not exhibit
any superiority over the ZBI-7 or the ZBI-6 in psychometric characteristics and differential ability. An earlier small
study reported a perfect performance of the ZBI-7 with
100% sensitivity and 100% specificity in the palliative care
setting [20]. The validation of the ZBI-7 in our larger study
was close to thisd90% specificity at the sensitivity level of
90% (Fig. 1). However, we also found that, compared with
the ZBI-7, excluding the ‘‘global burden question’’ did not
compromise the ability of the ZBI-6 to distinguish carers
with burden from those without, and results were almost
equal to ZBI-12 (Fig. 1). Therefore, when investigators
need to keep the number of questions short, the ZBI-6 appears to be a good choice. Short forms to assess caregiver
1.0
0.9
0.8
Sensitivity
0.7
0.6
0.5
0.4
0.3
AUC (95%CI)
0.2
ZBI- 1: 0.90(0.87-0.93)
ZBI- 6: 0.98(0.97-0.99)
ZBI- 8: 0.97(0.96-0.98)
0.1
0.0
0.0
0.1
0.2
0.3
0.4
0.5
ZBI- 4: 0.94(0.92-0.96)
ZBI- 7: 0.98(0.96-0.98)
ZBI-12: 0.99(0.98-0.99)
0.6
0.7
0.8
0.9
1.0
1-Spectificity
Fig. 1. Receiver operating characteristic curves for various short-form versions of the Zarit Burden Interview (ZBI) and areas under the curve (AUC, 95%
confidence interval [CI]). A total score of 21 on the full-scale ZBI as the cutoff value between low and high burden [18].
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
burden may be important to ensure feasible collection of
datadburdened carers often focus on the needs of the patients whom they care for and not their own experiences
and stresses related to caring [37] and may not wish
to spend time completing anything but the briefest
questionnaire.
When using short-form versions of the ZBI as a screening test, sensitivity and specificity are standard measures
for the diagnostic performance compared with the gold
standarddZBI-22 [38]. However, these two measures are
inversely related. Increasing one measure (by changing
the cutoff value) results in a decrease in the other. Which
one is more important is a question that can only be
answered in the context in which it is used. Often a balance
is needed. For example, sensitivity is important when identifying highly burdened carers (as measured by the summary score of the ZBI), because they can be offered
more support that is unlikely to do harm [39]. However,
when resources are scarce or if carers felt they were ‘‘labeled’’ as not coping by false-positive screening results,
specificity is more important than sensitivity. It should be
noted however that, in this study, we were primarily testing
the performance of short forms of the ZBI as a screening
tool. In clinical practice, a wider exploration of the components contributing to burden may be needed. Ideally, qualitative or cognitive interviewing would be needed to
establish if all relevant aspects for caregiver burden are
included.
We recognize several limitations for this study. First, the
performance comparisons were evaluated with cross-sectional data; therefore, they provide no information on short
forms’ responsiveness to change (an essential psychometric
property in intervention and longitudinal studies) [40].
Three of the original studies collected data at several time
points; we are planning to use these data to assess the adequacy of short-form ZBI to detect change. Second, our
analyses were restricted to the limited number of common
demographic variables in the pooled data set; therefore, we
could not make detailed performance comparisons across
subsamples. Third, our validation was based on a comparison between short forms of ZBI with the full 22-item version, and thus makes an assumption that ZBI-22 accurately
captures caregiver burden. Ideally, we would have assessed
the short-form versions with other measures of burden or
against clinical findings, but this would have required more
intensive data collection among burdened carers, which
may not have been feasible. Our data only allow conclusions to be drawn about the short-form versions of ZBI
compared with the full version.
5. Conclusions
We found strong validity and internal consistency for
each of the short-form versions in all three samples. The
541
ZBI-12 is suitable in all situations, whereas the ZBI-7 or
the ZBI-6 is suitable when a fewer-question version is
needed, for example, in palliative care setting. The ZBI-7
is equivalent to the ZBI-6 although with one more question.
The ZBI-4 and ZBI-1 may be useful when a very short
screening instrument is needed, but the ZBI-1 may be less
valid in cancer.
Acknowledgments
We thank the patients, carers, staff, and volunteers who
participated in the original studies, including (1) six day
and home hospice and palliative care services which recruited and interviewed patients and carers and Danielle
Goodwin and other interviewers in the study; (2) two home
palliative care services in London, Celia Leam and Liz Taylor who worked with us to recruit patients, and Alison
Pearce (research assistant); (3) Research assistants Shehla
Kazim, Amanda Tadrous, and Joel Sheridon and representatives of Headway, the Encephalitis Society and the Meningitis Trust, who helped to disseminate information about
the ABI study to carer participants; (4) Community Mental
Health Teams for Older Adults in the South London and
Maudsley Mental Health Trust and the research workers
Beth Foley and Louise Atkins.
In addition, we thank the funders of the original studies:
the NHS Executive (London and South East) for funding
projects 1 and 2, the Department of Health (R&D grant
030/0066) for project 3, and the Department of Health, Policy Research Programme for project 4. Dr. Gao Wei is 50%
supported by the National Cancer Research Institute, UK,
a part of the ‘‘COMPlex interventions: Assessment, trialS
and implementation of Services in Supportive and Palliative Care (COMPASS)’’ collaborative. We also thank Professors Peter Fayers, Gordon Murray, and Julia Brown for
their helpful comments to improve this manuscript.
References
[1] Charlton R. Palliative care in non-cancer patients and the neglected
caregiver. J Clin Epidemiol 1992;45:1447e9.
[2] Hung SY, Pickard AS, Witt WP, Lambert BL. Pain and depression in
caregivers affected their perception of pain in stroke patients. J Clin
Epidemiol 2007;60:963e70.
[3] Maher J, Green H. Carers 2000. Office for National Statistics. London: The Stationary Office; 2002.
[4] The Resource Implications Study Group of the MRC Study of Cognitive Function and Aging (RIS MRC CFAS). Psychological morbidity among informal caregivers of older people: a 2-year follow-up
study. The Resource Implications Study Group of the MRC study
of cognitive function and ageing (RIS MRC CFAS). Psychol Med
2000;30:943e55.
[5] Harding R, Higginson IJ. What is the best way to help caregivers in
cancer and palliative care? A systematic literature review of interventions and their effectiveness. Palliat Med 2002;17:63e71.
[6] Harding R, Higginson IJ, Leam C, Donaldson N, Pearce A, George R,
et al. Evaluation of a short-term group intervention for informal
542
I.J. Higginson et al. / Journal of Clinical Epidemiology 63 (2010) 535e542
carers of patients attending a home palliative care service. J Pain
Symptom Manage 2004;27:396e408.
[7] Harvey K, Catty J, Langman A, Winfield H, Clement S, Burns E,
et al. A review of instruments developed to measure outcomes for
carers of people with mental health problems. Acta Psychiatr Scand
2008;117:164e76.
[8] Visser-Meily JM, Post MW, Riphagen II, Lindeman E. Measures
used to assess burden among caregivers of stroke patients: a review.
Clin Rehabil 2004;18:601e23.
[9] Mularski RA, Dy SM, Shugarman LR, Wilkinson AM, Lynn J,
Shekelle PG, et al. A systematic review of measures of end-of-life
care and its outcomes 3. Health Serv Res 2007;42:1848e70.
[10] Goldstein NE, Concato J, Fried TR, Kasl SV, Johnson-Hurzeler R,
Bradley EH. Factors associated with caregiver burden among caregivers
of terminally ill patients with cancer. J Palliat Care 2004;20:38e43.
[11] Schneider J, Hallam A, Murray J, Foley B, Atkin L, Banerjee S, et al.
Formal and informal care for people with dementia: factors associated with service receipt. Aging Ment Health 2002;6:255e65.
[12] Alvarez-Ude F, Valdes C, Estebanez C, Rebollo P. Health-related
quality of life of family caregivers of dialysis patients. J Nephrol
2004;17:841e50.
[13] Zarit SH, Reever KE, Bach-Peterson J. Relatives of the impaired elderly: correlates of feelings of burden. Gerontologist 1980;20:
649e55.
[14] Gort AM, Mingot M, Gomez X, Soler T, Torres G, Sacristan O, et al.
Use of the Zarit scale for assessing caregiver burden and collapse in
caregiving at home in dementias. Int J Geriatr Psychiatry 2007;22:
957e62.
[15] O’Rourke N, Tuokko HA. The relative utility of four abridged versions of the Zarit Burden Interview. J Ment Health Aging 2003;9:
55e64.
[16] Chenier MC. Review and analysis of caregiver burden and nursing
home placement. Geriatr Nurs 1997;18:121e6.
[17] Bachner YG, O’Rourke N. Reliability generalization of responses by
care providers to the Zarit Burden Interview. Aging Ment Health
2007;11:678e85.
[18] Zarit SH, Orr RD, Zarit JM. The hidden victims of Alzheimer’s disease:
families under stress. New York: New York University Press; 1985.
[19] Bedard M, Molloy DW, Squire L, Dubois S, Lever JA, O’Donnell M.
The Zarit Burden Interview: a new short version and screening version. Gerontologist 2001;41:652e7.
[20] Gort AM, March J, Gomez X, de MM, Mazarico S, Balleste J. [Short
Zarit scale in palliative care]. Med Clin (Barc) 2005;124:651e3.
[21] Arai Y, Tamiya N, Yano E. [The short version of the Japanese version
of the Zarit Caregiver Burden Interview (J-ZBI_8): its reliability and
validity]. Nippon Ronen Igakkai Zasshi 2003;40:497e503.
[22] Goodwin DM, Higginson IJ, Myers K, Douglas H-R, Normand C. Effectiveness of palliative day care in improving pain, symptom control
and quality of life. J Pain Symptom Manage 2003;25:202e12.
[23] Higginson IJ, Donaldson N. Relationship between three palliative
care outcome scales. Health Qual Life Outcomes 2004;2:68e75.
[24] Jackson D, Turner-Stokes L, Murray J, Leese M, McPherson KM.
Acquired brain injury and dementia: a comparison of carer experiences. Brain Inj 2009;23:1e12.
[25] Banerjee S, Murray J, Foley B, Atkins L, Schneider J, Mann A.
Predictors of institutionalisation in people with dementia. J Neurol
Neurosurg Psychiatry 2003;74:1315e6.
[26] Knowles ES, Condon CA. Why people say ‘‘Yes’’: a dual-process
theory of acquiescence. J Pers Soc Psychol 1999;77:379e86.
[27] Shaffer JP. Multiple hypothesis-testing. Annu Rev Psychol 1995;46:
561e84.
[28] Whitlatch CJ, Zarit SH, von EA. Efficacy of interventions with caregivers: a reanalysis. Gerontologist 1991;31:9e14.
[29] Hebert R, Bravo G, Preville M. Reliability, validity and reference
values of the Zarit Burden Interview for assessing informal caregivers
of community-dwelling older persons with dementia. Can J Aging
2000;19:494e507.
[30] Knight BG, Fox LS, Chou CP. Factor structure of the burden interview. J Clin Geropsychol 2000;6:249e58.
[31] O’Rourke N, Tuokko HA. Psychometric properties of an abridged
version of The Zarit Burden Interview within a representative Canadian caregiver sample. Gerontologist 2003;4:121e7.
[32] Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL,
Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007;60:
34e42.
[33] Nunnally JC, Bernstein IH. Psychometric theory. New York:
McGraw-Hill; 1994.
[34] Coffin M, Sukhatme S. Receiver operating characteristic studies and
measurement errors. Biometrics 1997;53:823e37.
[35] Weinstein MC, Fineberg HV, Elstein AS, Frazier HS, Neuhauser D,
Neutra RR, et al. Clinical decision analysis. Philadelphia: WB Saunders; 1980.
[36] Lim JW, Zebrack B. Caring for family members with chronic physical illness: a critical review of caregiver literature. Health Qual Life
Outcomes 2004;2:50.
[37] Harding R, Higginson I. Working with ambivalence: informal caregivers of patients at the end of life. Support Care Cancer 2001;9:
642e5.
[38] Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP,
Irwig LM, et al. Towards complete and accurate reporting of studies
of diagnostic accuracy: the STARD initiative. Ann Intern Med
2003;138:40e4.
[39] Fletcher RH, Fletchher SW. Prevention. In: Fletcher RH,
Fletchher SW, editors. Clinical epidemiology: the essentials. Baltimore, MD: Lippincott Williams & Wilkins; 2005. p. 158e61.
[40] Kirshner B, Guyatt G. A methodological framework for assessing
health indices. J Chronic Dis 1985;38:27e36.
Download