Acknowledgements
A cost-effectiveness framework for
profiling hospital efficiency
Sharon-Lise Normand1,2
Joe Newhouse1
Meredith Rosenthal3
Justin Timbie
1Department
2Department
AcademyHealth Annual Research Meeting
June 5, 2007
Health
of Health Care Policy, Harvard Medical School
of Biostatistics, Harvard School of Public
3Department
of Health Policy & Management, Harvard
School of Public Health
Walt Disney World “Dolphin”
1
Context
2
Examples of efficiency metrics
• Interest in efficiency measurement following
growth of P4P.
• Dartmouth Atlas: population-based efficiency:
– Medicare spending (last 2 years of life)
– Resource inputs: beds, physician FTE inputs
– Utilization: hospital/ICU days, physician visits
– 42% of commercial HMOs use cost information
(Rosenthal, 2005)
• DRA of 2005 requires Medicare to implement
value based purchasing for hospital services by
FY’09.
– Efficiency measures to be included in FY’10-11.
• Measuring appropriateness and efficiency are
both challenges.
• Leapfrog Group: risk-adjusted LOS,
readmission rates within 14 days.
• National Quality Forum: focusing on LOS and
readmission.
• Medicare: MEDPAC considering publicly
reporting hospital readmission rates.
3
Measurement challenges
• Defining efficiency: Focus on payment or resource use
(LOS, readmission rates, RVUs).
– DRG-based payment makes hospital efficiency
profiling different.
– Limited ability to measure inpatient resource use.
• Duration of efficiency, quality measurement.
– Longer duration is desired.
– Causes attribution difficulties (PAC providers).
• Weighting of cost vs. quality.
– Binary (threshold) scoring approaches weight
domains equally.
– Measuring performance continuously allows tradeoffs.5
4
Study design
• Objective: Compare efficiency of hospital care
following acute myocardial infarction (AMI).
• Motivation: Channeling patients to high-value
hospitals for specific conditions.
Efficiency = Health benefit relative to cost
• Outcomes: In-hospital survival, hospital costs.
• Data source: Massachusetts all payer data.
– 69 hospitals (11,259 patients) in FY’03.
6
1
Methods - Cost measurement
Methods - Estimation
• Used total hospital charges and global cost-tocharge ratios.
• Link inter-hospital transfers to create inpatient
“episodes.”
• Estimate “predicted” outcomes.
– Costs derived from charge data remove price
variation.
– Use of global cost-to-charge ratios may confound
estimates due to differential markup across revenue
centers.
– Fit hierarchical models.
– Condition on hospital-specific effect, risk factors.
• Estimate “expected” outcomes.
• Used in-hospital outcomes, although 30-day
outcomes are preferred.
• Lacking post-acute care costs, costs of
procedures.
– Condition on population mean effect, risk factors.
7
8
Results – Threshold Scoring
• Estimate P(INHB > 0)
• Identify efficient hospitals using relative or
absolute threshold.
93
92
92
91
90
90
89
88
88
INHBi = ΔEi – ΔCi/λ
where λ = WTP/ΔE = $5M/Life saved
P(Y (S) > Y (S) , Y (C) < Y (C) )
87
• Incremental outcomes:
ΔEi = Predicted survivali – Expected survivali
ΔCi = Predicted costi – Expected costi
• Incremental Net Health Benefits (INHB):
Standardized
(%)
StandardizedSurvival
Survival (%)
94
94
Methods - Combining measures
P(Y (S) < Y (S), Y (C) > Y (C) )
15000
15,000
9
30000
30,000
35000
35,000
10
Sensitivity of INHB estimates to λ
1.0
1.0
94
94
0.4
0.4
0.0
0.0
0.2
0.2
P (INHBP(INHB
> 0)
> 0)
0.6
0.6
0.8
0.8
93
92
92
91
90
90
89
88
88
ΔCi
⎛
⎞
P(INHBi > 0 ) = P⎜ ΔEi −
> 0⎟
λ
⎝
⎠
00
87
Standardized Survival (%)
25000
25,000
Standardized Cost (Dollars)
Results - Cost-effectiveness
Standardized Survival (%)
20000
20,000
Standardized Cost (dollars)
11
22
3
3
44
55
Willingness to Pay (Million $/Life Saved)
15000
15,000
20000
20,000
25000
25,000
30000
30,000
Standardized
Cost (Dollars)
Standardized
Cost
(dollars)
35000
35,000
11
Willingness to Pay Threshold
(Million $/Life Saved)
12
2
Summary
Future work
• Proposed an economic approach to measuring
efficiency using a composite measure.
• Theoretically strong and objective weighting
mechanism.
• Results will differ from threshold model due to
ability to incorporate tradeoffs.
• Difficult to agree on single WTP value.
• Longitudinal analysis.
• Inclusion of AMI process measures, quality of
life.
• Developing willingness to pay values that reflect
multiple outputs (benefits).
• Refining cost measure to include RVUs.
• Exploring a composite measure of hospital
efficiency.
– LY and QALY measures of benefit are more
promising.
13
14
3