RI Experience with Public Reporting
6/28/2006December 8, 2003
Acknowledgements:
Rates of Change During Public and Private
Reporting Cycles of Hospital Performance:
Judith Barr, Tierney Giannotti,
Giannotti, and Marcia Petrillo –
Qualidigm
Shoshanna Sofaer – Consultant/Baruch College
William Waters – RI Department of Health
Deirdre Mylod and staff – Press Ganey
Hospital Association of Rhode Island
Implications for Mechanisms Driving Quality Improvement
Cathy E. Duquette, Ph.D., RN, CPHQ
Vice President, Nursing and Patient Care Services
Newport Hospital – Newport, RI
~~~~~~~~~~
June 27, 2006
Barr, J.K., Giannotti,
Giannotti, T.E., Sofaer,
Sofaer, S., Duquette, C.E., Waters,
W.J. and Petrillo,
Petrillo, M.K. 2006. “Using Public Reports of Patient
Satisfaction for Hospital Quality Improvement”
Improvement”. Health
Services Research 41(3), Part I (June 2006); 663663-682.
1
Rhode Island–
Island– Setting the Stage:
The Rhode Island Legislation:
Passed in July 1998 called for public reporting of:
Small state just over 1,000,000 population
– Comparable, statistically valid patient satisfaction
measures
– Standardized data set of clinical performance
measures, riskrisk-adjusted for patient variables
– 39 cities/towns; very limited county government
1 State Department of Health
16 hospitals in the state
Addressed the general health environment in RI
and the potential impact on quality:
– 13 hospitals: 10 acute care, 1 women & infants’
infants’,1 adult
psychiatric and 1 rehabilitation hospital participate in
patient satisfaction survey and report
– 10 acute care hospitals participate in the clinical
measures data collection and report
– All eligible hospitals were early participants in the
Hospital Quality Alliance
Impending mergers
ForFor-Profit vs. NotNot-ForFor-Profit
3
Program Development - Structure
and Process:
Process:
Applies to all licensed health care facilities in the
state, starting with hospitals
Director of the Department of Health (HEALTH) is
responsible for program development and
4
implementation
Program Development – Considerations:
Director of HEALTH is responsible
Steering Committee and Work Group structure
Process very open and public
– Committee format; consensus as goal
– Consumer, minority and interested party input
Input and feedback incorporated into each step of
program development
Hospitals represented by Hospital Association of Rhode
Island (HARI) through all stages of program development
– Opportunities to discuss issues and concerns among hospitals
within HARI structure
5
Cathy E. Duquette, Ph.D., RN, CPHQ
Hospital Association of Rhode Island
2
Outcome needed to address both public
accountability AND quality improvement
Aimed to balance desire to report on all patients/all
conditions vs. what was feasible
Needed to develop a report that was meaningful to
consumers AND hospitals
Report format and method of reporting needed to
be determined before data were available
Started with public reporting of patient satisfaction
Hospital approach was collaborative vs. competitive
6
1
RI Experience with Public Reporting
6/28/2006December 8, 2003
Program Development - Outcome:
The Public Reports
Program Development - Outcome:
The Private Reports
All hospitals in RI had a mechanism for measuring
patient perception prepre-program
Patient Satisfaction I – Nov 2001
– Variation to method, process, frequency
Hospitals agreed to select the same vendor and process
to meet program requirements
– Transition to mail survey conducted by Parkside Associates and
then Press Ganey
– Agreement to pilot data collection phase with each process
change (2000 and 2002) to evaluate process and provide early
data and information to hospitals to refine and target ongoing
quality improvement efforts
– Process created to establish ongoing data collection and
feedback for internal use between public reporting cycles
– Public General Report
– Public Technical Report
Patient Satisfaction II – Oct 2003
– Public General Report
– Public Technical Report
Patient Satisfaction III – TBD
– Currently participating in “dry run”
run”
– Awaiting HCAHPS for public report
7
Program Development - Outcome:
The Public Reports
8
Public Report Development:
State committee process – Patient Satisfaction Public
Release Work Group with hospital, consumer, and health
care stakeholder input
Evaluation of Public Reporting
on Hospital Patient Satisfaction
in Rhode Island – 2003
– Hospital staff and leadership actively engaged in process
Two types of public reports: general public and technical
Key reporting decisions made before results available
– Methods for translating raw data into different format
– Method and “standard”
standard” against which comparisons made
Statewide Effort to Improve
Hospital Patient Satisfaction
Ratings - 2004
Private report format designed for quality improvement and
not appropriate for public reporting
Draft reports went through formative testing process with
consumers
9
Sample Page from Public Report 2001:
Patient Satisfaction Report Excerpt 2001
Cathy E. Duquette, Ph.D., RN, CPHQ
Hospital Association of Rhode Island
10
Sample Page from Public Report 2003:
11
Patient Satisfaction Report Excerpt 2003
12
2
RI Experience with Public Reporting
6/28/2006December 8, 2003
Findings: RI Scores over Time
RI Trend Analysis vs. National:
Hospitals in RI started out and continue to be
higher than national average score
Steady improvement in RI score
No spikes around or following public reporting
time periods
Rate of increase is not faster than that of
national upward trend
13
Initial Responses:
Hospital Response
Hospitals supportive of public reporting
– Hospital CEOs supported enabling legislation
Hospital acceptance of program value in
driving and coordinating quality improvement
efforts statewide vs. influencing consumer
“choice”
choice”
Significant hospital involvement in process
from the beginning of program development
Commitment to
Quality Improvement
15
16
Quality Improvement Efforts:
For More Information:
Internal:
Senior leadership involvement and intense
organizational commitment
Reaching clinical staff and Boards of Trustees
Increase in focus and coordination
External:
Collaborative vs. competitive model
www.health.ri.gov
– Sharing of best practices
– Coordinated efforts through HARI
Demonstrating improvement over time
Cathy E. Duquette, Ph.D., RN, CPHQ
Hospital Association of Rhode Island
– RI Background Reports;
– Public and Technical Reports; and
– Evaluation Reports on Findings and Quality
Improvement Efforts
www.health.ri.gov/chic/performance/series.php
– Direct link to list of reports
17
18
3
RI Experience with Public Reporting
6/28/2006December 8, 2003
Questions?
19
Cathy E. Duquette, Ph.D., RN, CPHQ
Hospital Association of Rhode Island
4