Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Development of Chinese Version of Hospital Autonomy Questionnaire Journal: BMJ Open rp Fo Manuscript ID Article Type: Date Submitted by the Author: Complete List of Authors: bmjopen-2015-010504 Research 17-Nov-2015 Secondary Subject Heading: Medical management HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Health policy < HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Organisational development < HEALTH SERVICES ADMINISTRATION & MANAGEMENT w ie Keywords: Health policy ev <b>Primary Subject Heading</b>: rr ee Liu, Zifeng; Sun Yat-sen University, Guanghua School of Stomotology, Hospital of Stomatology; Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology Yuan, Lianxiong; Sun Yat-sen University, School of Public Health Huang, Yixiang; Sun Yat-sen University, School of Public Health; Guangdong Health Economics Association Zhang, Lingling; Clemson University, Department of Public Health Sciences Luo, Futian; Sun Yat-sen University, School of Public Health ly on For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 1 of 15 Development of Chinese Version of Hospital Autonomy Questionnaire Zifeng Liu 1,2, Lianxiong Yuan 2, Yixiang Huang 2,3,*, Lingling Zhang4, *, Futian Luo 2 1 Guanghua School of Stomotology, Hospital of Stomatology, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology, 56 Linyuan west Rd, 510055, Guangzhou, China; EMail: sumsliu@hotmail.com 2 School of Public Health, Sun Yat-sen University, 74 Zhongshan 2nd Road, 510080, Guangzhou, China; E-mails: Yixiang Huang, huangyx@mail.sysu.edu.cn; Futian Luo, luoft@mail.sysu.edu.cn 3 Guangdong Health Economics Association, 17 Xianlienan Road, 510060, Guangzhou, China 4 Department of Public Health Sciences, Clemson University, 515 Edwards Hall, Clemson, 296340745, SC, USA; E-Mail: lingliz@clemson.edu rp Fo * Corresponding Authors: huangyx@mail.sysu.edu.cn; lingliz@clemson.edu ee Abstract Objective: We aimed to develop an questionnaire to quantitatively evaluate the autonomy of public hospitals in China. rr Method: An extensive literature review was conducted to select possible items into the questionnaire, ev which was then reviewed by experts. Based on the reviewers’ comments from a pilot, the final ie questionnaire, including 6 subscales and 24 questions, was distributed to 404 secondary and tertiary w hospitals in Guangdong China, and 379 completed questionnaires were collected. Results: Analysis suggests all internal consistency reliabilities exceeded the minimum reliability on standard of 0.70 for alpha coefficient. The overall scale coefficient is 0.88, and six subscale coefficients are 0.92(strategic management), 0.83(budget and expenditure), 0.86 (financing), 0.77 ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open (financing, medical management), 0.85(human resource), and 0.86(accountability), respectively. Correlation coefficients between items and their hypothesized subscales were higher than those with other subscales, except for question 5. The model fit indexes are all acceptable (CMIN/DF=1.62, GFI=0.92, AGFI=0.90, PGFI=0.74, CFI=0.97, RMSEA=0.04). Conclusions: This study demonstrates the reliability and validity of a CVHAQ, and provides a quantitative method to assess the hospital autonomy. Keywords: Hospital Autonomy; Questionnaire; Development; Reliability; Validity; China For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Strengths and limitations of this study This is, to the best of our knowledge, the first study to quantitatively investigate the public hospital autonomy in China. By surveying more than 400 public hospitals, we developed the first version of a hospital autonomy questionnaire, which helps to understand the relationship between public hospital and the government. rp Fo We verified the reliability and validity of our questionnaire, which provided a quantitative method to assess the hospital autonomy in China. The survey was conducted only in Guangdong Province, thus the generalization of the results to other provinces should be with caution. ee This study is a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In the future, panel data are needed to be collected. 1. Introduction ev rr Hospital autonomy is a key issue in health sector reform, which is considered to be an effective ie way to improve the efficiency of public hospitals [1], and this is a particularly important issue in China w as over 80% hospitals are run by the state. Studies on hospital autonomy evaluation have yielded on mixed results. This may be due to small sample sizes and quality of data in these studies, which prevented researchers from conducting more elaborate statistical analyses and reaching robust ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 conclusions. Govindaraj and Chawla [2], using the evaluation toolkit by Chawla et al., carried out five country case studies (Ghana, Kenya, Zimbabwe, India, and Indonesia). However, the results varied by countries, probably because of the short period of time that elapsed since the granting of autonomy. Bossert, et al. measured hospital autonomy in Indonesia, and found little evidence on achieving its objectives [3]. Ssengooda, et al. performed another case study of 8 hospitals in Uganda. Given the nature of the case study, the authors did not think their results should be used as the sole basis for national or international level policy development [4]. In addition, different authors carried out eight For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 2 of 15 Page 3 of 15 BMJ Open country or area case studies (United Kingdom, New Zealand, Australia, Hong Kong, Malaysia, Singapore, Indonesia, and Tunisia) based on Harding and Preker’s conceptual framework on hospital autonomy[5]. Hawkins and Ham summarized these studies and found that autonomization might improve efficiency in some areas, but not in others [6]. McPake et al. made a positive conclusion by studying five hospitals in Bogotá, Colombia [7], while Aamir Saeed, et al. studied the autonomization in teaching hospitals of Punjab, and found that hospital autonomization has not yet yielded hoped-for benefits [8]. London investigated impacts of hospital autonomization in Viet Nam and also found rp Fo mixed results, mainly due to the small sample size and data constraint [9]. Therefore, there’s an urgent need to develop a new evaluation tool which can be used to quantify the extent of hospital autonomy. In China, public hospitals play a critical role in the healthcare system. According to the China Health Statistics Yearbook (2014), they provide medical services to 89.5% population, and the ee proportion of spending in public hospitals is 95.5% of the total national health expenditure in China. rr Currently, public hospitals are considered as less efficient and a serious financial burden to the government [10]. In order to address these problems, China has granted autonomy to some public ev hospitals since the early 1980s, including shifting partial decision-making control from the government ie to hospital managers, which allowed public hospitals to earn profit from medical services they provided. However, after more than 20 years, some research suggested that healthcare reform in China w has not made significant progress [11]. In 2012, China’s State Council announced a new phase of on health care reform with the allowance of more private hospitals and better public hospital autonomy such as the separation of hospital operation from the administrative order to improve efficiency [12]. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com The objective of this study was to develop a Chinese version of a hospital autonomy questionnaire (CVHAQ), which can be used to evaluate the current effort of hospital autonomy, which will help policy makers better understand the extent of policy implementation and formulate specific policies to redefine the relationship between health authorities and hospitals. 2. Experimental Section Theoretical model and questionnaire development For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open A systematic approach was used to generate a 32-item questionnaire [13-14]. The development of items for inclusion in the CVHAQ was carried out in five phases. First, an extensive literature review was conducted to select possible subscales for the questionnaire. The theoretical basis on hospital autonomy used the conceptual framework from Harding and Preker [6], which contained five subscales: 1) decision rights; 2) residual claimant; 3) market exposure; 4) accountability; 5) social functions. Based on three related measuring tools, the subscale of decision rights was refined and 9 subscales were created to evaluate the extent of Chinese hospital autonomy, which were strategic rp Fo management, budget and expenditure, finance, human resource, day-to-day management, residual claimant, market exposure, accountability, and social functions. Second, a large number of potential sub-items were developed under each subscale. Third, a group of experts in law, hospital management, government, and statistics were invited to discuss relevant items for inclusion or exclusion. Fourth, a ee pilot survey was performed to assess the reliability and validity of the questionnaire. Fifth, based on rr the findings of the pilot, three subscales were removed from the questionnaire. After some necessary linguistic revisions, the questionnaire, including 6 subscales (24 items) as indicators of Chinese ev hospital autonomy, was finalized and used to build a Chinese hospital autonomy model in this study. ie The questions mainly examine the extent to which the surveyed hospitals were affected by the government in the year of 2013. Responses were rated on a 5-point Likert scale for hospital autonomy w (1 = totally constrained, 2 = very constrained, 3 = partly constrained, 4 = little constrained, 5 = no on constrained). Items were forward scored on a 1-5 point (1=1, 2=2, 3=3, 4=4, 5=5), and subscale scores were computed as the sum of each item score. That is, the higher scores indicate higher autonomy. Data collection ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 The survey process consisted of two parts. Firstly, an electronic version of the questionnaire was sent to 404 secondary and tertiary hospitals in Guangdong province with the support of the Health Bureau of Guangdong province. Secondly, senior management staff of these hospitals were contacted and asked to organize persons familiar with these issues to fill in the questionnaire. Then the completed questionnaires were collected by the research team who were responsible for answering questions and conducting quality control. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 4 of 15 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 5 of 15 Data analysis SPSS 19.0 for Windows was used for data analysis. First, Cronbach’s alpha coefficients were calculated to evaluate the internal consistency reliability of the total questionnaire and each subscale. Cronbach’s alpha coefficient ≧0.70 was considered as acceptable. Second, multi-trait scaling analysis (using Pearson correlation analysis) was conducted to determine the item-subscale correlations. If he analysis shows a stronger correlation (correlation coefficient ≧0.70) between an item and its hypothesized subscale and that the coefficient is larger than those with other subscales, the rp Fo questionnaire is considered as well defined. In order to test the structure of CVHAQ, an exploratory factor analysis was conducted and the extracted factors were rotated to simple structure using the Varimax procedure (orthogonal rotation) to see if the result would be consistent with the theoretical model. Varimax rotation can enhance the interpretability of the factors with high loadings on a factor. ee Then a confirmatory factor analysis was performed based on structure equation model with AMOS rr 19.0 to assess the fitness of our modified theory model. The fit index of χ2/df (<2), GFI (>0.90), AGFI(>0.90), NNFI(>0.90), CFI(>0.90), RMSEA(<0.05), and SRMR(<0.08) were used to assess the ev fitness of the model. Missing item values from individual surveys were imputed with the mean value[15]. 3. Results and Discussion on Respondent Groups w ie 379 questionnaires were collected in this study. The response rate was 93.81%. The percentage of ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open missing value for each item of the subscale varied from 0.00% to 3.63%. The mean scores and standard deviations for the 6 subscales and 24 items were presented in Table 1. Reliability Cronbach’s alpha coefficient was presented in Table 1. All internal consistency reliabilities exceeded the minimum reliability standard of 0.70. Among which the overall scale coefficient was 0.88, and 6 subscale coefficients were 0.92 (strategic management), 0.83(budget and expenditure), For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open 0.86 (financing), 0.77 (financing, medical management), 0.85 (human resource), and 0.86 (accountability), respectively. Table 1: CVHAQ Reliability for questionnaire and subscales Scale/Item overall scale Subscale 1:strategic management Q1:The extent of your hospital to develop a vision and purpose constrained by government departments Q2:The extent of your hospital's development goals constrained by government departments Q3:The extent of your hospital to develop a short-term development plan constrained by government departments Q4:The extent of the hospital to develop a long-term development plan constrained by government departments? Subscale 2: budget and expenditure Q5:The extent of your hospital to set up financial budget constrained by government departments? Q6:The extent of your hospital's drug procurement constrained by government departments? Q7:The extent of your hospital's equipment procurement constrained by government departments Q8:Except drugs and equipments, the extent of your hospital's other spending constrained by government departments Subscale 3: financing Q9:The extent of your hospital's short-term liabilities constrained by government departments Q10:The extent of your hospital's long-term liabilities constrained by government departments Q11:The extent of your hospital's Other liabilities (finance leases, bills, etc.) constrained by government departments Q12:The degree of your hospital accept donations intervention by the government departments Subscale 4: day-to-day management Q13:The degree of your hospital medical business management direct intervention by the government departments Q14:The degree of your hospital logistics service management direct intervention by the government departments Q15:The degree of your hospital carry convenience services direct intervention by the government departments Q16:The degree of your hospital acting style construction w ie ev rr ee rp Fo Cronbach's Alpha 0.88 73.21 12.97 0.92 11.97 3.57 mean std 3.05 1.11 2.95 0.95 3.08 0.93 2.87 0.98 9.55 3.33 2.71 1.13 1.94 1.08 2.09 0.97 2.80 0.90 11.25 4.22 2.94 0.83 0.86 1.22 on 2.61 1.26 2.63 1.33 3.08 1.23 ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 12.38 2.96 3.04 0.95 3.52 0.89 3.29 0.96 2.52 1.03 0.77 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 6 of 15 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 7 of 15 direct intervention by the government departments 11.54 3.47 Subscale 5: human resource Q17:The extent of your hospital recruiting employees 2.67 1.03 constrained by government departments Q18:The extent of your hospital staff rewards and 3.29 0.98 punishment constrained by government departments Q19:The extent of your hospital employee's salary 2.7 1.05 constrained by government departments Q20:The extent of your hospital dismissed employees 2.87 1.12 constrained by government departments 16.32 2.94 Subscale 6: accountability Q21:Whether the purpose of the inspection which the 4.22 0.88 government departments set for your hospital are clear Q22:Whether the assessment indicators which the 4.07 0.98 government departments set for your hospital are clear Q23:Whether the assessment indicators which the government departments set for your hospital are 3.69 0.90 reasonable Q24:The degree of recognition of government departments 4.34 0.73 inspection result to your hospital 0.85 0.86 Item-subscale correlations ev rr ee rp Fo Pearson correlation coefficients between subscales and its items were presented in Table 2. The results showed that items had higher correlation coefficients with its theoretical subscale than other ie subscales. w Table 2: Item-subscale correlations of CVHAQ subscale2 0.36 0.36 0.36 0.39 0.79 0.79 0.86 0.82 0.56 0.55 0.53 0.46 0.37 0.32 0.24 subscale3 subscale4 subscale5 subscale6 0.21 0.35 0.22 -0.04 0.22 0.32 0.26 0.06 0.24 0.36 0.22 0.07 0.21 0.34 0.24 0.08 0.56 0.31 0.39 -0.03 0.41 0.32 0.32 -0.02 0.52 0.33 0.46 -0.04 0.55 0.33 0.37 0.01 0.32 0.32 0.02 0.84 0.30 0.29 0.05 0.88 0.28 0.31 0.01 0.87 0.32 0.26 0.01 0.71 0.37 0.31 -0.02 0.82 0.28 0.24 0.08 0.70 0.14 0.20 0.04 0.78 ly Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Q11 Q12 Q13 Q14 Q15 subscale1 0.85 0.94 0.90 0.92 0.33 0.31 0.35 0.28 0.20 0.16 0.20 0.26 0.32 0.19 0.33 on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Q16 Q17 Q18 Q19 Q20 Q21 Q22 Q23 Q24 0.30 0.24 0.30 0.17 0.17 0.03 0.03 0.07 0.07 0.29 0.40 0.42 0.42 0.33 -0.06 -0.05 0.00 -0.02 0.27 0.27 0.31 0.32 0.24 -0.02 -0.03 -0.01 0.00 0.74 0.32 0.35 0.28 0.26 0.03 0.03 0.03 0.01 0.35 0.80 0.81 0.86 0.86 -0.01 -0.06 0.05 -0.03 0.01 0.04 -0.05 -0.04 -0.01 0.86 0.89 0.86 0.75 Factor analysis and model evaluation rp Fo To test the validity of the hypothesis, the exploratory factor analysis with Varimax factor rotation was conducted, and 6 components were extracted, which accounted for 70.63% of the total variance. Results were presented in Table 3. The results were consistent with the study hypothesis, except that Q5 had a little higher factor loading to subscale3 than to subscale2, which we think more suitable for ee scale2 according to its content (budget related). In addition, the fitness of the theory model to hospital autonomy were presented in Table 4. rr Table 3: Exploratory factor analysis with Varimax factor rotation subscale2 subscale3 subscale4 subscale5 subscale6 0.52 ly 0.50 0.85 0.84 0.84 0.64 on 0.43 0.82 0.74 0.60 w ie Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 Q19 Q20 subscale1 0.81 0.92 0.87 0.89 ev 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 0.79 0.69 0.78 0.65 0.74 0.74 0.82 0.86 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 8 of 15 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 9 of 15 Q21 Q22 Q23 Q24 0.87 0.88 0.86 0.75 Note. Only factor loadings of 0.40 or greater are reported. Total variance explained=70.63%. Table 4: fitness of fit of CVHAQ χ2/df GFI AGFI NNFI CFI RMSEA(95%CI) SRMR 1.62 0.92 0.90 0.96 0.97 0.04(0.03,0.05) 0.07 rp Fo Note. χ2 =Minimum Fit Function Chi-square; df = degree of freedom; RMSEA = Root Mean Square Error of Approximation; CI = Confidence Interval; CFI = Comparative Fit Index; NNFI = Non-Normed Fit Index; AGFI = Adjusted Goodness of Fit Index; SRMR = Standardized Root Mean Square Residual. Discussion ee In this study, the hospital autonomy survey was modified to adapt to Chinese health policiesand rr the CVHAQ was developed based on Harding and Preker’s conceptual framework on hospital ev autonomy and learning from previous experience of case studies. The reliability and factor structure of CVHAQ were assessed. Results of this study showed that the CVHAQ was a reliable and valid ie questionnaire to measure hospital autonomy. The confirmatory factor analysis confirmed the w theoretical model, which reflected the extent of hospital autonomy. The higher scores the hospitals had, the more autonomy the hospitals have. In the pilot survey, no significant variance was identified on in the following three subscales: residual claimant, market exposure, and social functions. Under the ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open current Chinese health policies, almost all secondary and tertiary hospitals can earn profit from medical services they provide, so that there is little variance of residual claimant and market exposure between sample hospitals that could be captured by the questionnaire. Social function is a complementary reform to ensure that services, which were previously cross-subsidized, continue to be delivered, and does not belong to the scope of hospital autonomy. The six theoretical subscales included in the final CVHAQ well reflected the status of hospital autonomization, which explained a large amount of the variance (>70%). The internal consistency reliability of the questionnaire was For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open evaluated by Cronbach’s alpha coefficients. All Cronbach’s alpha coefficients exceeded the recommended standard of 0.70, indicating adequate reliability of CVHAQ. Results of confirmatory factor analysis showed that all indicators of fitness were acceptable [16-18]. This study showed that the subscale2 and subscale3 were correlated( r=0.71), which can be explained by the fact that the autonomy of the two subscales commonly depends on the economic policy for a hospital which is set by the government, thus the finance, budget, and expenditure are synergistically affected Subscale5 and subscale2 were also correlated(r=0.55). The underlying reason could be that Chinese government rp Fo spent little on human resources, and the cost was borne by the hospital [19-20]. Characteristics of local hospitals in Guangdong made it very suitable for conducting this large scale quantitative study. China traditionally managed its public hospitals as administrative units. However, in the past 30 years, Chinese government has been reforming its health system by reducing ee the health department’s direct control on public hospitals and shifting the day-to-day decision making rr from the government authority to hospital managers in order to reduce the government’s financial burden and improve hospitals’ efficiency [21]. Guangdong, the frontier of China’s economic reform, ev has about 400 secondary and tertiary public hospitals. They are divided into national hospitals, ie provincial hospitals and municipal or county hospitals. Because of different amount of government inputs and degree of decentralization, these hospitals vary greatly in autonomy, which created a unique w opportunity for conducting this study in Guangdong. In addition, this study was supported by the on Health Bureau of Guangdong Province, which resulted in a higher response rate of local hospitals. This really helped overcome the issues of small sample size and data constraint existed in previous studies. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Page 10 of 15 Although many studies have been conducted on hospital autonomization, there is little quantitative study. Most previous studies were based on case study, and the results were subject to potential confounding factors, such as hospital size, management style, and geographic location, etc [22]. Empirical literature to date has done little to explore a hospital autonomy questionnaire to quantify the extent of hospital autonomy. The CVHAQ developed in this helped fill this gap in published literature and provided a validated tool that can help overcome these shortcomings to draw reliable conclusions. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 11 of 15 In addition, the CVHAQ would lay a strong foundation for quantitatively analyzing the relationship between hospital autonomy and its effect on healthcare reform. For example, a regression analysis can be done to explore the relationship between hospital autonomy and efficiency by using the hospital autonomy scores as independent. Some limitations must be mentioned regarding our findings. The survey was conducted only in Guangdong Province, thus the generalization of the results to other provinces should be with caution. In our future study, we will investigate hospital autonomy in other provinces in China to further rp Fo validate our questionnaire. In addition, we conducted a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In future studies, we plan to collect panel data to monitor hospital autonomy and explore the relationship between hospital autonomy and efficiency in order to provide decision basis for China’s health care reform. rr 4. Conclusions ee This study demonstrated the reliability and validity of a Chinese version of a hospital autonomy ev questionnaire, and provided a quantitative method to assess the hospital autonomy in China. Acknowledgments ie We thank Qiumao Cai, Lina Yu and Chunxiao Wang at the Health Department of Guangdong w Province for their assistance. This research was funded by the Guangdong Medical Fundation of China (C2013016). Author Contributions ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open ZFL, FTL and YXH obtained the funding. ZFL, YXH and LLZ conceived the idea and the designed the study. ZFL, LXY collected and cleaned the data. ZFL, YXH and LLZ draft the manuscript. All authors critically revised the manuscript for important intellectual content. All authors read and approved the final version of the manuscript. Conflicts of Interest The authors declare no conflict of interest. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Data sharing statement Consent was not obtained but the presented data are anonymised and risk of identification is low. References 1. Walford, V; Grant, K. Health Sector Reform: Improving Hospital Efficiency. Health Systems Resource Centre, London, United Kingdom of England,1998; pp.34-40. 2. Govindaraj, R.; Chawla, M. Recent Experiences with Hospital Autonomy in Developing Countries —What Can We Learn? Harvard School of Public Health, , United States of America, 1996; pp. 1-66. 3. Bossert, T.; Kosen, S.; Harsono, B.; Gani, A. Hospital Autonomy in Indonesia,; Harvard School of rp Fo Public Health, United States of America, 1997; pp. 1-38. 4. Ssengooba, F.; Atuyambe, L.; McPake, B.; Hanson, K.; Okuonzi, S. What could be achieved with greater public hospital autonomy? Comparison of public and PNFP hospitals in Uganda. Public Administration and Development 2002, 22, 415-428. ee 5. Harding, April L; Preker, Alexander S. Understanding Organizational Reforms: The Corporatization of Public Hospitals, The World Bank, Washington, DC, United States of America, 2000; pp. 1-29. 6. Harding, April L; Preker, Alexander S. Innovations in Health Care Delivery: the Corporatization of rr Public Hospitals.The World Bank, Washington, DC, United States of America, 2003; pp.79-104. 7. McPake, B.; Yepes, F. J.; Lake, S.; Sanchez, L. H. Is the Colombian health system reform ev improving the performance of public hospitals in Bogota? Health Policy and Planning 2003, 18, 182194. ie 8. Saleem M.; Saeed A.; Ahmad S.; Ch A.Q. Measuring Extent of Autonomy in Teaching Hospitals of w Punjab: A Case of Services Hospital, Lahore. European Journal of Business and Management 2013, 5, 83-90. on 9. London, J. D. The promises and perils of hospital autonomy Reform by decree in Viet Nam. Social Science & Medicine 2013, 96, 232-240. 10. Bank, W. Fixing the public hospital system in China. Washington, DC: World Bank. Available ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 online: http://documents.worldbank.org/curated/en/2010/06/13240557/fixing-public-hospital-systemchina-vol-2-2-main-report. (assessed on 8 September 2015). 11. Yanfeng, G. Evaluation and suggestion on China medical health system reform (Summary and emphasis). China Health Policy 2005, A01, 1-14. 12. Hipgrave D.; Guo S.; Mu Y.; Guo Y.; Yan F.; et al. Chinese-style decentralization and health system reform. PLoS Medicine 2012, 9, e1001337. 13. KELLEY, K. Good practice in the conduct and reporting of survey research. International Journal for Quality in Health Care 2003, 15, 261-266. 14. Burns KE, Duffett M, Kho ME, Meade MO, Adhikari NK, Sinuff T, Cook DJ; ACCADEMY For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 12 of 15 Page 13 of 15 BMJ Open Group. A guide for the design and conduct of self-administered surveys of clinicians. Canadian Medical Association Journal. 2008;179(3):245-52 15. Wagstaff, A; Sarah, B. The Impacts of Public Hospital Autonomization: Evidence from a QuasiNatural Experiment: The World Bank, Washington, DC, United States of America, 2012; pp.30-44. 16. Steiger J.H. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 1990, 25, 173-180. 17. Hu L.; Peter B. Fit Indices in Covariance Structure Modeling: Sensitivity to Underparameterized Model Misspecification. Psychological Methods 1998, 3, 424-453. 18. McDonald R.P.; Marsh. Choosing a Multivariate Model: Noncentrality and Goodness of Fit. rp Fo Psychological Bulletin 1990, 107, 247-255. 19. Hu S.; Tang S.; Liu Y.; Zhao Y.; Escobar M.L.; et al. Reform of how health care is paid for in China: challenges and opportunities. The Lancet 2008, 372, 1846-1853. 20. Allen, P.; Cao, Q.; Wang, H. Public hospital autonomy in China in an international context. The International Journal of Health Planning and Management, 2014, 29, 141-159. ee 21. Yip, W.; Hsiao, W. China's health care reform: A tentative assessment. China Economic Review 2009, 20, 613-619. rr 22. Saunders J.A.; Morrow-Howell N.; Spitznagel E.; Dore P.; Proctor E.K.; et al. Imputing Missing Data: A Comparison of Methods for Social Work Researchers. Social Work Research 2006, 30, 19-31. w ie ev ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml BMJ Open STROBE 2007 (v4) checklist of items to be included in reports of observational studies in epidemiology* Checklist for cohort, case-control, and cross-sectional studies (combined) Section/Topic Title and abstract Item # 1 Recommendation (a) Indicate the study’s design with a commonly used term in the title or the abstract Reported on page # 1 Fo (b) Provide in the abstract an informative and balanced summary of what was done and what was found Introduction Background/rationale 2 Objectives rp 1 Explain the scientific background and rationale for the investigation being reported 2 3 State specific objectives, including any pre-specified hypotheses 3 Methods Study design 4 Present key elements of study design early in the paper 4 Setting 5 4 Participants 6 Describe the setting, locations, and relevant dates, including periods of recruitment, exposure, follow-up, and data collection (a) Cohort study—Give the eligibility criteria, and the sources and methods of selection of participants. Describe methods of follow-up Case-control study—Give the eligibility criteria, and the sources and methods of case ascertainment and control selection. Give the rationale for the choice of cases and controls Cross-sectional study—Give the eligibility criteria, and the sources and methods of selection of participants Variables 7 Data sources/ measurement 8* Bias ee rr ev iew (b) Cohort study—For matched studies, give matching criteria and number of exposed and unexposed Case-control study—For matched studies, give matching criteria and the number of controls per case Clearly define all outcomes, exposures, predictors, potential confounders, and effect modifiers. Give diagnostic criteria, if applicable on 4 4 9 For each variable of interest, give sources of data and details of methods of assessment (measurement). Describe comparability of assessment methods if there is more than one group Describe any efforts to address potential sources of bias 4 Study size 10 Explain how the study size was arrived at 4 Quantitative variables 11 Statistical methods 12 Explain how quantitative variables were handled in the analyses. If applicable, describe which groupings were chosen and why (a) Describe all statistical methods, including those used to control for confounding 5 (b) Describe any methods used to examine subgroups and interactions 5 (c) Explain how missing data were addressed 5 ly (d) Cohort study—If applicable, explain how loss to follow-up was addressed Case-control study—If applicable, explain how matching of cases and controls was addressed For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml 4 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 Page 14 of 15 Page 15 of 15 Cross-sectional study—If applicable, describe analytical methods taking account of sampling strategy 5 (e) Describe any sensitivity analyses Results Participants 13* (a) Report numbers of individuals at each stage of study—eg numbers potentially eligible, examined for eligibility, confirmed eligible, included in the study, completing follow-up, and analysed (b) Give reasons for non-participation at each stage Fo (c) Consider use of a flow diagram Descriptive data 14* rp (a) Give characteristics of study participants (eg demographic, clinical, social) and information on exposures and potential confounders (b) Indicate number of participants with missing data for each variable of interest ee (c) Cohort study—Summarise follow-up time (eg, average and total amount) Outcome data 15* Cohort study—Report numbers of outcome events or summary measures over time rr Case-control study—Report numbers in each exposure category, or summary measures of exposure Main results 16 Cross-sectional study—Report numbers of outcome events or summary measures 5 (a) Give unadjusted estimates and, if applicable, confounder-adjusted estimates and their precision (eg, 95% confidence interval). Make clear which confounders were adjusted for and why they were included (b) Report category boundaries when continuous variables were categorized 9 ev iew (c) If relevant, consider translating estimates of relative risk into absolute risk for a meaningful time period Other analyses 17 Report other analyses done—eg analyses of subgroups and interactions, and sensitivity analyses Key results 18 Summarise key results with reference to study objectives Limitations 19 11 Interpretation 20 Generalisability 21 Discuss limitations of the study, taking into account sources of potential bias or imprecision. Discuss both direction and magnitude of any potential bias Give a cautious overall interpretation of results considering objectives, limitations, multiplicity of analyses, results from similar studies, and other relevant evidence Discuss the generalisability (external validity) of the study results Give the source of funding and the role of the funders for the present study and, if applicable, for the original study on which the present article is based 11 Discussion Other information Funding 22 on 6-8 9-10 ly 11 11 *Give information separately for cases and controls in case-control studies and, if applicable, for exposed and unexposed groups in cohort and cross-sectional studies. Note: An Explanation and Elaboration article discusses each checklist item and gives methodological background and published examples of transparent reporting. The STROBE checklist is best used in conjunction with this article (freely available on the Web sites of PLoS Medicine at http://www.plosmedicine.org/, Annals of Internal Medicine at http://www.annals.org/, and Epidemiology at http://www.epidem.com/). Information on the STROBE Initiative is available at www.strobe-statement.org. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 BMJ Open Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Development of Chinese Version of Hospital Autonomy Questionnaire: a Cross-sectional Study in Guangdong Province rp Fo Journal: Manuscript ID Article Type: Date Submitted by the Author: Complete List of Authors: BMJ Open bmjopen-2015-010504.R1 Research 14-Jan-2016 Secondary Subject Heading: Medical management ie Keywords: Health policy ev <b>Primary Subject Heading</b>: rr ee Liu, Zifeng; Sun Yat-sen University, Guanghua School of Stomotology, Hospital of Stomatology; Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology Yuan, Lianxiong; Sun Yat-sen University, School of Public Health Huang, Yixiang; Sun Yat-sen University, School of Public Health; Guangdong Health Economics Association Zhang, Lingling; Clemson University, Department of Public Health Sciences Luo, Futian; Sun Yat-sen University, School of Public Health w HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Health policy < HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Organisational development < HEALTH SERVICES ADMINISTRATION & MANAGEMENT ly on For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 1 of 21 Development of Chinese Version of Hospital Autonomy Questionnaire: a Cross-sectional Study in Guangdong Province ZifengLiu1,2, LianxiongYuan2, Yixiang Huang2,3,*, Lingling Zhang4,*, FutianLuo2 1 Guanghua School of Stomotology, Hospital of Stomatology, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology, 56 Lingyuan west Rd,510055, Guangzhou, China; EMail: sumsliu@hotmail.com 2 School of Public Health, Sun Yat-sen University, 74 Zhongshan 2nd Road, 510080, Guangzhou, China; E-mails: Yixiang Huang, huangyx@mail.sysu.edu.cn; Futian Luo, luoft@mail.sysu.edu.cn 3 Guangdong Health Economics Association, 17 Xianlienan Road, 510060, Guangzhou, China 4 Department of Public Health Sciences, Clemson University, 515 Edwards Hall, Clemson, 296340745, SC, USA; E-Mail: lingliz@clemson.edu ee rp Fo * Corresponding Authors: huangyx@mail.sysu.edu.cn;lingliz@clemson.edu rr Abstract ev Objective: We aimed to develop a questionnaire to quantitatively evaluate the autonomy of public hospitals in China. ie Method: An extensive literature review was conducted to select possible items included into the w questionnaire, which was then reviewed by five experts. After a two-round Delphi method, we on distributed the questionnaire to 404 secondary and tertiary hospitals in Guangdong Province, China, ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open and 379 completed questionnaires were collected. The final questionnaire was then developed on the basis of the results of both exploratory factor analysis and confirmatory factor analysis. Results: Analysis suggests all internal consistency reliabilities exceeded the minimum reliability standard of 0.70 for alpha coefficient. The overall scale coefficient is 0.87, and six subscale coefficients are 0.92(strategic management), 0.81(budget and expenditure), 0.85 (financing), 0.75 (financing, medical management), 0.86(human resource), and 0.86(accountability), respectively. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Correlation coefficients between items and their hypothesized subscales were higher than those with other subscales, except for question 5. The model fit indexes are all acceptable (χ2/DF=1.73, GFI=0.93, AGFI=0.91, NNFI=0.96, CFI=0.97, RMSEA=0.04, SRMR=0.07). Conclusions: This study demonstrates the reliability and validity of a Chinese version of hospital autonomy questionnaire, and provides a quantitative method to assess the hospital autonomy. Keywords: Hospital Autonomy; Questionnaire; Development; Reliability; Validity; China rp Fo Strengths and limitations of this study ee This is, to the best of our knowledge, the first study to quantitatively investigate the public hospital autonomy in China. rr By surveying more than 400 public hospitals, we developed the first version of a hospital ev autonomy questionnaire, which helps to understand the relationship between public hospital and the ie government. w We verified the reliability and validity of our questionnaire, which provided a quantitative method to assess the hospital autonomy in China. on The survey was conducted only in Guangdong Province, thus the generalization of the results to other provinces should be with caution. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 This study is a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In the future, panel data needs to be collected. 1. Introduction For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 2 of 21 Page 3 of 21 BMJ Open In developing countries, public hospitals are normally characterized by inefficient resource management low productivity for their rigid hierarchical structures, and ineffective administrative and financial controls by the government1. Turning public hospitals into autonomous entities is thought to be able to improve their performance2. In China, because over 80% hospitals are run by the state3, enlarging public hospital autonomy, which is also considered to be an effective way to improve the efficiency of public hospitals, is a key issue in health sector reform4, and this is a particularly important rp Fo issue in China. Studies on hospital autonomy evaluation have also yielded mixed results in other countries. Govindaraj and Chawla5, using the evaluation toolkit by Chawla et al., carried out five country case studies (Ghana, Kenya, Zimbabwe, India, and Indonesia). However, the results varied by ee country, probably because of the short period of time that elapsed since the granting of autonomy. rr Bossert, et al. measured hospital autonomy in Indonesia and found little evidence on achieving its ev objectives6. Ssengooda, et al. performed another case study of 8 hospitals in Uganda. Given the nature of the case study, the authors did not think their results should be used as the sole basis for national or ie international level policy development7. In addition, different authors carried out eight country or area w case studies (United Kingdom, New Zealand, Australia, Hong Kong, Malaysia, Singapore, Indonesia, on and Tunisia) based on Harding and Preker’s conceptual framework on hospital autonomy8. Hawkins and Ham summarized these studies and found that autonomization might improve efficiency in some ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com areas, but not in others9. McPake et al. made a positive conclusion by studying five hospitals in Bogotá, Colombia10, while AamirSaeed, et al. studied the autonomization in teaching hospitals of Punjab, and found that hospital autonomization has not yet yielded hoped-for benefits11. London investigated impacts of hospital autonomization in Vietnam and also found mixed results, mainly due to the small sample size and data constraints12. Some researchers attributed the mixed results to small For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open sample sizes and quality of data in these studies, which prevented researchers from conducting more elaborate statistical analyses and reaching robust conclusions2. In China, public hospitals play a critical role in the healthcare system. According to the China Health Statistics Yearbook (2015)3, they provide medical services to 89.5% population, and the proportion of spending in public hospitals is 95.5% of the total national health expenditure in China. Currently, public hospitals are considered less efficient and a serious financial burden to the rp Fo government13. In order to address these problems, China has granted autonomy to some public hospitals since the early 1980s, including shifting partial decision-making control from the government to hospital managers, which has allowed public hospitals to earn profit from medical services they ee have provided. However, after more than 20 years, some research suggests that health care reform in rr China has not made significant progress14. In 2012, China’s State Council announced a new phase of ev health care reform with the allowance of more private hospitals and greater public hospital autonomy to improve efficiency15. Therefore, studying the impact of hospital autonomy on efficiency is ie important, and developing an effective tool for measuring the public hospital autonomy will be the first w problem. With the Chinese government’s support and enough sample hospitals in Guangdong province, on we carried out this study. The objective of this study was to develop a Chinese version of hospital autonomy questionnaire(CVHAQ), which can be used to evaluate the level of hospital autonomy, ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 help policy makers better understand the extent of policy implementation and formulate specific policies to redefine the relationship between health authorities and hospitals. 2. Experimental Section Theoretical model and questionnaire development For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 4 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 5 of 21 Although many researchers have proposed evaluation tools for hospital autonomy, there are three generic tools, namely Chawla et al. (1996), Over and Watanabe (2003), and Harding and Preker (2003)2. The Chawla et al. (1996) tool proposes three key areas to analyze the existing level of autonomy: administration, financing and inputs. The Over and Watanabe (2003) tool considers five elements of hospital structure: residual claimant status, decision right, degree of market exposure, availability of accountability mechanisms and extent of unfunded mandates. The Harding and Preker (2003) tool proposes the five dimensions to analyze the extent rp Fo of hospital autonomy: decision right, market exposure, residual claimant, accountability and social functions. We modified the three existing tools to develop the Chinese version of hospital autonomy questionnaire. rr ee 16-17 Figure 1: Flowchart of Questionnaire Development16- ev A systematic approach was used to generate the final questionnaire16-17. The development of items ie for inclusion in the CVHAQ was carried out in five phases. First, an extensive literature review was w conducted to select possible subscales for the questionnaire. The theoretical basis on hospital on autonomy was the conceptual framework from Harding and Preker, which contained five subscales: 1) decision rights, 2) residual claimant, 3) market exposure, 4) accountability, 5) social functions8. At the ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open same time, we also learned from the other two related measuring tools, and 9 subscales were created to evaluate the extent of Chinese hospital autonomy: strategic management, budget and expenditure, finance, human resource, day-to-day management, residual claimant, market exposure, accountability, and social functions. Second, after in-depth interviews and focus-group sessions,40 potential sub-items were developed. Third, ten carefully selected experts, including two lawyers, four hospital management experts, two government officers, and two professors versed in statistics were invited to For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open discuss relevant items for inclusion or exclusion. We used the Delphi method to evaluate the items. The experts gave their scores in term of linguistic expression, importance, clarity, and correlation for each item for two rounds, and then we deleted the items whose importance score was less than 7.5. The questionnaire had then taken its initial shape with 32 items. Fourth, a pilot testing with 26 selected hospitals was conducted to judge the appropriateness of each included question. Fifth, in a formal survey, six undergraduate students were selected as questionnaire interviewers, and two researchers in rp Fo our focus-group were designated as quality controllers. After investigation, we used the method of exploratory factor analysis to screen the items, and finally we deleted 10 items and extracted 6 factors (All loading are acceptable). In order to enhance the interpretability of the factors with high loadings ee on a factor, we rotated the extracted factors to simple structure using the Varimax procedure rr (orthogonal rotation) to see if the result was consistent with our theoretical model. Furthermore, we ev evaluated the reliability of the questionnaire and the Cronbach’s alpha coefficients in all subscales higher than 0.70. After some necessary linguistic revisions, the questionnaire, including 6 subscale ie (22items) indicators of Chinese hospital autonomy, was finalized and used to build a Chinese hospital autonomy model. w on Responses were rated on a 5-point Likert scale for hospital autonomy (1 = totally constrained, 2 = very constrained, 3 = partly constrained, 4 =hardly constrained, 5 = not constrained). Items were ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 forward scored on a 1-5 point (1=1, 2=2, 3=3, 4=4, 5=5), and subscale scores were computed as the sum of each item score. That is, the higher scores indicate higher autonomy. Figure 2: Steps of questionnaire development8 Quality control measures For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 6 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 7 of 21 Item generation The items in this questionnaire were generated through literature reviews, in-depth interviews, and focus-group sessions. Firstly, we reviewed PubMed, and CNKI to collect the pertinent literature. Secondly, we set up a focus group to analyze the pertinent literature and preliminarily determined the subscales of our questionnaire. Finally, the members of the focus group reviewed the potential respondents or experts in-depth. When item generation continues until no new items emerge, we rp Fo established an item pool with 40 items. Then, the Delphi method was used for two rounds. Pilot testing ee The questionnaire was tested for how well respondents comprehend and correctly answer crucial rr questions, or to confirm that the questionnaire is user-friendly for the respondent, and ascertain how long it will take to complete. ie Formal survey ev All of the questionnaire interviewers and quality controllers were systemically trained by the w project investigator(PI) before the investigation. During the investigation, the questionnaire on interviewers were responsible for connecting respondents who were familiar with questions, and reported to the PI regularly. The quality controllers are responsible for checking the integrity and accuracy of the finished questionnaire. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open Data entry Double blind input, consistency check, and logical check was used to control the quality of data entry. Data collection For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open This survey was conducted in 2013, and the data collection process consisted of two parts. First, an electronic version of the questionnaire was sent to 404 secondary and tertiary hospitals in Guangdong province with the support of the Health Bureau of Guangdong province. Second, senior management staff of these hospitals were contacted and asked to organize persons familiar with these issues to fill in the questionnaire. Then the completed questionnaires were collected by the research team. Data analysis rp Fo SPSS 19.0 for Windows was used for data analysis. First, Cronbach’s alpha coefficients were calculated to evaluate the internal consistency reliability of the total questionnaire and each subscale. ee Cronbach’s alpha coefficient ≧0.70 was considered as acceptable. Second, multi-trait scaling analysis rr (using Pearson correlation analysis) was conducted to determine the item-subscale correlations. If the ev analysis shows a stronger correlation (correlation coefficient ≧0.70) between an item and its hypothesized subscale and that the coefficient is larger than those with other subscales, the ie questionnaire is considered as well defined. In order to test the validity of CVHAQ, an exploratory w factor analysis was conducted and the extracted factors were rotated to simple structure using the on Varimax procedure (orthogonal rotation) to see if the result would be consistent with the theoretical model. Varimax rotation can enhance the interpretability of the factors with high loadings on a factor. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 The value of average variance extracted (AVE) and that of construct reliability (C.R.) were calculated to test convergent validity and discriminant validity. Then a confirmatory factor analysis was performed with AMOS 19.0 to assess the fitness of our modified theory model. The fit index ofχ2/df (<2), GFI (>0.90), AGFI (>0.90), NNFI (>0.90), CFI (>0.90), RMSEA (<0.05), and SRMR (<0.08) were used to assess the fitness of the model. Missing item values from individual surveys were imputed with the mean value18. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 8 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 9 of 21 3. Results and Discussion Respondent Groups A total of 379 questionnaires were collected in this study. The characteristics of the participating hospitals are listed in Table 1. The response rate was 93.81%. The percentage of missing value for each item of the subscale varied from 0.00% to 3.63%. Table 1 Characteristics of the participating hospitals rp Fo variables classification grade specialized hospital general hospital secondary tertiary Pearl River Delta (PRD) other areas in Guangdong province location Exploratory factor analysis N % 110 269 293 86 164 215 29.0 71.0 77.3 22.7 43.3 56.7 ev rr ee To test the validity of the hypothesis, the exploratory factor analysis with Varimax factor rotation ie was conducted, and 6 components were extracted, which accounted for 73.05% of the total variance. w Results are presented in Table 2. Table 2: Exploratory factor analysis with Varimax factor rotation subscale1 0.82 Q2 0.92 Q3 0.87 Q4 0.89 subscale3 subscale4 subscale5 subscale6 ly Q1 subscale2 on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open Q5 0.83 Q6 0.73 Q7 0.59 Q8 0.84 Q9 0.84 Q10 0.85 Q11 0.65 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Q12 0.77 Q13 0.79 Q14 0.76 Q15 0.77 Q16 0.76 Q17 0.83 Q18 0.85 Q19 0.86 Q20 0.88 Q21 0.85 Q22 rp Fo 0.76 Note. Only factor loadings of 0.50 or greater are reported. Total variance explained=73.05%. Reliability ee The mean scores, standard deviations, and Cronbach’s alpha coefficient were presented in Table rr 3. All internal consistency reliabilities exceeded the minimum reliability standard of 0.70. Among which the overall scale coefficient was 0.87, and 6 subscale coefficients were 0.92 (strategic ev management), 0.81(budget and expenditure), 0.85(financing), 0.75(financing, medical management), ie 0.86(human resource), and 0.86 (accountability), respectively. w Table 3: CVHAQ Reliability for questionnaire and subscales Scale/Item Subscale1:strategic management Q1:The extent of your hospital to develop a vision and purpose constrained by government departments Q2:The extent of your hospital's development goals constrained by government departments Q3:The extent of your hospital to develop a short-term development plan constrained by government departments Q4:The extent of the hospital to develop a long-term development plan constrained by government departments? Subscale2: budget and expenditure Cronbach's Alpha 67.47 11.68 0.87 mean std ly overall scale on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 11.92 3.53 3.04 1.10 2.94 0.94 3.07 0.92 2.87 0.96 6,80 2,52 0.92 0.81 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 10 of 21 Page 11 of 21 BMJ Open Q5:The extent of your hospital's drug procurement constrained by government departments? Q6:The extent of your hospital's equipment procurement constrained by government departments 1.94 1.08 2.09 0.98 2.78 0.90 11.16 4.20 2.92 1.23 2.59 1.26 2.60 1.32 3.05 1.23 9.83 2.28 3.03 0.95 3.51 0.89 3.28 0.96 11.46 3.54 Q7:Except drugs and equipment, the extent of your hospital's other spending constrained by government departments Subscale3: financing Q8:The extent of your hospital's short-term liabilities constrained by government departments rp Fo Q9:The extent of your hospital's long-term liabilities constrained by government departments Q10:The extent of your hospital's Other liabilities (finance leases, bills, etc.) constrained by government departments Q11:The degree of your hospital accept donations ee intervention by the government departments Subscale4: day-to-day management 0.85 0.75 Q12:The degree of your hospital medical business rr management direct intervention by the government departments ev Q13:The degree of your hospital logistics service management direct intervention by the government departments ie Q14:The degree of your hospital carry convenience w services direct intervention by the government departments Subscale5: human resource Q15:The extent of your hospital recruiting employees constrained by government departments punishment constrained by government departments Q17:The extent of your hospital employee's salary constrained by government departments Q18:The extent of your hospital dismissed employees constrained by government departments Subscale6: accountability Q19:Whether the purpose of the inspection which the government departments set for your hospital are clear Q20:Whether the assessment indicators which the government departments set for your hospital are clear 2.66 1.05 ly Q16:The extent of your hospital staff rewards and 0.86 on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com 3.26 0.99 2.69 1.07 2.85 1.12 16.30 2.95 4.22 0.89 4.06 0.99 0.86 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Q21:Whether the assessment indicators which the government departments set for your hospital are 3.68 0.89 4.34 0.73 reasonable Q22:The degree of recognition of government departments inspection result to your hospital Item-subscale correlations Pearson correlation coefficients between subscales and its items are presented in Table 4. The rp Fo results showed that items had higher correlation coefficients as compared to its theoretical subscale than the other subscales. Table 4: Item-subscale correlations of CVHAQ subscale1 subscale2 Q1 0.86 0.33 0.22 0.32 0.22 -0.04 Q2 0.94 0.33 0.23 0.32 0.27 0.07 Q3 0.90 rr 0.33 0.25 0.37 0.23 0.07 Q4 0.91 0.36 0.21 0.32 0.25 0.07 Q5 0.33 0.86 0.40 0.29 0.31 -0.04 Q6 0.35 0.89 0.55 0.30 0.47 -0.05 Q7 0.28 0.81 0.58 0.34 0.37 0.01 Q8 0.21 0.52 0.87 0.29 0.35 -0.04 Q9 0.18 0.54 0.88 w ee 0.29 0.31 -0.00 Q10 0.19 0.48 0.87 0.24 0.30 -0.06 Q11 0.26 0.43 0.72 0.28 0.27 -0.00 Q12 0.34 0.36 0.37 0.85 0.32 Q13 0.21 0.29 0.28 0.80 Q14 0.34 0.23 0.15 0.80 Q15 0.24 0.38 0.28 Q16 0.31 0.40 Q17 0.19 Q18 subscale3 subscale4 subscale5 subscale6 ie ev -0.03 0.25 0.06 0.22 0.02 0.26 0.81 0.04 0.33 0.34 0.82 -0.05 0.41 0.34 0.27 0.86 -0.01 0.18 0.33 0.28 0.21 0.86 0.01 Q19 0.01 -0.05 -0.03 0.02 0.01 0.86 Q20 0.01 -0.04 -0.06 0.01 -0.05 0.89 Q21 0.07 0.01 0.01 0.02 0.04 0.85 Q22 0.06 -0.04 -0.01 0.01 -0.01 0.75 ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 12 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 13 of 21 Convergent validity and discriminant validity If the value of AVE is higher than 0.5 and the value of C.R. is higher than 0.70, we consider the convergent validity acceptable. In order to test discriminant validity, we calculated the square root of every AVE value belonging to each latent subscale. The outcomes (in Table5) show that the square roots of the AVE of each subscale are larger than the correlation of the specific subscale with any of the other subscales. Table 5 Convergent and discriminant validity for questionnaire and subscales rp Fo Variable AVE strategic C.R. budget and expenditure financing day-to-day management resource management resource 0.76 0.93 0.87 0.58 0.81 0.38 0.76 0.61 0.86 0.25 0.59 0.78 0.51 0.75 0.37 0.33 0.60 0.85 0.27 0.61 0.86 0.04 0.36 accountability 0.71 0.45 0.37 0.32 0.77 -0.04 -0.03 0.02 0.00 ie accountability human ev human expenditure rr management day-to-day financing management strategic budget and ee 0.78 Note: on the diagonal we insert the square roots of every AVE value in order to compare it with the other correlation coefficients. w Confirmatory factor analysis on We use AMOS19.0 to conduct confirmatory factor analysis, and 7 indicators were calculated to test the fitness of our theory model. The results were presented in Table 6. Table 6: fitness of fit of CVHAQ ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open χ2/df GFI AGFI NNFI CFI RMSEA(95%CI) SRMR 1.73 0.93 0.91 0.96 0.97 0.04(0.03,0.05) 0.07 Note. χ2 =Minimum Fit Function Chi-square; df= degree of freedom; RMSEA = Root Mean Square Error of Approximation; CI = Confidence Interval; CFI = Comparative Fit Index; NNFI = Non-Normed Fit Index; AGFI = Adjusted Goodness of Fit Index; SRMR = Standardized Root Mean Square Residual. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Discussion In this study, the hospital autonomy survey was modified to adapt to Chinese health policies and the CVHAQ was developed based on Harding and Preker’s conceptual framework on hospital autonomy and also learning from the Chawla et al. (1996) tool and Over and Watanabe(2003) tool. The reliability and factor structure of CVHAQ were assessed. Results of this study showed that the CVHAQ was a reliable and valid questionnaire to measure hospital autonomy. The confirmatory factor rp Fo analysis confirmed the theoretical model, which reflected the extent of hospital autonomy. The higher scores the hospitals had, the more autonomy they had. According to Chinese Health Statistics Report (2015)3, and government fiscal budgets provide about 7 percent of total revenue for public hospitals. ee Almost all secondary and tertiary hospitals have to earn profit from medical services they provide, so rr that there is little variance of residual claimant and market exposure between sample hospitals that ev could be captured by the questionnaire. Social function is a complementary reform to ensure that services, which were previously cross-subsidized, continue to be delivered, and does not belong to the ie scope of hospital autonomy. The six theoretical subscales included in the final CVHAQ well reflected w the status of hospital autonomization. Results of confirmatory factor analysis showed that all indicators on of fitness were acceptable19-21. This study showed that the subscale2 and subscale3 were correlated( r=0.59), which can be explained by the fact that the autonomy of the two subscales commonly depends ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Page 14 of 21 on the economic policy for a hospital which is set by the government, thus the finance, budget, and expenditure are synergistically affected Subscale5 and subscale2 were also correlated(r=0.45). The underlying reason could be that Chinese government spent little on human resources and the cost was borne by the hospital22-23. Characteristics of local hospitals in Guangdong made it very suitable for conducting this large scale quantitative study. China traditionally managed its public hospitals as administrative units. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 15 of 21 BMJ Open However, in the past 30 years, Chinese government has been reforming its health system by reducing the health department’s direct control on public hospitals and shifting the day-to-day decision making from the government authority to hospital managers in order to reduce the government’s financial burden and improve hospitals’ efficiency24. Guangdong, the frontier of China’s economic reform, has more than 400 secondary and tertiary public hospitals. They are divided into national hospitals, provincial hospitals and municipal or county hospitals. Because of different amount of government rp Fo inputs and degree of decentralization, these hospitals vary greatly in autonomy, which created a unique opportunity for conducting this study in Guangdong. In addition, this study was supported by the Health Bureau of Guangdong Province, which resulted in a higher response rate of local hospitals. This ee really helped overcome the issues of small sample size and data constraint existing in previous studies. rr Although many studies have been conducted on hospital autonomization, a small amount of them ev are quantitative. Most previous studies were based on case study, and the results were subject to potential confounding factors, such as hospital size, management style, and geographic location, etc25. ie Empirical literature to date has done little to explore a hospital autonomy questionnaire to quantify the w extent of hospital autonomy. The CVHAQ developed in this helped fill this gap in published literature on and provided a validated tool that can help overcome these shortcomings to draw reliable conclusions. In addition, the CVHAQ would lay a strong foundation for quantitatively analyzing the ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com relationship between hospital autonomy and its effect on healthcare reform. For example, a regression analysis can be done to explore the relationship between hospital autonomy and efficiency by using the hospital autonomy scores as independent. Some limitations must be mentioned regarding our findings. The survey was conducted only in Guangdong Province, thus the generalization of the results to other provinces should be with caution. In our future study, we will investigate hospital autonomy in other provinces in China to further For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open validate our questionnaire. In addition, we conducted a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In future studies, we plan to collect panel data to monitor hospital autonomy and explore the relationship between hospital autonomy and efficiency in order to provide decision basis for China’s health care reform. 4. Conclusions rp Fo This study demonstrated the reliability and validity of a Chinese version of a hospital autonomy questionnaire, and provided a quantitative method to assess the hospital autonomy in China. Acknowledgments ee We thank Qiumao Cai, Lina Yu and Chunxiao Wang at the Health Department of Guangdong Province for their assistance. This research was funded by the Guangdong Medical Fund of China (C2013016). Author Contributions ie ev rr ZFL, FTL and YXH obtained the funding. ZFL, YXH and LLZ conceived the idea and the w designed the study. ZFL, LXY collected and cleaned the data. ZFL, YXH and LLZ drafted the on manuscript. All authors critically revised the manuscript for important intellectual content. All authors read and approved the final version of the manuscript. Conflicts of Interest ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Page 16 of 21 The authors declare no conflict of interest. Ethics approval Medical Ethics Committee, Guanghua School of Stomotology, Hospital of Stomatology, Sun Yatsen University. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 17 of 21 Data sharing No additional data available. References 1. Abdullah MT, Shaw J. A review of the experience of hospital autonomy in Pakistan. International rp Fo Journal of Health Planning and Management. 2007;22(1):45-62. 2. Castaño R, Bitran R, Giedion. U, Monitoring and Evaluating Hospital Autonomization and Its Effects on Priority Health Services, Abt Associates Inc: 2004. http://pdf.usaid.gov/pdf_docs/PNADA 591.pdf. ee 3. National Health and Family Planning Commission of the People's Republic of China. National Health and Family Planning Statistical Year Book. 2015:104-136. rr 4. Walford V, Grant K. Health Sector Reform: Improving Hospital Efficiency. Health Systems ev Resource Centre, London, United Kingdom of England,1998; pp.34-40. 5.Govindaraj R, Chawla M. Recent Experiences with Hospital Autonomy in Developing Countries— What Can We Learn? ie Harvard School of Public Health, , United States of America, 1996; pp. 1-66. 6. Bossert T, Kosen S, Harsono B, Gani A. Hospital Autonomy in Indonesia, Harvard School of Public Health, United States of America, 1997; pp. 1-38. w on 7. Ssengooba F, Atuyambe L, McPake B, Hanson K, Okuonzi S. What could be achieved with greater public hospital autonomy? Comparison of public and PNFP hospitals in Uganda. Public Administration and Development. 2002;22(5):415-428. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open 8. Harding AL, Preker AS. Understanding Organizational Reforms: The Corporatization of Public Hospitals, The World Bank, Washington, DC, United States of America, 2000; pp. 1-29. 9. Harding AL, Preker AS. Innovations in Health Service Delivery: the Corporatization of Public Hospitals. The World Bank, Washington, DC, United States of America, 2003; pp.79-104. 10. McPake B, Yepes FJ, Lake S, Sanchez LH. Is the Colombian health system reform improving the performance of public hospitals in Bogota? Health Policy and Planning. 2003;18(2):182-194. 11. Saleem M, Saeed A, Ahmad S, Ch AQ. Measuring Extent of Autonomy in Teaching Hospitals of For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Punjab: A Case of Services Hospital, Lahore. European Journal of Business and Management. 2013;5(8):83-91. 12. London JD. The promises and perils of hospital autonomy Reform by decree in Viet Nam.Social Science & Medicine 2013, 96, 232-240. 13. World Bank. Fixing the public hospital system in China. Washington, DC: World Bank. Available online: http://documents.worldbank.org/curated/en/2010/06/13240557/fixing-public-hospital-systemchina-vol-2-2-main-report. (assessed on 8 September 2015). 14. Yanfeng G. Evaluation and suggestion on China medical health system reform (Summary and rp Fo emphasis).China Health Policy 2005, A01, 1-14. 15. Hipgrave D, Guo S, Mu Y, Guo Y, et al. Chinese-style decentralization and health system reform. PLoS Med. 2012;9(11): e1001337. 16. KELLEY K, CLARK B, BROWN V, SITZIA J. Good practice in the conduct and reporting of ee survey research. International Journal for Quality in Health Care. 2003;15(3):261-266. rr 17. Burns KE, Duffett M, Kho ME, Meade MO, et al. A guide for the design and conduct of selfadministered surveys of clinicians. CMAJ. 2008;179(3):245-252. ev 18. Wagstaff A, Sarah B. The Impacts of Public Hospital Autonomization: Evidence from a QuasiNatural Experiment: The World Bank, Washington, DC, United States of America, 2012; pp.30-44. ie 19.Steiger JH. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 1990;25(2):173-180. w 20. Hu L, Peter BM. Fit Indices in Covariance Structure Modeling: Sensitivity to Under Parameterized on Model Misspecification. Psychological Methods 1998, 3(4): 424-453. 21. McDonald RP, Marsh HW. Choosing a Multivariate Model: Noncentrality and Goodness of Fit. Psychological Bulletin 1990; 107(2): 247-255. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 22. Hu S, Tang S, Liu Y, Zhao Y, Escobar ML, et al. Reform of how health care is paid for in China: challenges and opportunities. The Lancet 2008; 372: 1846-1853. 23. Allen P, Cao Q, Wang H. Public hospital autonomy in China in an international context. The International Journal of Health Planning and Management, 2014; 29(2): 141-159. 24. Yip W, Hsiao W. China's health care reform: A tentative assessment. China Economic Review 2009;20(4): 613-619. 25. Saunders JA, Morrow-Howell N, Spitznagel E. Dore P, Proctor EK, et al. Imputing Missing Data: For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 18 of 21 Page 19 of 21 BMJ Open A Comparison of Methods for Social Work Researchers. Social Work Research 2006; 30(1):19-31. w ie ev rr ee rp Fo ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open ee rp Fo flowchart 338x190mm (300 x 300 DPI) w ie ev rr ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 20 of 21 Page 21 of 21 BMJ Open ev rr ee rp Fo steps 254x190mm (300 x 300 DPI) w ie ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Development of the Chinese version of the Hospital Autonomy Questionnaire: a cross-sectional study in Guangdong Province rp Fo Journal: Manuscript ID Article Type: Date Submitted by the Author: Complete List of Authors: BMJ Open bmjopen-2015-010504.R2 Research 02-Feb-2016 Secondary Subject Heading: Medical management ie Keywords: Health policy ev <b>Primary Subject Heading</b>: rr ee Liu, Zifeng; Sun Yat-sen University, Guanghua School of Stomotology, Hospital of Stomatology; Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology Yuan, Lianxiong; Sun Yat-sen University, School of Public Health Huang, Yixiang; Sun Yat-sen University, School of Public Health; Guangdong Health Economics Association Zhang, Lingling; Clemson University, Department of Public Health Sciences Luo, Futian; Sun Yat-sen University, School of Public Health w HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Health policy < HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Organisational development < HEALTH SERVICES ADMINISTRATION & MANAGEMENT ly on For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 1 of 21 Development of the Chinese version of the Hospital Autonomy Questionnaire: a cross-sectional study in Guangdong Province Zifeng Liu1,2, Lianxiong Yuan2, Yixiang Huang2,3,*, Lingling Zhang4,*, Futian Luo2 1 Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology, 56 Lingyuan West Rd, 510055, Guangzhou, China 2 School of Public Health, Sun Yat-sen University, 74 Zhongshan 2nd Road, 510080, Guangzhou, China 3 Guangdong Health Economics Association, 17 Xianlienan Road, 510060, Guangzhou, China 4 Department of Public Health Sciences, Clemson University, 515 Edwards Hall, Clemson, SC 296340745, USA *Correspondence to ee rp Fo Dr. Yixiang Huang: huangyx@mail.sysu.edu.cn rr Dr. Lingling Zhang: lingliz@clemson.edu ABSTRACT ie ev Objective: We aimed to develop a questionnaire for quantitative evaluation of the autonomy of public hospitals in China. w Method: An extensive literature review was conducted to select possible items for inclusion in the on questionnaire, which was then reviewed by five experts. After a two-round Delphi method, we ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open distributed the questionnaire to 404 secondary and tertiary hospitals in Guangdong Province, China, and 379 completed questionnaires were collected. The final questionnaire was then developed on the basis of the results of both exploratory factor analysis and confirmatory factor analysis. Results: Analysis suggested that all internal consistency reliabilities exceeded the minimum reliability standard of 0.70 for the alpha coefficient. The overall scale coefficient was 0.87, and six subscale coefficients were 0.92 (strategic management), 0.81 (budget and expenditure), 0.85 (financing), 0.75 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open (financing, medical management), 0.86 (human resources) and 0.86 (accountability). Correlation coefficients between and among items and their hypothesised subscales were higher than those with other subscales. The value of average variance extracted (AVE) was higher than 0.5, the value of construct reliability (C.R.) was higher than 0.7, and the square roots of the AVE of each subscale were larger than the correlation of the specific subscale with the other subscales, supporting the convergent and discriminant validity of the Chinese version of the Hospital Autonomy Questionnaire (CVHAQ). rp Fo The model fit indices were all acceptable: χ2/degrees of freedom (χ2/df) =1.73, Goodness of Fit Index (GFI) =0.93, Adjusted Goodness of Fit Index (AGFI) =0.91, Non-Normed Fit Index (NNFI) =0.96, Comparative Fit Index (CFI) =0.97, Root Mean Square Error of Approximation (RMSEA) =0.04, ee Standardised Root Mean Square Residual (SRMR) =0.07. rr Conclusions: This study demonstrated the reliability and validity of a Chinese version of the Hospital ev Autonomy Questionnaire and provides a quantitative method for the assessment of hospital autonomy. Keywords: Hospital Autonomy; Questionnaire; Development; Reliability; Validity; China Strengths and limitations of this study w ie on ▪ To the best of our knowledge, this is the first study to carry out a quantitative investigation of public hospital autonomy in China. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 ▪ By surveying more than 400 public hospitals, we developed the first version of a Hospital Autonomy Questionnaire, designed to improve our understanding of the relationship between public hospitals and the government. ▪ We verified the reliability and validity of our questionnaire, which provides a quantitative method for the assessment of hospital autonomy in China. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 2 of 21 Page 3 of 21 BMJ Open ▪ The survey was conducted only in Guangdong Province; thus, the generalisation of the results to other provinces should be made with caution. ▪ This was a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In the future, panel data should be collected. INTRODUCTION rp Fo In developing countries, public hospitals are normally characterised by inefficient resource management, by low productivity due to their rigid hierarchical structures and by ineffective governmental administrative and financial controls.1 Turning public hospitals into autonomous entities ee is thought to be able to improve their performance.2 In China, because over 80% of hospitals are run by the rr state,3 increasing public hospital autonomy, which is also considered to be an effective way to improve the efficiency of public hospitals, is a key issue in health sector reform4 and is a particularly important ev issue in China. Studies on the evaluation of hospital autonomy in other countries have yielded mixed ie results. Govindaraj and Chawla,5 using the evaluation toolkit by Chawla et al, carried out five country w case studies (Ghana, Kenya, Zimbabwe, India and Indonesia). However, the results varied by country, on probably because of the short period of time that elapsed since the granting of autonomy in each country. Bossert et al measured hospital autonomy in Indonesia and found little evidence that its ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com objectives were achieved.6 Sengooba et al performed another case study of eight hospitals in Uganda. Given the nature of the case study, the authors did not believe that their results should be used as the sole basis for national- or international-level policy development.7 In addition, different authors carried out eight country or area case studies (United Kingdom, New Zealand, Australia, Hong Kong, Malaysia, Singapore, Indonesia and Tunisia) based on Harding and Preker’s conceptual framework on hospital autonomy.8 Hawkins and Ham summarised these studies and found that autonomisation might For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open improve efficiency in some areas but not in others.9 McPake et al reached a positive conclusion by studying five hospitals in Bogotá, Colombia,10 whilst Amir Saeed et al studied the autonomisation of teaching hospitals in Punjab and found that it has not yet yielded the hoped-for benefits.11 London investigated the impact of hospital autonomisation in Vietnam and also found mixed results, mainly due to the small sample size and data constraints.12 Some researchers attributed the mixed results to small sample sizes and quality of data in these studies, which prevented researchers from conducting rp Fo more elaborate statistical analyses and reaching robust conclusions.2 In China, public hospitals play a critical role in the healthcare system. According to the China Health Statistics Yearbook (2015),3 they provide medical services to 89.5% of the population, and the ee proportion of spending in public hospitals is 95.5% of the total national health expenditure in China. rr Currently, public hospitals are considered less efficient and a serious financial burden to the ev government.13 To address these problems, China began granting autonomy to some public hospitals in the early 1980s, including shifting partial decision-making control from the government to hospital ie managers, which has allowed public hospitals to make a profit from the medical services they provide. w However, after more than 20 years, some research suggests that healthcare reform in China has not on made significant progress.14 In 2012, China’s State Council announced a new phase of healthcare reform, allowing for more private hospitals and granting greater public hospital autonomy to improve ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 efficiency.15 Therefore, studying the impact of hospital autonomy on efficiency is important, and developing an effective tool for measuring such autonomy is the first challenge. With the Chinese government’s support, and sufficient hospitals in Guangdong province to provide a good sample, we carried out this study. The objective of this study was to develop a Chinese version of the Hospital Autonomy Questionnaire (CVHAQ), which can be used to evaluate the level of hospital autonomy and For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 4 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 5 of 21 to help policy-makers better understand the extent of policy implementation and formulate specific policies to redefine the relationship between health authorities and hospitals. METHODS Theoretical model and questionnaire development Although many researchers have proposed evaluation tools for hospital autonomy, there are three generic rp Fo tools, namely, Chawla et al.(1996), Over and Watanabe (2003) and Harding and Preker (2003).2 The Chawla et al (1996) tool proposes three key areas to be analysed to determine the existing level of autonomy: administration, financing and inputs. The Over and Watanabe (2003) tool considers five elements of hospital ee structure: residual claimant status, decision right, degree of market exposure, availability of accountability mechanisms and extent of unfunded mandates. The Harding and Preker (2003) tool proposes five dimensions rr for analysis of the extent of hospital autonomy: decision right, market exposure, residual claimant, ev accountability and social functions. We modified the three existing tools to develop a Chinese version of the Hospital Autonomy Questionnaire. ly on Figure 1 Flowchart of questionnaire development16 17 w ie 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open A systematic approach was used to generate the final questionnaire.16 17 The development of items for inclusion in the CVHAQ was carried out in five phases. First, an extensive literature review was conducted to select possible subscales for the questionnaire. The theoretical basis for hospital autonomy was the conceptual framework from Harding and Preker, which contained five subscales: decision rights, residual claimant, market exposure, accountability and social functions.8 At the same time, we also learned from the other two related measuring tools, and nine subscales were created to For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open evaluate the extent of Chinese hospital autonomy: strategic management, budget and expenditure, finance, human resources, day-to-day management, residual claimant, market exposure, accountability and social functions. Second, after in-depth interviews and focus-group sessions, 40 potential subitems were developed. Third, ten carefully selected experts — including two lawyers, four hospital management experts, two government officers, and two professors versed in statistics — were invited to discuss relevant items for inclusion or exclusion. We used the Delphi method to evaluate the items. rp Fo In two rounds, the experts gave their scores in terms of linguistic expression, importance, clarity and correlation for each item, and then we deleted the items whose importance score was less than 7.5. The remaining 32 items constituted the initial shape of the questionnaire. Fourth, a pilot test with 26 ee selected hospitals was conducted to judge the appropriateness of each included question. Fifth, in a rr formal survey, six undergraduate students were selected as questionnaire interviewers, and two ev researchers in our focus-group were designated as quality controllers. After investigation, we used the method of exploratory factor analysis to screen the items, and finally we deleted 10 items and extracted ie 6 factors. (All loadings were larger than 0.5) To enhance the interpretability of the factors with high w loadings, we rotated the extracted factors to a simple structure using the Varimax procedure on (orthogonal rotation) to see if the result was consistent with our theoretical model. Furthermore, we evaluated the reliability of the questionnaire and the Cronbach’s alpha coefficients in all subscales ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 higher than 0.70. Meanwhile, we calculated the value of AVE (>0.5) and square roots of AVE to test the validity of the questionnaire. After some necessary linguistic revisions, the questionnaire, including six subscale (22 items) indicators of Chinese hospital autonomy, was finalised and used to build a Chinese hospital autonomy model. Responses were rated on a 5-point Likert scale for hospital autonomy (1 = totally constrained, 2 = very constrained, 3 = partly constrained, 4 = hardly constrained, 5 = not constrained). Items were For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 6 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 7 of 21 forward-scored on a 1- to 5-point scale (1=1, 2=2, 3=3, 4=4, 5=5), and subscale scores were computed as the sum of each item score; that is, the higher scores indicated higher autonomy. Figure 2 Steps of questionnaire development8 Quality control measures: item generation rp Fo The items in this questionnaire were generated through literature reviews, in-depth interviews and focus-group sessions. First, we reviewed PubMed and the China National Knowledge Infrastructure (CNKI) to collect pertinent literature. Second, we set up a focus group to analyse the pertinent ee literature and preliminarily determined the subscales of our questionnaire. Finally, the members of the rr focus group reviewed the potential respondents or experts in-depth. When item generation continued ev until no new items emerged, we established an item pool with 40 items. Then, the Delphi method was used for two rounds. ie Pilot testing w The questionnaire was tested for how well respondents comprehended and correctly answered crucial on questions, or to confirm that the questionnaire was user-friendly for the respondent and to ascertain how long it took to complete. Formal survey ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open All of the questionnaire interviewers and quality controllers were systematically trained by the project investigator (PI) before the investigation. During the investigation, the questionnaire interviewers were responsible for connecting with respondents who were familiar with questions and reported regularly to the PI. The quality controllers were responsible for checking the integrity and accuracy of the finished questionnaire. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Data entry Double-blind input, consistency check and logical check were used to control the quality of data entry. Data collection This survey was conducted in 2013, and the data collection process consisted of two parts. First, an electronic version of the questionnaire was sent to 404 secondary and tertiary hospitals in Guangdong Province with the support of the Health Bureau of Guangdong Province. Second, senior management rp Fo staff of these hospitals were contacted and asked to organise persons familiar with these issues to complete the questionnaire. The completed questionnaires were then collected by the research team. Data analysis ee SPSS 19.0 for Windows was used for data analysis. First, Cronbach’s alpha coefficients were rr calculated to evaluate the internal consistency reliability of the total questionnaire and each subscale. ev Cronbach’s alpha coefficient ≧0.70 was considered as acceptable. Second, multi-trait scaling analysis (using Pearson correlation analysis) was conducted to determine the item-subscale correlations. If the ie analysis showed a stronger correlation (correlation coefficient ≧0.70) between an item and its w hypothesised subscale, and with a coefficient larger than those of other subscales, the questionnaire on was considered well-defined. To test the validity of the CVHAQ, an exploratory factor analysis was conducted, and the extracted factors were rotated to simple structure by the Varimax procedure ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 (orthogonal rotation) to see if the result would be consistent with the theoretical model. Varimax rotation can enhance the interpretability of the factors with high loadings. The values of AVE and C.R. were calculated to test convergent validity and discriminant validity. A confirmatory factor analysis was then performed with AMOS 19.0 to assess the fitness of our modified theory model. The fit indices of χ2/df (<2), GFI (>0.90), AGFI (>0.90), NNFI (>0.90), CFI (>0.90), RMSEA (<0.05) and For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 8 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 9 of 21 SRMR (<0.08) were used to assess the fitness of the model. Missing item values from individual surveys were imputed with the mean value.18 RESULTS Responding groups In total, 379 questionnaires were collected in this study. The characteristics of the participating rp Fo hospitals are listed in table 1. The response rate was 93.81%. The percentage of missing values for each item of the subscale varied from 0.00% to 3.63%. Table 1 Characteristics of the participating hospitals Variables Classification ee specialised hospital general hospital secondary tertiary Pearl River Delta (PRD) other areas in Guangdong Province rr Grade Location N % 110 269 293 86 164 215 29.0 71.0 77.3 22.7 43.3 56.7 ie ev Exploratory factor analysis w To test the validity of the hypothesis, the exploratory factor analysis with Varimax factor rotation was on conducted, and six components were extracted, which accounted for 73.05% of the total variance. Results are presented in table 2. Table 2 ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open Exploratory factor analysis with Varimax factor rotation Subscale 1 Q1 0.82 Q2 0.92 Q3 0.87 Q4 0.89 Subscale 2 Subscale 3 Subscale 4 Subscale 5 Subscale 6 Q5 0.83 Q6 0.73 Q7 0.59 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open Q8 0.84 Q9 0.84 Q10 0.85 Q11 0.65 Q12 0.77 Q13 0.79 Q14 0.76 Q15 0.77 Q16 0.76 Q17 0.83 Q18 Q19 Q20 Q21 Q22 rp Fo 0.85 0.86 0.88 0.85 0.76 ee Note: Only factor loadings of 0.50 or greater are reported. Total variance explained=73.05%. rr Reliability ev The mean scores, standard deviations and Cronbach’s alpha coefficients are presented in table 3. All internal consistency reliabilities exceeded the minimum reliability standard of 0.70, among which the ie overall scale coefficient was 0.87, and six subscale coefficients were 0.92 (strategic management), w 0.81 (budget and expenditure), 0.85 (financing), 0.75 (financing, medical management), 0.86 (human resources) and 0.86 (accountability). ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Table 3 CVHAQ reliability for questionnaire and subscales Mean SD Overall scale Cronbach's alpha 67.47 11.68 0.87 Subscale 1: strategic management 11.92 3.53 3.04 1.10 2.94 0.94 Scale/Item 0.92 Q1: The extent to which your hospital’s desire to develop a vision and purpose is constrained by government departments Q2: The extent to which your hospital's development goals are constrained by government departments For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 10 of 21 Page 11 of 21 BMJ Open Q3: The extent to which your hospital’s attempt to develop a short-term development plan is constrained by 3.07 0.92 2.87 0.96 6.80 2.52 1.94 1.08 2.09 0.98 your hospital's other spending is constrained by government 2.78 0.90 government departments Q4: The extent to which the hospital’s attempt to develop a long-term development plan is constrained by government departments Subscale 2: budget and expenditure Q5: The extent to which your hospital's drug procurement is constrained by government departments Q6: The extent to which your hospital's equipment rp Fo procurement is constrained by government departments 0.81 Q7: Except for drugs and equipment, the extent to which departments Subscale 3: financing ee Q8: The extent to which your hospital's short-term liabilities are constrained by government departments Q9: The extent to which your hospital's long-term liabilities rr are constrained by government departments 11.16 4.20 2.92 1.23 2.59 1.26 2.60 1.32 3.05 1.23 9.83 2.28 3.03 0.95 3.51 0.89 0.85 Q10: The extent to which your hospital's other liabilities ev (finance leases, bills, etc.) are constrained by government departments ie Q11: The degree to which government departments intervene in your hospital’s ability to accept donations Subscale 4: day-to-day management w Q12: The degree to which government departments directly intervene in your hospital’s medical business management Q13: The degree to which government departments directly Q14: The degree to which government departments directly intervene in your hospital’s ability to provide convenience ly intervene in your hospital’s logistics service management 0.75 on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com 3.28 0.96 11.46 3.54 2.66 1.05 3.26 0.99 2.69 1.07 services Subscale 5: human resources Q15: The extent to which your hospital’s ability to recruit employees is constrained by government departments 0.86 Q16: The extent to which your hospital’s policies for staff rewards and punishment are constrained by government departments Q17: The extent to which your hospital employee salary For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open structure is constrained by government departments Q18: The extent to which your hospital’s ability to dismiss employees is constrained by government departments Q19: Whether the purposes of the inspection set by government departments for your hospital are clear Q20: Whether the assessment indicators set by government departments for your hospital are clear Q21: Whether the assessment indicators set by government departments for your hospital are reasonable Q22: The degree to which recognition of government departments’ inspection affects your hospital 1.12 4.22 0.89 4.06 0.99 3.68 0.89 4.34 0.73 0.86 ee Item-subscale correlations 2.85 16.30 2.95 Subscale 6: accountability rp Fo Pearson correlation coefficients between subscales and items are presented in table 4. The results rr showed that items had higher correlation coefficients as compared with the theoretical subscale than ev with the other subscales. Table 4 Subscale 1 Item-subscale correlations of CVHAQ ie Subscale 2 Subscale 3 Subscale 4 Subscale 5 Subscale 6 0.32 0.22 -0.04 0.32 0.27 0.07 0.25 0.37 0.23 0.07 0.36 0.21 0.32 0.25 0.07 0.33 0.86 0.40 0.29 0.31 -0.04 Q6 0.35 0.89 0.55 0.30 Q7 0.28 0.81 0.58 0.34 Q8 0.21 0.52 0.87 Q9 0.18 0.54 Q10 0.19 Q11 Q1 0.86 0.33 0.22 Q2 0.94 0.33 0.23 Q3 0.90 0.33 Q4 0.91 Q5 ly on w 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 0.47 -0.05 0.37 0.01 0.29 0.35 -0.04 0.88 0.29 0.31 -0.00 0.48 0.87 0.24 0.30 -0.06 0.26 0.43 0.72 0.28 0.27 -0.00 Q12 0.34 0.36 0.37 0.85 0.32 -0.03 Q13 0.21 0.29 0.28 0.80 0.25 0.06 Q14 0.34 0.23 0.15 0.80 0.22 0.02 Q15 0.24 0.38 0.28 0.26 0.81 0.04 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 12 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 13 of 21 Q16 0.31 0.40 0.33 0.34 0.82 -0.05 Q17 0.19 0.41 0.34 0.27 0.86 -0.01 Q18 0.18 0.33 0.28 0.21 0.86 0.01 Q19 0.01 -0.05 -0.03 0.02 0.01 0.86 Q20 0.01 -0.04 -0.06 0.01 -0.05 0.89 Q21 0.07 0.01 0.01 0.02 0.04 0.85 Q22 0.06 -0.04 -0.01 0.01 -0.01 0.75 Convergent validity and discriminant validity rp Fo If the value of AVE was higher than 0.5 and the value of C.R. was higher than 0.70, we considered the convergent validity acceptable. To test discriminant validity, we calculated the square root of every AVE value belonging to each latent subscale. The outcomes (in table 5) show that the square roots of the AVE of each subscale were larger than the correlation of the specific subscale with any of the other subscales. ee Table 5 Convergent and discriminant validity for questionnaire and subscales rr Strategic Variable AVE C.R. management Strategic management expenditure Day-to-day Human resources Accountability expenditure management resources 0.76 0.93 0.87 0.58 0.81 0.38 0.76 0.61 0.86 0.25 0.59 Accountability 0.51 0.75 0.37 0.36 0.60 0.85 0.27 0.45 0.37 0.32 0.77 0.61 0.86 0.04 -0.04 -0.03 0.02 0.00 0.78 0.33 0.71 0.78 ly on management Human w Financing Day-to-day Financing ie Budget and Budget and ev 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open Note: On the diagonal we inserted the square roots of every AVE value to compare it with the other correlation coefficients. Confirmatory factor analysis We used AMOS 19.0 to conduct confirmatory factor analysis, and seven indicators were calculated to test the fitness of our theory model. RMSEA and SRMR were less than 0.08, whilst GFI, AGFI, NNFI and CFI were higher than 0.9, leading to acceptable construct validity. The results are presented in table 6. Table 6 Fitness of fit of CVHAQ For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open χ2/df GFI AGFI NNFI CFI RMSEA (95%CI) SRMR 1.73 0.93 0.91 0.96 0.97 0.04 (0.03,0.05) 0.07 Note. χ2=Minimum Fit Function Chi-square; df=degree of freedom; GFI=Goodness of Fit Index; AGFI = Adjusted Goodness of Fit Index; NNFI = Non-Normed Fit Index; CFI = Comparative Fit Index; RMSEA = Root Mean Square Error of Approximation; CI = Confidence Interval; SRMR = Standardised Root Mean Square Residual. χ2/df<2.0, GFI>0.90, AGFI>0.90, NNFI>0.90, CFI>0.90, RMSEA<0.08, SRMR<0.08. DISCUSSION rp Fo In this study, the hospital autonomy survey was modified to adapt to Chinese health policies, and the CVHAQ was developed based on Harding and Preker’s conceptual framework on hospital autonomy, as well as the tools developed by Chawla et al (1996) and Over and Watanabe (2003)2. The reliability ee and factor structure of the CVHAQ were assessed. Results of this study showed that the CVHAQ was rr a reliable and valid questionnaire for the measurement of hospital autonomy. The confirmatory factor analysis confirmed the theoretical model, which reflected the extent of hospital autonomy. The higher ev scores the hospitals had, the more autonomy they had. According to the Chinese Health Statistics ie Report (2015),3 government fiscal budgets provide about 7% of total revenue for public hospitals. w Almost all secondary and tertiary hospitals must earn profit from the medical services they provide, so on there is little variance in residual claimant and market exposure between sample hospitals that could be captured by the questionnaire. Social function is a complementary reform to ensure that services that ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Page 14 of 21 were previously cross-subsidised continue to be delivered, and does not belong to the scope of hospital autonomy. The six theoretical subscales included in the final CVHAQ well reflected the status of hospital autonomisation. Results of confirmatory factor analysis showed that all indicators of fitness were acceptable.19-21 This study showed that subscale 2 and subscale 3 were correlated (r=0.59), which can be explained by the fact that the autonomy of the two subscales commonly depends on the economic policy for a hospital, which is set by the government; thus, finances, budget and expenditure For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 15 of 21 BMJ Open are synergistically affected. Subscale 5 and subscale 2 were also correlated (r=0.45). The underlying reason could be that the Chinese government spent little on human resources, and the cost was borne by the hospital.22 23 Characteristics of local hospitals in Guangdong made it very suitable for conducting this largescale quantitative study. China has traditionally managed its public hospitals as administrative units. However, in the past 30 years, the Chinese government has been reforming its health system by rp Fo reducing the health department’s direct control over public hospitals and shifting the day-to-day decision-making from government authority to hospital managers, to reduce the government’s financial burden and improve hospital efficiency.24 Guangdong, the frontier of China’s economic ee reform, has more than 400 secondary and tertiary public hospitals. They are divided into national rr hospitals, provincial hospitals and municipal or county hospitals. Because of different levels of ev government input and degrees of decentralisation, these hospitals vary greatly in autonomy, which created a unique opportunity for us to conduct this study in Guangdong. In addition, this study was ie supported by the Health Bureau of Guangdong Province, which resulted in a higher response rate from w local hospitals. This helped overcome the issues of small sample size and data constraint existing in previous studies. on Although many studies on hospital autonomisation have been conducted, only a few were ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com quantitative. Most previous studies were based on case study, and the results were subject to potential confounding factors, such as hospital size, management style, geographic location, etc.25 Empirical literature to date has done little to explore a hospital autonomy questionnaire to quantify the extent of hospital autonomy. The CVHAQ developed in this study helped fill this gap in the published literature and provided a validated tool that can help overcome these shortcomings and enable reliable conclusions to be drawn. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open In addition, the CVHAQ could lay a strong foundation for quantitative analysis of the relationship between hospital autonomy and its effect on healthcare reform. For example, a regression analysis can be done to explore the relationship between hospital autonomy and efficiency by using the hospital autonomy scores as independent factors. Some limitations must be mentioned regarding our findings. The survey was conducted only in Guangdong Province; thus, generalisation of the results to other provinces should be done with caution. rp Fo In our future study, we will investigate hospital autonomy in other provinces in China to further validate our questionnaire. In addition, we conducted a cross-sectional study that could not illustrate the underlying trend of hospital autonomy. In future studies, we plan to collect panel data to monitor ee hospital autonomy and explore the relationship between hospital autonomy and efficiency, to provide rr an evidence-based foundation for China’s healthcare reform. CONCLUSIONS ie ev This study demonstrated the reliability and validity of a Chinese version of a hospital autonomy questionnaire, and provided a quantitative method for the assessment of hospital autonomy in China. w Acknowledgements on We thank Qiumao Cai, Lina Yu and Chunxiao Wang at the Health Department of Guangdong ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Page 16 of 21 Province for their assistance. This research was funded by the Guangdong Medical Fund of China (C2013016). Author contributions ZFL, FTL and YXH obtained the funding. ZFL, YXH and LLZ conceived the idea and designed the study. ZFL and LXY collected and processed the data. ZFL, YXH and LLZ drafted the manuscript. All For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 17 of 21 authors critically revised the manuscript for important intellectual content. All authors read and approved the final version of the manuscript. Conflicts of interest The authors declare no conflicts of interest. Ethics approval rp Fo Medical Ethics Committee, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University. Data sharing No additional data available. rr REFERENCES ee 1. Abdullah MT, Shaw J. A review of the experience of hospital autonomy in Pakistan. Int J Health Plan Mgmt 2007;22:45–62. ev 2. Castaño R, Bitran R, Giedion U. Monitoring and eEvaluating Hhospital Aautonomization and Iits ie eEffects on pPriority Hhealth sServices., Abt Associates Inc: 2004. http://pdf.usaid.gov/pdf_docs/PNADA 591.pdf. w on 3. National Health and Family Planning Commission of the People's Republic of China. National Health and Family Planning Statistical Year Book 2015:104-36. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open 4. Walford V, Grant K. Health sector reform: improving hospital efficiency. London, UK: Health Systems Resource Centre, 1998;34–40. 5. Govindaraj R, Chawla M. Recent experiences with hospital autonomy in developing countries— what can we learn? Boston, MA: Harvard School of Public Health, 1996;1–66. 6. Bossert T, Kosen S, Harsono B, et al. Hospital autonomy in Indonesia. Boston, MA: Harvard School of Public Health, 1997; 1–38. 7. Sengooba F, Atuyambe L, McPake B, et al. What could be achieved with greater public hospital autonomy? Comparison of public and PNFP hospitals in Uganda. Public Admin Dev 2002;22:415–28. For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open 8. Harding AL, Preker AS. Understanding organizational reforms: the Corporatization of Public Hospitals. Washington, DC: The World Bank, 2000;1–29. 9. Harding AL, Preker AS. Innovations in health service delivery: the Corporatization of Public Hospitals. Washington, DC: The World Bank, 2003;79–104. 10. McPake B, Yepes FJ, Lake S, et al.. Is the Colombian health system reform improving the performance of public hospitals in Bogotá? Health Policy Planning 2003;18:182–94. 11. Saleem M, Saeed A, Ahmad S, et al. Measuring extent of autonomy in teaching hospitals of Punjab: a case of services hospital, Lahore. Eur J Bus Mgmt 2013;5:83–91. rp Fo 12. London JD. The promises and perils of hospital autonomy. Reform by decree in Viet Nam. Soc Sci Med 2013;96:232–40. 13. World Bank. Fixing the public hospital system in China. Washington, DC: World Bank. Available online: http://documents.worldbank.org/curated/en/2010/06/13240557/fixing-public-hospital-system- ee china-vol-2-2-main-report. (accessed on 8 September 2015). rr 14. Ge YF. Evaluation and suggestion on China medical health system reform (summary and emphasis). China Health Policy 2005; A01:1–14. ev 15. Hipgrave D, Guo S, Mu Y, et al. Chinese-style decentralization and health system reform. PLoS Med 2012;9: e1001337. ie 16. Kelley K, Clark B, Brown V, et al. Good practice in the conduct and reporting of survey research. Int J Quality Health Care 2003;15:261–6. w 17. Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. Can Med Assoc J 2008;179:245–52. on 18. Wagstaff A, Sarah B. The impacts of public hospital autonomization: evidence from a quasinatural experiment. Washington, DC: The World Bank, 2012;30–44. ly 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 19.Steiger JH. Structural model evaluation and modification: an interval estimation approach. Multivariate Behav Res 1990;25:173–80. 20. Hu L, Peter BM. Fit indices in covariance structure modeling: sensitivity to under parameterized model misspecification. Psycholog Meth 1998;3:424–53. 21. McDonald RP, Marsh HW. Choosing a multivariate model: noncentrality and goodness of fit. Psychol Bull 1990;107:247–55. 22. Hu S, Tang S, Liu Y, et al. Reform of how health care is paid for in China: challenges and For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 18 of 21 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Page 19 of 21 opportunities. The Lancet 2008;372:1846–53. 23. Allen P, Cao Q, Wang H. Public hospital autonomy in China in an international context. Int J Health Planning Mgmt 2014;29:141–59. 24. Yip W, Hsiao W. China's health care reform: a tentative assessment. China Economic Rev 2009;20:613–9. 25. Saunders JA, Morrow-Howell N, Spitznagel E, et al. Imputing missing data: a comparison of methods for social work researchers. Social Work Res 2006; 30:19–31. w ie ev rr ee rp Fo ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 BMJ Open For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com BMJ Open ee rp Fo flowchart 338x190mm (300 x 300 DPI) w ie ev rr ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Page 20 of 21 Page 21 of 21 BMJ Open ev rr ee rp Fo steps 254x190mm (300 x 300 DPI) w ie ly on 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com For peer review only - http://bmjopen.bmj.com/site/about/guidelines.xhtml Downloaded from http://bmjopen.bmj.com/ on March 1, 2016 - Published by group.bmj.com Development of the Chinese version of the Hospital Autonomy Questionnaire: a cross-sectional study in Guangdong Province Zifeng Liu, Lianxiong Yuan, Yixiang Huang, Lingling Zhang and Futian Luo BMJ Open 2016 6: doi: 10.1136/bmjopen-2015-010504 Updated information and services can be found at: http://bmjopen.bmj.com/content/6/2/e010504 These include: References This article cites 16 articles, 4 of which you can access for free at: http://bmjopen.bmj.com/content/6/2/e010504#BIBL Open Access This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ Email alerting service Receive free email alerts when new articles cite this article. Sign up in the box at the top right corner of the online article. Topic Collections Articles on similar topics can be found in the following collections Health policy (431) Medical management (148) Notes To request permissions go to: http://group.bmj.com/group/rights-licensing/permissions To order reprints go to: http://journals.bmj.com/cgi/reprintform To subscribe to BMJ go to: http://group.bmj.com/subscribe/