Health Policy Initiative | PIAT Interview Guide for Policymakers Policy Implementation Assessment Tool Master Interview Guide May 2010 POLICYMAKERS This master interview guide was prepared by the USAID | Health Policy Initiative, Task Order 1. In-country teams should adapt this master interview guide to the specific policy of interest and the given country or local context. To learn more about applying the tool, please see the paper Taking the Pulse of Policy: The Policy Implementation Assessment Tool (2010), available at www.healthpolicyinitiative.com/policyimplementation. Health Policy Initiative | PIAT Interview Guide for Policymakers Policy Implementation Interview Guide for Policymakers Basic Information about the Policymaker Please obtain and enter all basic information about the policymaker before the interview. Name of policymaker:______________________________________________________________ Official title: _____________________________________________________________________ Sex: F: ______ M: ______ Agency/organization: ______________________________________________________________ Length of time at agency/organization: ________________________________________________ Office address: ___________________________________________________________________ Email and contact numbers: ________________________________________________________ Date(s) of interview:_______________________________________________________________ Name of interviewer: ______________________________________________________________ The following information about the policy is to be completed by the core team before data collection starts. Print this on a separate sheet of paper to give to the respondent. Full name (and number if applicable) of the policy that is the focus of the assessment:________ _________________________________________________________________________________ Issuing body/institution:____________________________________________________________ ________________________________________________________ Date officially approved:____________________________________________________________ _________________________________________________________________________________ Policy goal (as stated in the policy):___________________________________________________ _________________________________________________________________________________ Policy objectives (as stated in the policy): ______________________________________________ _________________________________________________________________________________ Policy timeframe (as stated in the policy):_____________________________________________ _________________________________________________________________________________ 1 Health Policy Initiative | PIAT Interview Guide for Policymakers Note to Interviewer: All questions or phrases to read aloud are in bold font. Items to be filled in by the core team prior to the interviews are italicized and shaded in gray. Some of these items will be filled in based on the findings from the policy text analysis completed by the core team prior to application of this tool. All instructions to interviewers are italicized and enclosed by double-lined boxes. They should not be read aloud. Ask each question as stated in the interview guide. If the key informant states that he/she does not really know the answer, write “DK” (“Don’t know”). Numbered categories of responses are provided for several questions. Read out the categories to the respondent and circle the corresponding number of the respondent’s choice. Choices should not fall between two numbers; in such cases, the interviews should encourage the respondents to choose the number that best reflects their viewpoint. Most questions request the key informant to specify or explain further. Please probe appropriately to obtain the underlying reasons. Write down any comments or recommendations that the key informant gives. Interviewers are encouraged to probe in the case of open-ended questions. Use spaces provided and the margins or the back pages of the interview guide if more space is needed. In some instances, a respondent may decline to answer a specific question. If so, write down “Declined,” then ask the respondent if it is okay to ask the next question. If the respondent agrees to continue, be sure to ask the next applicable question based on “Skip” instructions. In case questions arise, make sure you have a copy of the policy with you. Introduction Good morning Sir/Madam [or as appropriate]. Thank you very much for making time for this interview. My name is [state your name] and I work for [state your organization]. We are interviewing policymakers regarding the implementation of the insert exact title of the policy. By policy implementation, we mean the activities and operations of various stakeholders toward achieving the goals and objectives articulated in an authorized policy—in this case, the insert the policy. The purpose of this assessment is to analyze how well insert the policy is being implemented. The results of the interviews can be used by policymakers and stakeholders to clarify guidelines and directives, address barriers to implementation, improve resource mobilization, update implementation plans, or advocate for policy reform. This interview includes close-ended questions as well as questions that are open ended. We anticipate the interview will last about one hour. CONSENT Please be assured that all your responses will be held in strict confidence; findings will be presented in aggregate, and no statements used in the report will be attributed directly to you. Your participation is voluntary, and you may decline to answer any question or end the interview at any point. Do you agree to continue? ___Yes ___No ____________Interviewer’s Initials 2 Health Policy Initiative | PIAT Interview Guide for Policymakers Review the goals and objectives of the policy (listed above on the first page of the interview guide). Confirm with the respondent that he/she is aware of the contents of this policy and can answer questions about its implementation. Tips for conducting the interview are enclosed in these double-lined boxes. A. The Policy, Its Formulation, and Dissemination A1. Referring to the goals and objectives of this policy, to what extent do you think these goals and objectives address the key issues in the country, district, technical area…complete as appropriate for the policy? 1 Do not address important issues 2 Address some key issues, but many missing 3 Address most of the key issues, but some missing 4 Address all key issues (A1a) Why? Please explain. A1b. To what extent does the policy address the needs of the poor or insert other underserved, vulnerable, or most at-risk populations as appropriate based on the policy text analysis and their health status? 1 Does not address needs of the poor/ underserved 2 3 Addresses most of the key issues affecting the poor/underserved Addresses some key issues affecting the poor/underserved 4 Addresses all key issues affecting the poor/underserved (A1b1) Please explain. A1c. To what extent does the policy address gender issues in the country, district, technical area…complete as appropriate per the policy text analysis? 1 Does not address key gender issues 2 Addresses some key gender issues 3 Addresses most of the key gender issues 3 4 Addresses all key gender issues Health Policy Initiative | PIAT Interview Guide for Policymakers (A1c1) Please explain. If the policy specifies a timeframe, read out the timeframe then ask question A2; otherwise skip to A3. A2. In your opinion, are the goals and objectives achievable within the timeframe set out in the policy? 1_Yes 2_No 8_Don’t know (A2a) Why? Please explain. A3. How extensive was the involvement of various stakeholders during the process of formulating the policy? 1 2 3 4 No involvement Limited involvement Moderate involvement Extensive involvement (A3a) Please explain. Ask about different stakeholders, as appropriate based on the policy text analysis: NGOs, women’s groups, the private or commercial sector, different ministries [e.g., Health, Finance, Planning, Women’s Affairs], groups representing the poor, and others. (A3b) In your opinion, how has this degree of involvement in policy formulation affected implementation? 4 Health Policy Initiative | PIAT Interview Guide for Policymakers A4. In your opinion, how well was the policy disseminated to various implementing agencies? 1 Not disseminated 2 Limited dissemination 3 Disseminated widely; no forums for discussion 4 Disseminated widely; with forums for discussion (A4a) In your opinion, how has this degree of dissemination affected implementation? B. Social, Political, and Economic Context The core team should tailor the questions in this section to include any specific social, economic, or political issues that may affect policy implementation. B1. From your perspective, how do social factors—at either local or national levels—facilitate or hinder the process of implementing this policy? Please consider religious practices or beliefs, gender norms, cultural practices, ethnic affiliations, or social status. Social Factor (1) Indicate Facilitate/Hinder (2) Describe Effect (B1a) Religious practices or beliefs (B1a1) (B1a2) (B1b) Gender norms (B1b1) (B1b2) (B1c) Cultural practices (B1c1) (B1c2) 5 Health Policy Initiative | PIAT Interview Guide for Policymakers (B1d) Ethnic affiliations (B1d1) (B1d2) (B1e) Social status (B1e1) (B1e2) (B1f) Other (B1f1) (B1f2) B2. In your opinion, how do political factors—at either local or national levels— facilitate or hinder the process of implementing this policy? Please take into consideration changes in government, decentralization, policy environment, and international agreements (e.g., United Nations declarations, Millennium Development Goals). Political Factor (1) Indicate Facilitate/Hinder (2) Describe Effect (B2a) Changes in government (B2a1) (B2a2) (B2b) Decentralization; and/or divergent priorities at national and local levels (B2b1) (B2b2) (B2c) Policy environment, including alignment or conflict with other policies International agreements, programs, covenants, and priorities (B2c1) (B2c2) (B2d1) (B2d2) (B2d) 6 Health Policy Initiative | PIAT Interview Guide for Policymakers (B2e) Prioritization of poverty alleviation on the policy agenda (B2e1) (B2e2) (B2f) Other (B2f1) (B2f2) B3. In your opinion, how do economic factors—at either local or national levels—facilitate or hinder the process of implementing this policy? Please take into consideration domestic economic issues as well as global assistance priorities and mechanisms. Economic Factor (1) Indicate Facilitate/Hinder (2) Describe Effect (B3a) Unemployment (B3a1) (B3a2) (B3b) Migration (B3b1) (B3b2) (B3c) Poverty (B3c1) (B3c2) (B3d) Global assistance mechanisms, donor priorities (B3d1) (B3d2) (B3e) Other (B3e1) (B3e2) 7 Health Policy Initiative | PIAT Interview Guide for Policymakers C. Leadership for Policy Implementation C1. Currently, is there support among opinion leaders or influential institutions from any sector for implementing this policy? 1_Yes 2_No 8_Don’t know If yes Which opinion leaders or institutions support implementing this policy? (1) How is the support for implementing this policy manifested? (C1a) (C1a1) (C1b) (C1b1) (C1c) (C1c1) If no or don’t know, continue with C2. C2. Currently, is there opposition among opinion leaders or influential institutions from any sector for implementing this policy? 1_Yes 2_No 8_Don’t know If yes Which opinion leaders or institutions oppose implementing this policy? (C2a) (1) How is the opposition for implementing this policy manifested? (C2a1) (C2b) (C2b1) (C2c) (C2c1) If no or don’t know, continue with C3. C3. In your understanding, what is the lead institution for implementing the policy? ____________________________________________________________________________________ (C3a) Please explain. 8 Health Policy Initiative | PIAT Interview Guide for Policymakers C4. How effective is this institution’s leadership in implementing the policy? 1 Not effective 2 Somewhat effective 3 Mostly effective 4 Very effective (C4a) Please explain. D. Stakeholder Involvement in Policy Implementation D1. To what extent are different sectors within the government involved in implementing the policy? 1 None – only the key Ministry/agency 2 Limited involvement of various sectors 3 Moderate involvement of various sectors 4 Wide multisectoral involvement (D1a) Please explain. Ask about different ministries [e.g., Health, Finance, Planning, Women’s Affairs], departments [e.g., reproductive health and HIV programs within the Ministry of Health], agencies, and levels within the government. D2. To what extent are other stakeholders involved in implementing the policy? 1 None – only the government 2 Limited involvement of other nongovernmental stakeholders 3 Moderate involvement of other nongovernmental stakeholders 9 4 Wide involvement of other nongovernmental stakeholders Health Policy Initiative | PIAT Interview Guide for Policymakers (D2a) Please explain. Ask about different stakeholders, as appropriate based on the policy text analysis: NGOs, women’s groups, the private or commercial sector, groups representing the poor and other vulnerable populations, and others. There are no questions D3–D5 in the Policymakers interview guide. D6. What, if any, other organizations could be involved in order to improve implementation of the policy? Please identify organizations and explain why their participation would foster implementation. Organization (D6a) 1. Reason (D6a1) (D6b) (D6b1) E. Implementation Planning and Resource Mobilization If there is an official implementation plan, ask E1 to E5a, and then skip to question E13. If there is no implementation plan, skip to E6 and E7. E1. Are you familiar with insert the official title of the implementation plan here? 1_Yes 2_No If yes, continue with E2; otherwise skip to E13. 10 8_Don’t know Health Policy Initiative | PIAT Interview Guide for Policymakers E2. How helpful is insert the official title of the implementation plan here in implementing the policy? 1 Not helpful 2 Somewhat helpful 3 Helpful in most aspects 4 Very helpful (E2a) Please explain. E3. Do you have any suggestions for making the insert the official title of the implementation plan here more useful for implementing organizations or agencies? E4. To what extent does the implementation plan include strategies to address the needs of the poor or insert other underserved, vulnerable, or most at-risk populations as appropriate and their health status? 1 2 Does not address needs of the poor/ underserved Addresses some key issues affecting the poor/underserved 3 Addresses most of the key issues affecting the poor/ underserved 4 Addresses all key issues affecting the poor/underserved (E4a) Please explain. E5. To what extent does the implementation plan include strategies to address gender issues in the country, district, technical area…complete as appropriate per the policy text analysis? 1 Does not address key gender issues 2 Addresses some key gender issues 3 Addresses most of the key gender issues 11 4 Addresses all key gender issues Health Policy Initiative | PIAT Interview Guide for Policymakers (E5a) Please explain. Skip to E13. If there is no written implementation plan, ask E6 through E7a. E6. Because there is no overall implementation plan for the policy, what document is currently guiding the implementation of the policy? E7. How helpful is the document refer to the document mentioned in E6 to your organization for implementing the policy? 1 Not helpful 2 Somewhat helpful 3 Helpful in most aspects 4 Very helpful (E7a) Why? Please explain. There are no questions E8–E12 in the Policymakers interview guide. E13. Is there a mechanism in place to ensure funding for implementing this policy? 1_Yes 2_No If yes, ask E13a; if no, ask E13b. If don’t know, continue with E15. (E13a) Please explain the mechanism. 12 8_Don’t know Health Policy Initiative | PIAT Interview Guide for Policymakers (E13b) How will funding for this policy be sustained for the insert duration of the policy? Please explain. There is no question E14 in the Policymakers interview guide. E15. In your opinion, how sufficient are the financial resources that are being allocated for implementation of this policy? 1 Not sufficient 2 Somewhat sufficient 3 Mostly sufficient 4 Completely sufficient (E15a) Please explain. (E15b) If applicable, what do you recommend to increase financial resources available for implementing this policy? E16. Have there been problems or bottlenecks in the disbursement of funds? 1_Yes 2_No 8_Don’t know If yes, continue with E16a and E16b; otherwise skip to E19. (E16a) Please explain. (E16b) In your opinion how can these problems be resolved? There are no questions E17–E18 in the Policymakers interview guide. 13 Health Policy Initiative | PIAT Interview Guide for Policymakers E19. Do financial resource allocation decisions consider level of poverty and inequities, including gender? 1_Yes 8_Don’t know 2_No (E19a) Please explain. F. Operations and Services F1. In your opinion, how effective is the coordination among the various organizations that are implementing strategies designed to achieve the policy’s goals? 1 Not effective 2 Somewhat effective; many improvements needed 3 Mostly effective; some improvements needed 4 Very effective (F1a) Please explain. (F1b) If applicable, please describe any suggestions for improving this situation. F2a. Are you aware of any barriers to providing services under the policy? 1_Yes 2_No 8_Don’t know If yes, collect information below; otherwise, skip to F2b. Service (F2a1) (1) Barrier/Challenge (F2a1a) 14 Health Policy Initiative | PIAT Interview Guide for Policymakers (F2a2) (F2a2a) (F2a3) (F2a3a) F2b. Are you aware of any positive changes in providing services under the policy? 1_Yes 2_No 8_Don’t know If yes, collect information below; otherwise, continue with F3. (F2b1) Service (1) Positive Change (F2b1a) (F2b2) (F2b2a) (F2b3) (F2b3a) F3. In your opinion, do the key implementing organizations have the flexibility to adapt strategies and activities to respond to local needs? 1 No flexibility 2 Some flexibility 3 Quite a bit of flexibility 4 Complete flexibility (F3a) Please explain. (F3b) If applicable, please describe any suggestions for improving the situation. 15 Health Policy Initiative | PIAT Interview Guide for Policymakers G. Feedback on Progress and Results G1. What institution(s) is monitoring the implementation of this policy? G2. What methodology is being used to monitor the implementation of this policy? If the respondent has difficulty identifying methods, ask about specific approaches, such as regular meetings, periodic reports, site visits, service statistics, client satisfaction surveys, etc. G3. What indicators are used to monitor the implementation of the policy? G4a. How are the following key gender issues/strategies relating to the policy’s implementation being assessed? If the respondent has difficulty identifying methods, ask about specific approaches, such as use of genderbased indicators, sex-disaggregated data, other gender analyses or studies. If more than one issue/strategy is mentioned, please list separately. (G4a1) Please explain. Fill in gender issue identified during the policy text analysis (G4a2) Please explain. Fill in gender issue identified during the policy text analysis (G4a3) Please explain. Fill in gender issue identified during the policy text analysis 16 Health Policy Initiative | PIAT Interview Guide for Policymakers G4b. How are the following key poverty and equity issues/strategies relating to the policy’s implementation being assessed? If the respondent has difficulty identifying methods, ask about specific approaches, such as use of equitybased indicators, quintile analysis, other poverty assessment tools. If more than one issue/strategy is mentioned, please list separately. (G4b1) Please explain. Fill in poverty and equity issue identified during the policy text analysis (G4b2) Please explain. Fill in poverty and equity issue identified during the policy text analysis (G4b3) Please explain. Fill in poverty and equity issue identified during the policy text analysis There is no question G5 in the Policymaker interview guide. G6. Are you receiving feedback on how this policy is being implemented overall? 1_Yes 2_No 8_Don’t know If no or don’t know, proceed to G6e. If yes (G6a) What type of information? (G6b) From whom? (G6c) How helpful is this feedback to you in your position? 1 Not helpful 2 Somewhat 3 Mostly helpful 17 4 Very helpful Health Policy Initiative | PIAT Interview Guide for Policymakers (G6d) Please explain. (G6e) What additional information would you like to receive regarding the process of implementing the policy, if any? H. Overall Assessment H1. Overall, how well do you think the policy is being implemented? 1 Not being implemented 2 Partly implemented 3 Many parts of the policy are being implemented 4 Overall, implementation is proceeding very well (H1a) Please explain. H2. Are you beginning to see positive changes as a result of implementing this policy? 1_Yes 2_No 8_Don’t know If yes If no or don’t know (H2a) What are these changes? (H2b) Why do you think there are no changes so far? H3. Would additional policy action—such as issuance of a law or operational guidelines—facilitate the implementation of this policy? 1_Yes 8_Don’t know 2_No 18 Health Policy Initiative | PIAT Interview Guide for Policymakers If yes, ask H3a and H3b; otherwise, skip to H4. (H3a) What additional policy action is needed? (H3b) What office should take this policy action? H4. In the process of implementing the policy, which initiatives/activities at the local or national levels have been successful or serve as lessons learned? Please explain. H5. In addition to what you have already mentioned above, do you have any additional suggestions that would improve implementation of this policy? Please describe. Thank you. Thank you and follow-up. Please thank the respondent for the time, and provide your contact information for any follow-up questions or concerns. Describe the next steps for disseminating and discussing the results as agreed among the core team. Obtain the respondent’s initial interest and availability in participating in the follow-up activities. This would typically include the following, but should be developed as appropriate for each assessment. Analyze responses Present findings at a forum for stakeholders for discussion Based on discussions, develop strategies for further steps 19