Tool/Methodology for Monitoring Policy Implementation

advertisement
Health Policy Initiative | PIAT Interview Guide for Policymakers
Policy Implementation
Assessment Tool
Master Interview Guide
May 2010
POLICYMAKERS
This master interview guide was prepared by the USAID | Health Policy Initiative,
Task Order 1. In-country teams should adapt this master interview guide to the
specific policy of interest and the given country or local context.
To learn more about applying the tool, please see the paper Taking the Pulse of Policy:
The Policy Implementation Assessment Tool (2010), available at
www.healthpolicyinitiative.com/policyimplementation.
Health Policy Initiative | PIAT Interview Guide for Policymakers
Policy Implementation Interview Guide for
Policymakers
Basic Information about the Policymaker
Please obtain and enter all basic information about the policymaker before the interview.
Name of policymaker:______________________________________________________________
Official title: _____________________________________________________________________
Sex:
F: ______
M: ______
Agency/organization: ______________________________________________________________
Length of time at agency/organization: ________________________________________________
Office address: ___________________________________________________________________
Email and contact numbers: ________________________________________________________
Date(s) of interview:_______________________________________________________________
Name of interviewer: ______________________________________________________________
The following information about the policy is to be completed by the core team before data collection
starts. Print this on a separate sheet of paper to give to the respondent.
Full name (and number if applicable) of the policy that is the focus of the assessment:________
_________________________________________________________________________________
Issuing body/institution:____________________________________________________________
________________________________________________________
Date officially approved:____________________________________________________________
_________________________________________________________________________________
Policy goal (as stated in the policy):___________________________________________________
_________________________________________________________________________________
Policy objectives (as stated in the policy): ______________________________________________
_________________________________________________________________________________
Policy timeframe (as stated in the policy):_____________________________________________
_________________________________________________________________________________
1
Health Policy Initiative | PIAT Interview Guide for Policymakers
Note to Interviewer:








All questions or phrases to read aloud are in bold font.
Items to be filled in by the core team prior to the interviews are italicized and shaded in
gray. Some of these items will be filled in based on the findings from the policy text analysis
completed by the core team prior to application of this tool.
All instructions to interviewers are italicized and enclosed by double-lined boxes. They
should not be read aloud.
Ask each question as stated in the interview guide. If the key informant states that he/she
does not really know the answer, write “DK” (“Don’t know”).
Numbered categories of responses are provided for several questions. Read out the
categories to the respondent and circle the corresponding number of the respondent’s
choice. Choices should not fall between two numbers; in such cases, the interviews should
encourage the respondents to choose the number that best reflects their viewpoint.
Most questions request the key informant to specify or explain further. Please probe
appropriately to obtain the underlying reasons. Write down any comments or
recommendations that the key informant gives. Interviewers are encouraged to probe in the
case of open-ended questions. Use spaces provided and the margins or the back pages of the
interview guide if more space is needed.
In some instances, a respondent may decline to answer a specific question. If so, write down
“Declined,” then ask the respondent if it is okay to ask the next question. If the respondent
agrees to continue, be sure to ask the next applicable question based on “Skip” instructions.
In case questions arise, make sure you have a copy of the policy with you.
Introduction
Good morning Sir/Madam [or as appropriate]. Thank you very much for making time for this
interview. My name is [state your name] and I work for [state your organization]. We are
interviewing policymakers regarding the implementation of the insert exact title of the policy.
By policy implementation, we mean the activities and operations of various stakeholders toward
achieving the goals and objectives articulated in an authorized policy—in this case, the insert the
policy.
The purpose of this assessment is to analyze how well insert the policy is being implemented. The
results of the interviews can be used by policymakers and stakeholders to clarify guidelines and
directives, address barriers to implementation, improve resource mobilization, update
implementation plans, or advocate for policy reform.
This interview includes close-ended questions as well as questions that are open ended. We
anticipate the interview will last about one hour.
CONSENT
Please be assured that all your responses will be held in strict confidence; findings will be
presented in aggregate, and no statements used in the report will be attributed directly to
you. Your participation is voluntary, and you may decline to answer any question or end
the interview at any point. Do you agree to continue?
___Yes
___No
____________Interviewer’s Initials
2
Health Policy Initiative | PIAT Interview Guide for Policymakers
Review the goals and objectives of the policy (listed above on the first page of the interview guide).
Confirm with the respondent that he/she is aware of the contents of this policy and can answer questions
about its implementation. Tips for conducting the interview are enclosed in these double-lined boxes.
A. The Policy, Its Formulation, and Dissemination
A1.
Referring to the goals and objectives of this policy, to what extent do you think these goals
and objectives address the key issues in the country, district, technical area…complete as
appropriate for the policy?
1
Do not address
important issues
2
Address some key
issues, but many
missing
3
Address most of
the key issues, but
some missing
4
Address all key issues
(A1a) Why? Please explain.
A1b.
To what extent does the policy address the needs of the poor or insert other underserved, vulnerable,
or most at-risk populations as appropriate based on the policy text analysis and their health status?
1
Does not address
needs of the poor/
underserved
2
3
Addresses most of
the key issues
affecting the
poor/underserved
Addresses some key
issues affecting the
poor/underserved
4
Addresses all key
issues affecting the
poor/underserved
(A1b1) Please explain.
A1c.
To what extent does the policy address gender issues in the country, district, technical area…complete
as appropriate per the policy text analysis?
1
Does not address
key gender issues
2
Addresses some key
gender issues
3
Addresses most of
the key gender issues
3
4
Addresses all key
gender issues
Health Policy Initiative | PIAT Interview Guide for Policymakers
(A1c1) Please explain.
If the policy specifies a timeframe, read out the timeframe then ask question A2; otherwise skip to A3.
A2.
In your opinion, are the goals and objectives achievable within the timeframe set out in the policy?
1_Yes
2_No
8_Don’t know
(A2a) Why? Please explain.
A3.
How extensive was the involvement of various stakeholders during the process of formulating the
policy?
1
2
3
4
No involvement
Limited involvement
Moderate involvement
Extensive involvement
(A3a) Please explain.
Ask about different stakeholders, as
appropriate based on the policy
text analysis: NGOs, women’s
groups, the private or commercial
sector, different ministries [e.g.,
Health, Finance, Planning,
Women’s Affairs], groups
representing the poor, and others.
(A3b) In your opinion, how has this degree of involvement in policy formulation affected
implementation?
4
Health Policy Initiative | PIAT Interview Guide for Policymakers
A4.
In your opinion, how well was the policy disseminated to various implementing agencies?
1
Not disseminated
2
Limited dissemination
3
Disseminated
widely; no forums
for discussion
4
Disseminated widely; with
forums for discussion
(A4a) In your opinion, how has this degree of dissemination affected implementation?
B. Social, Political, and Economic Context
The core team should tailor the questions in this section to include any specific social, economic, or
political issues that may affect policy implementation.
B1.
From your perspective, how do social factors—at either local or national levels—facilitate or hinder
the process of implementing this policy? Please consider religious practices or beliefs, gender
norms, cultural practices, ethnic affiliations, or social status.
Social Factor
(1) Indicate
Facilitate/Hinder
(2) Describe Effect
(B1a)
Religious
practices or
beliefs
(B1a1)
(B1a2)
(B1b)
Gender norms
(B1b1)
(B1b2)
(B1c)
Cultural practices
(B1c1)
(B1c2)
5
Health Policy Initiative | PIAT Interview Guide for Policymakers
(B1d)
Ethnic affiliations
(B1d1)
(B1d2)
(B1e)
Social status
(B1e1)
(B1e2)
(B1f)
Other
(B1f1)
(B1f2)
B2.
In your opinion, how do political factors—at either local or national levels— facilitate or hinder the
process of implementing this policy? Please take into consideration changes in government,
decentralization, policy environment, and international agreements (e.g., United Nations
declarations, Millennium Development Goals).
Political Factor
(1) Indicate
Facilitate/Hinder
(2) Describe Effect
(B2a)
Changes in
government
(B2a1)
(B2a2)
(B2b)
Decentralization;
and/or divergent
priorities at
national and local
levels
(B2b1)
(B2b2)
(B2c)
Policy
environment,
including
alignment or
conflict with other
policies
International
agreements,
programs,
covenants, and
priorities
(B2c1)
(B2c2)
(B2d1)
(B2d2)
(B2d)
6
Health Policy Initiative | PIAT Interview Guide for Policymakers
(B2e)
Prioritization of
poverty alleviation
on the policy
agenda
(B2e1)
(B2e2)
(B2f)
Other
(B2f1)
(B2f2)
B3.
In your opinion, how do economic factors—at either local or national levels—facilitate or hinder
the process of implementing this policy? Please take into consideration domestic economic issues as
well as global assistance priorities and mechanisms.
Economic Factor
(1) Indicate
Facilitate/Hinder
(2) Describe Effect
(B3a)
Unemployment
(B3a1)
(B3a2)
(B3b)
Migration
(B3b1)
(B3b2)
(B3c)
Poverty
(B3c1)
(B3c2)
(B3d)
Global assistance
mechanisms,
donor priorities
(B3d1)
(B3d2)
(B3e)
Other
(B3e1)
(B3e2)
7
Health Policy Initiative | PIAT Interview Guide for Policymakers
C. Leadership for Policy Implementation
C1.
Currently, is there support among opinion leaders or influential institutions from any sector for
implementing this policy?
1_Yes
2_No
8_Don’t know
If yes
Which opinion leaders or institutions
support implementing this policy?
(1) How is the support for implementing
this policy manifested?
(C1a)
(C1a1)
(C1b)
(C1b1)
(C1c)
(C1c1)
If no or don’t know, continue with C2.
C2.
Currently, is there opposition among opinion leaders or influential institutions from any
sector for implementing this policy?
1_Yes
2_No
8_Don’t know
If yes
Which opinion leaders or institutions
oppose implementing this policy?
(C2a)
(1) How is the opposition for implementing
this policy manifested?
(C2a1)
(C2b)
(C2b1)
(C2c)
(C2c1)
If no or don’t know, continue with C3.
C3.
In your understanding, what is the lead institution for implementing the policy?
____________________________________________________________________________________
(C3a) Please explain.
8
Health Policy Initiative | PIAT Interview Guide for Policymakers
C4.
How effective is this institution’s leadership in implementing the policy?
1
Not effective
2
Somewhat effective
3
Mostly effective
4
Very effective
(C4a) Please explain.
D. Stakeholder Involvement in Policy Implementation
D1.
To what extent are different sectors within the government involved in implementing the policy?
1
None – only the
key Ministry/agency
2
Limited involvement
of various sectors
3
Moderate involvement
of various sectors
4
Wide multisectoral
involvement
(D1a) Please explain.
Ask about different ministries
[e.g., Health, Finance, Planning,
Women’s Affairs], departments
[e.g., reproductive health and
HIV programs within the
Ministry of Health], agencies,
and levels within the government.
D2.
To what extent are other stakeholders involved in implementing the policy?
1
None – only the
government
2
Limited involvement
of other
nongovernmental
stakeholders
3
Moderate involvement
of other
nongovernmental
stakeholders
9
4
Wide involvement of
other nongovernmental
stakeholders
Health Policy Initiative | PIAT Interview Guide for Policymakers
(D2a) Please explain.
Ask about different stakeholders, as
appropriate based on the policy text
analysis: NGOs, women’s groups, the
private or commercial sector, groups
representing the poor and other
vulnerable populations, and others.
There are no questions D3–D5 in the Policymakers interview guide.
D6.
What, if any, other organizations could be involved in order to improve implementation of the
policy? Please identify organizations and explain why their participation would foster
implementation.
Organization
(D6a)
1. Reason
(D6a1)
(D6b)
(D6b1)
E. Implementation Planning and Resource Mobilization
If there is an official implementation plan, ask E1 to E5a, and then skip to question E13.
If there is no implementation plan, skip to E6 and E7.
E1.
Are you familiar with insert the official title of the implementation plan here?
1_Yes
2_No
If yes, continue with E2; otherwise skip to E13.
10
8_Don’t know
Health Policy Initiative | PIAT Interview Guide for Policymakers
E2.
How helpful is insert the official title of the implementation plan here in implementing the
policy?
1
Not helpful
2
Somewhat helpful
3
Helpful in
most aspects
4
Very helpful
(E2a) Please explain.
E3.
Do you have any suggestions for making the insert the official title of the implementation plan here
more useful for implementing organizations or agencies?
E4.
To what extent does the implementation plan include strategies to address the needs of the poor or
insert other underserved, vulnerable, or most at-risk populations as appropriate and their health status?
1
2
Does not address
needs of the poor/
underserved
Addresses some key
issues affecting the
poor/underserved
3
Addresses most of
the key issues
affecting the poor/
underserved
4
Addresses all key
issues affecting the
poor/underserved
(E4a) Please explain.
E5.
To what extent does the implementation plan include strategies to address gender issues in the
country, district, technical area…complete as appropriate per the policy text analysis?
1
Does not address
key gender issues
2
Addresses some key
gender issues
3
Addresses most of
the key gender issues
11
4
Addresses all key
gender issues
Health Policy Initiative | PIAT Interview Guide for Policymakers
(E5a) Please explain.
Skip to E13. If there is no written implementation plan, ask E6 through E7a.
E6.
Because there is no overall implementation plan for the policy, what document is currently
guiding the implementation of the policy?
E7.
How helpful is the document refer to the document mentioned in E6 to your organization for
implementing the policy?
1
Not helpful
2
Somewhat helpful
3
Helpful in
most aspects
4
Very helpful
(E7a) Why? Please explain.
There are no questions E8–E12 in the Policymakers interview guide.
E13.
Is there a mechanism in place to ensure funding for implementing this policy?
1_Yes
2_No
If yes, ask E13a; if no, ask E13b. If don’t know, continue with E15.
(E13a) Please explain the mechanism.
12
8_Don’t know
Health Policy Initiative | PIAT Interview Guide for Policymakers
(E13b) How will funding for this policy be sustained for the insert duration of the policy? Please
explain.
There is no question E14 in the Policymakers interview guide.
E15.
In your opinion, how sufficient are the financial resources that are being allocated for
implementation of this policy?
1
Not sufficient
2
Somewhat sufficient
3
Mostly sufficient
4
Completely sufficient
(E15a) Please explain.
(E15b) If applicable, what do you recommend to increase financial resources available for
implementing this policy?
E16.
Have there been problems or bottlenecks in the disbursement of funds?
1_Yes
2_No
8_Don’t know
If yes, continue with E16a and E16b; otherwise skip to E19.
(E16a) Please explain.
(E16b) In your opinion how can these problems be resolved?
There are no questions E17–E18 in the Policymakers interview guide.
13
Health Policy Initiative | PIAT Interview Guide for Policymakers
E19.
Do financial resource allocation decisions consider level of poverty and inequities, including
gender?
1_Yes
8_Don’t know
2_No
(E19a) Please explain.
F. Operations and Services
F1.
In your opinion, how effective is the coordination among the various organizations that are
implementing strategies designed to achieve the policy’s goals?
1
Not effective
2
Somewhat effective;
many improvements
needed
3
Mostly effective; some
improvements needed
4
Very effective
(F1a) Please explain.
(F1b) If applicable, please describe any suggestions for improving this situation.
F2a.
Are you aware of any barriers to providing services under the policy?
1_Yes
2_No
8_Don’t know
If yes, collect information below; otherwise, skip to F2b.
Service
(F2a1)
(1) Barrier/Challenge
(F2a1a)
14
Health Policy Initiative | PIAT Interview Guide for Policymakers
(F2a2)
(F2a2a)
(F2a3)
(F2a3a)
F2b.
Are you aware of any positive changes in providing services under the policy?
1_Yes
2_No
8_Don’t know
If yes, collect information below; otherwise, continue with F3.
(F2b1)
Service
(1) Positive Change
(F2b1a)
(F2b2)
(F2b2a)
(F2b3)
(F2b3a)
F3.
In your opinion, do the key implementing organizations have the flexibility to adapt strategies and
activities to respond to local needs?
1
No flexibility
2
Some flexibility
3
Quite a bit of
flexibility
4
Complete flexibility
(F3a) Please explain.
(F3b) If applicable, please describe any suggestions for improving the situation.
15
Health Policy Initiative | PIAT Interview Guide for Policymakers
G. Feedback on Progress and Results
G1.
What institution(s) is monitoring the implementation of this policy?
G2.
What methodology is being used to monitor the implementation of this policy?
If the respondent has difficulty
identifying methods, ask about
specific approaches, such as
regular meetings, periodic reports,
site visits, service statistics, client
satisfaction surveys, etc.
G3.
What indicators are used to monitor the implementation of the policy?
G4a.
How are the following key gender issues/strategies relating to the policy’s implementation being
assessed?
If the respondent has difficulty identifying methods, ask about specific approaches, such as use of genderbased indicators, sex-disaggregated data, other gender analyses or studies.
If more than one issue/strategy is mentioned, please list separately.
(G4a1) Please explain.
Fill in gender issue identified
during the policy text analysis
(G4a2) Please explain.
Fill in gender issue identified
during the policy text analysis
(G4a3) Please explain.
Fill in gender issue identified
during the policy text analysis
16
Health Policy Initiative | PIAT Interview Guide for Policymakers
G4b.
How are the following key poverty and equity issues/strategies relating to the policy’s
implementation being assessed?
If the respondent has difficulty identifying methods, ask about specific approaches, such as use of equitybased indicators, quintile analysis, other poverty assessment tools.
If more than one issue/strategy is mentioned, please list separately.
(G4b1) Please explain.
Fill in poverty and equity issue
identified during the policy text
analysis
(G4b2) Please explain.
Fill in poverty and equity issue
identified during the policy text
analysis
(G4b3) Please explain.
Fill in poverty and equity issue
identified during the policy text
analysis
There is no question G5 in the Policymaker interview guide.
G6.
Are you receiving feedback on how this policy is being implemented overall?
1_Yes
2_No
8_Don’t know
If no or don’t know, proceed to G6e.
If yes
(G6a) What type of information?
(G6b) From whom?
(G6c) How helpful is this feedback to you in your position?
1
Not helpful
2
Somewhat
3
Mostly helpful
17
4
Very helpful
Health Policy Initiative | PIAT Interview Guide for Policymakers
(G6d) Please explain.
(G6e) What additional information would you like to receive regarding the process of
implementing the policy, if any?
H. Overall Assessment
H1.
Overall, how well do you think the policy is being implemented?
1
Not being
implemented
2
Partly implemented
3
Many parts of the
policy are being
implemented
4
Overall, implementation
is proceeding very well
(H1a) Please explain.
H2.
Are you beginning to see positive changes as a result of implementing this policy?
1_Yes
2_No
8_Don’t know
If yes
If no or
don’t know
(H2a) What are these changes?
(H2b) Why do you think there are no changes so far?
H3.
Would additional policy action—such as issuance of a law or operational guidelines—facilitate the
implementation of this policy?
1_Yes
8_Don’t know
2_No
18
Health Policy Initiative | PIAT Interview Guide for Policymakers
If yes, ask H3a and H3b; otherwise, skip to H4.
(H3a) What additional policy action is needed?
(H3b) What office should take this policy action?
H4.
In the process of implementing the policy, which initiatives/activities at the local or national levels
have been successful or serve as lessons learned? Please explain.
H5.
In addition to what you have already mentioned above, do you have any additional suggestions
that would improve implementation of this policy? Please describe.
Thank you.
Thank you and follow-up.
Please thank the respondent for the time, and provide your contact information for any follow-up
questions or concerns. Describe the next steps for disseminating and discussing the results as agreed
among the core team. Obtain the respondent’s initial interest and availability in participating in the
follow-up activities. This would typically include the following, but should be developed as appropriate
for each assessment.



Analyze responses
Present findings at a forum for stakeholders for discussion
Based on discussions, develop strategies for further steps
19
Download