Research Data Summary

advertisement
Effective Monitoring and Beneficiary Accountability Practices for Projects Implemented
Remotely in Insecure Environments: Summary of Individual Interview Participants
Note: This paper summarises key information from 28 organisations that participated in an individual interview for this
research project. It is not intended to be a representative survey of all humanitarian actors operating in Afghanistan or
elsewhere.
1. Demographics of Participant Organisations
Twenty-eight organisations participated in research interviews:
 20 INGOs, including five based outside Afghanistan. Apart from two INGOs, all operated projects in
Afghanistan. National NGOs were not included in the research but many INGO’s operated through
national partners.
 Four Institutional Donors and four Research & Good Practice Organisations.
Figure 1: Total humanitarian actors that participated in the research (28)1
20
Work only in
Afghanistan
15
10
Work in Afghanistan &
other countries
5
Development
Both
Humanitarian
0
Interna tiona l NGOs (20)
Ins titutiona l Donor (4)
Res ea rch & Good Pra ctice
Orga ni s a tions (4)
Sixteen2 INGOs and Good Practice & Research organisation participants operated in countries other than
Afghanistan.
Figure 2: Countries other than Afghanistan with operations by research participants (INGOs and Good Practice
& Research Organisations)
Other (5)*
Is ra el - Ga za (6)
South Suda n (13)
Soma l i a (9)
Pa ki s tan (12)
Sri La nka (10)
North Suda n (11)
* ‘Other’ countries include Iraq,
Myanmar (Burma) & Chad
1
Of the 20 INGOs interviewed, five were based outside Afghanistan, including two that did not work in Afghanistan. One of the
NGOs based in Afghanistan, despite having international funding sources and an international Board of Directors, is managed by a
national Programme Director. There are three expatriate staff working in this organisation, all subordinate to the national
Programme Director. This organisation was observed to run similarly to a national NGO.
2 This includes INGOs based in Afghanistan (10), INGOs based outside Afghanistan (5) and one Good Practice & Research
Organisation.
1
INGO participants (20) interviewed in the research were mostly large and medium-sized.
Figure 3: Size of INGO participants (19), based on number of expatriate and national/local employees in
Afghanistan
12
National staff
Expatriate
staff
10
6
3
4
3
Large
> 20 expa tri a te s ta ff
> 200 na ti ona l s ta ff
Medium
6-20 expa tri a te s ta ff
101-200 na ti ona l s ta ff
Small
1-5 expa tri a te s ta ff*
1-100 na ti ona l s ta ff
* Total INGOs sum to 19 because it excludes one INGO based outside Afghanistan that works solely through partner
organisations. The INGOs has no staff in Afghanistan and programmes are managed remotely from UK Head Office.
All twenty INGO participants have more than five years experience operating or supporting work in
Afghanistan; ten have more than 20 years experience.3
The twenty INGO participants implement humanitarian and development projects across a wide range of
sectors. The most common sectors were WASH, Livelihoods and Education.
Figure 4: Types of projects implemented by 20 INGO participants4
Emergency
Response
(9)
Food
Security (6)
Water,
Sanitation and
Hygiene (WASH)
(12)
Disaster Risk
Reduction
(3)
Infrastructure
Livelihoods (10)
/Construction
(3)
Community
Development
(7)
(x) = number of
organisations with
Agriculture
National
project type
(6)
Solidarity
Prog. (3)
Education
(15)
Psycho
/ Social
(2)
Capacity
Building
(3)
Conflict
Resolution
/ Peace (3)
Women’s
Rights (7)
Legal
Support
Refugee
(1)
Resettlement
(1)
Good Practice & Research Organisation participants only identified projects in the education sector as having
the potential to be successfully implemented and monitored under remote management. 5
Eighteen INGO participants implement projects in multiple provinces in Afghanistan; most work in four or
more provinces.
3
This includes INGOs based in and outside Afghanistan with 6-10 years (7); 11-20 years (3); 21-30 years (6) and more than 30 years
(4).
4 The 20 INGO participants include five based outside Afghanistan, of which two have no projects in Afghanistan.
5
Three of the four agencies interviewed were not in favour of remote management approaches. Their representatives spoke from
experience of having seen programmes poorly implemented (or not implemented at all) due to remote management approaches. It was
the general assessment of these three organisations that there would be no humanitarian and/or development sector that would lend
itself successfully to remote management – all experiencing issues and problems. One agency remarked that Education might be more
successfully implemented, whilst another commented that Basic Service Provision might be successfully implemented. The interviewer
was given the impression that the type of sector implemented is not the key issue. Rather, the issue is in relation to the management
approach itself, which is not supported by any of the three organisations.
2
Collectively, the four institutional donor participants support projects or humanitarian interventions in 33 out
of 34 provinces in Afghanistan.
The majority of participant INGOs operated projects in locations directly through their own staff. In
approximately one-third of directly operated locations, the organisation had limited or no expatriate presence.
Few project locations were operated through national partners, international partner or local community. No
participant INGO’s operated projects through private contractors.
Figure 5: Mode of Operation in INGO Participant’s Project Locations
No. of Project Locations
50
40
30
20
10
0
Di rect Opera tions Di rect but Li mi ted
Pres ence
Na tiona l
Pa rtner
Int'l .
Pa rtner
Loca l
Comm'y
Financial incentives and R&R benefits for staff are implemented by 196 INGOs participants:7
 Six have a voluntary expatriate staff base and do not pay expatriate salaries. All 19 pay salaries to
national staff (relocated and local).
 All provide expatriate staff with R&R benefits. These also apply to relocated national staff in seven
INGOs. Very few (2) apply R&R benefits to local staff.
 Half (9) provide a financial incentive to expatriate or relocated national staff working in insecure
locations.8 Fewer (5) INGOs provide financial incentive to local staff working in insecure locations.
6
Total INGOs sum to 19 because it excludes one INGO based outside Afghanistan that works solely through partner organisations
and has no staff in Afghanistan.
7 Several organisations emphasised that capacity building and an understanding of organisational ethos had a greater impact on
staff retention and staff capacity than did organisational salaries, financial incentives and other benefits. These organisations often
noted that there salaries were not comparable to larger organisations (e.g. UN and Government agencies), and that they preferred
to focus on building capacity through training workshops and mentoring.
8 Several organisations noted that financial incentives were provided based on ‘hardship’ (e.g. for remote locations as well as
insecure). It was also recognised by one organisation that the payment is made in view of ‘increased responsibility’ (and a review of
the job description). One organisation also noted a creative approach to probation – easing staff into insecure project locations
over a three month period of time. This was noted to have encouraged staff retention.
3
2. Remote-Management
Of the 20 INGO participants, 14 have remotely managed projects. The main rationale that INGOs gave for
adopting a remote management operational approach were 1) their organisational priority to work through
national partners, and 2) a response to a general deterioration in security.
Figure 6: Participant INGOs’ Rationale for Remote Management Operational Approach
25
* ‘Other’
includes cost
effectiveness
and forced
circumstances
given national
political
change.
20
15
10
5
0
Orga ni s a tiona l Pri ori ty
to work through
Na tiona l Pa rtners
Genera l Deteri ora tion
i n Securi ty
Speci fi c Securi ty
Inci dent
Other*
Rationale for Remote Management Operational Approach
Of the 14 INGOs with remotely managed projects, less than half have an existing remote management policy
or strategy in place, or criteria for ending remote management in insecure project locations9.
Figure 7: Number of Participant INGOs with Remote Management Strategies & Criteria
20
15
Not in place*
10
5
0
Partnership Policy
Remote Management
Strategy
In place
Remote Ma na gement / Pa rtners hi p
Stra tegy
Cri teri a to End Remote Ma na gement
Pa rtici pa nt INGOs wi th Remote Ma na ged Projects (14)
*This includes 2 INGOs that plan to develop criteria for ending remote management, and 1 INGO that plans
to develop a Remote Management Strategy. Two INGOs operate RM as standard practice.
9
It was noted that often while organisations did not have a formalised remote management policy that set out the criteria by
which standard operations would resume or projects would close down, it was clear from discussions that many organisations had
thought through the ‘return’ criteria (e.g. significant improvement in security). Those organisations which were able to
demonstrate this thinking have been included in the ‘Confirmed Criteria in Place’ column.
4
One of the four institutional donor participants has an ‘official stance’ or policy related to remote
management; two do not.10
Two-thirds of INGO participants have a programme wide and/or project specific security plan and risk analysis
is in place, which most review quarterly or twice-yearly:
 The responsibility for reviewing and updating the programme wide and/or specific security plan and risk
analysis is a joint effort between all staff and senior leadership.
 The majority (15) provide training on security plans and risk mitigation to expatriate staff and most to
national and local staff. Five (all based in Afghanistan) provide no security training to staff.
Figure 8: Number of Participant INGOs with Security Plan & Risk Analysis
20
Not in Place
15
Annually
10
In place, and
reviewed:
Bi-annual
5
Quarterly
0
Security Plan & Risk Analysis
among all participant INGOs (20)
The four institutional donor participants identified nine provinces in total that are ‘out of bounds’ for their
personnel to visit.11
More broadly, most of the INGO donors identified by the INGO participants (see figure 11) are able to visit
project sites or offices, however, in nearly all cases visits are dependent on security. Institutional donors who
do not visit project sites or offices include: DFID; Scottish Government; USAID; OFDA; Danish Government; Jersey
Aid.
10
The fourth institutional donor interviewed could not confirm whether or not there was a policy related to remote management.
11
It was noted that this fluctuates depending on the security situation of each province. Each institutional funding agency keeps a
‘watching brief’ on the security situation of the provinces in which they are supporting programmes. Decisions on when and whether to
visit project locations will be made closer to the time of the visit.
5
3. Monitoring and Beneficiary Accountability in Remotely Managed Projects
The most common issues identified by project stakeholders, relevant to monitoring remotely managed
projects, were the affect on programme quality, compromises to effective and rigorous monitoring, limited
capacity of personnel, and the security risk posed to staff and the community.
Figure 9: Issues identified by all 28 participants relevant to monitoring and beneficiary accountability projects
operating under remote management
Programming
Monitoring
Compromises
effective &
rigorous
monitoring (13)
Programme
Quality
(14)
Weak technical
oversight
(10)
Capacity
Staff & Security
Limited capacity
of personnel (own
& partner)
(11)
Inaccurate data
& reporting
(11)
Fewer
opportunities
to build staff
capacity
(6)
Poor
communication
(10)
Irregular access
to projects
(11)
Increased
pressure &
expectation (social
& political)
(7)
Increased
security
threat & risks
(8)
Fraud &
Corruption
(6)
Key issues identified by INGOs, specific to staff and/or partner capacity to monitor remotely managed projects
were the capacity to undertake robust monitoring of projects, to collect data, and to write reports (including in
English).
Figure 10: Staff and/or partner capacity issues related to monitoring & beneficiary accountability identified by
INGOs12
Monitoring & Reporting Skills
Management Skills
Project Cycle
Donor
Management
Relations
&
(4)
Funding
Cycles (2)
Undertaking
Robust
Monitoring (12)
Data Collection
(12)
Report Writing
(9)
Data
Analysis (5)
Understanding Concepts of:
M&E
(3)
Beneficiary
Accountability
(3)
Humanitarian
Action
Development (2)
Action
(2)
People
Management
(1)
12
It was noted that issues are exacerbated due to high turnover of personnel. In Afghanistan, particularly in high insecure
environments (and short-term emergency response projects) it can be difficult to develop and to retain capacity and institutional
knowledge. Organisations varied in terms of the level of capacity building initiatives that were in place to build staff capacity. Some
had developed internal structures which they invested in heavily. Others outsourced much of the training. Almost all organisations,
however, recognised that this is a key area that they invest in (and one which they feel impacts their staff retention).
6
In response to the issues identified above, the most common practices adopted by INGOs include:
 Regular monitoring visits from head office to field location by objective personnel (16)
 Dedicated M&E capacity (team / coordinator) (13)
 Mentoring and training focus on organisational values and ethos (7)
 Intentional focus on capacity building and training of local / national staff (5)
Good Practice & Research Organisation participants most commonly recommended the following practices to
improve monitoring of remote managed projects:
 Stronger data analysis and reporting procedures (4)
 Intentional focus on ensuring that monitoring and evaluation systems are in place from the start of
the project (3)
 Develop community relationship over long-term period (3)
Institutional Donor participants most commonly recommended the following practices to improve monitoring
of remote managed projects:
 Regular monitoring visits from head office to field location by objective personnel (4)
 Intentional focus on capacity building and training of local/national staff (3)
 Controls-based micro management approach (management and monitoring) (3)
All institutional donors identified by participant INGOs set the framework for INGOs’ project monitoring and
reporting. The level of involvement by each institutional donor in setting and following up on parameters for
project monitoring and beneficiary accountability varies widely:
 For the majority of institutional donors, evaluations or mid-term reviews varies are ‘not always’ required
and vary by project. A number of institutional donors however, do require evaluations or project reviews
(AusAid; Dutch Govt; ECHO; Jersey Aid; SIDA; BPRM; International NGOs (collective); USAID; OFDA). Only
two donors identified by INGOs did not require project evaluations or reviews.
Figure 11: Level of involvement of institutional donors in project monitoring, as identified by INGOs
Level of Donor Involvement:
Limited
Jersey Aid
Norwegian Gov’t
USAIS
OFDA
Scottish Gov’t
Medium
Afghan Gov’t
CIDA
Danish Gov’t
DFID
MFA
Italian Gov’t
BPRM
Irish Aid
Significant
UN Agencies (various)
International NGOs (various)
Norwegian Embassy
Highly Significant
AusAid
Dutch Gov’t
EC
ECHO
SIDA
Two-thirds of interviewees from INGOs believe that effective monitoring and adequate beneficiary
accountability needs can be met in projects that are remotely managed (Figure 12). Half of the four
interviewees from Good Practice & Research Organisations also believe this is possible.
Three of the four institutional donor participants will fund partners that use remote management to
implement projects; two currently do. One institutional donor participant is opposed to funding partners that
will remote manage projects.13
13
It was confirmed by one agency that in terms of good humanitarian practice, they are opposed to remote management. A strong
stance is taken within Afghanistan in opposition to remote management operational approaches and the donor is not currently willing to
support the funding of any projects that their own personnel are not able to visit (as part of agency monitoring visits). It was
acknowledged, however, that the agency does have to fund programmes within Somalia that are operated remotely. It was
acknowledged that the funding agency currently has no other choice than to do this.
7
Figure 12: Number of all organisational participants in favour of, or in opposition, to remote management
20
15
10
5
0
INGOs (20)
In favour
Good Practice /
Research Orgs (4)
Oppose
Institutional Donors
(4)
Undecided
8
Download