Type of Review: Annual Review Project Title: Sightsavers Programme Partnership Arrangement (PPA) Date started: 01 April 2013 Date review undertaken: 31 October 2014 Instructions to help complete this template: Before commencing the annual review you should have to hand: the Business Case or earlier project documentation. the Logframe the detailed guidance (How to Note)- Reviewing and Scoring Projects the most recent annual review (where appropriate) and other related monitoring reports key data from ARIES, including the risk rating the separate project scoring calculation sheet (pending access to ARIES) You should assess and rate the individual outputs using the following rating scale and description. ARIES and the separate project scoring calculation sheet will calculate the overall output score taking account of the weightings and individual outputs scores: Description Outputs substantially exceeded expectation Outputs moderately exceeded expectation Outputs met expectation Outputs moderately did not meet expectation Outputs substantially did not meet expectation Scale A++ A+ A B C Introduction and Context What support is the UK providing? The UK, through the Department for International Development (DFID), is investing in a 3 year Programme Partnership Arrangement (PPA) with Sightsavers between 2011 and 2014 and an extension has been agreed for 2014-2016. An investment of £3,738,678 for each year has been agreed. This type of strategic investment can leverage much greater impact than 1 traditional project funding by playing a key role in shaping how Sightsavers uses its non-DFID resources. What are the expected results? The results that this investment is expected to deliver are: • • • • • • • • • • • • • Provide 60,843,400 health treatments and surgeries; Train 149,330 health workers and eye specialists; £2,250,000 allocated to 21 innovative pilot projects to improve eye health and benefit visually impaired and disabled people, with lesson learning shared externally; Help strengthen health systems in 10 countries where Sightsavers works; 8 countries will increase public spending on eye health; 5,438,000 people screened for eye conditions; 1,335,013 surgeries and treatments provided; 1,147 teachers trained in special education needs; 2,690 disabled pupils enrolling in mainstream education systems; 5,212 rehabilitation workers trained; Advocacy for national policies in 17 countries; 150 initiatives to mainstream disability inclusion in NGOs and local government offices; Mainstreaming disability within, for example, local government and other CSOs; Increase of 1.45% of organisational income spent on organisational effectiveness evidence building, transparency, M&E, value for money initiatives. What is the context in which UK support is provided? Civil society plays a vital role in supporting citizens to improve their lives. Civil Society Organisations (CSOs) are central to delivering services, enabling citizens to be more active in their own development and ensuring that policies benefit ordinary people – especially the poorest. To achieve DFID’s priorities, as set out in its Business Plan (Structural Reform Plan), a multisectoral and multi-faceted approach to delivery is required, one in which CSOs, along with governments and the private sector, play a pivotal role in helping poor people to improve their lives. The PPA is one of DFID’s main support mechanisms to CSOs. In line with a commitment by the Secretary of State to support another round of PPAs over the 2011-14 period and following a robust selection process and implementation of a Resource Allocation Model, partners were identified for a 3 year PPA which began in April 2011. This is the last review for that reporting period. However, it should be noted that an additional two years extension has been agreed by the SoS for 2014-2016. Results from 2011-2014 will be progressed further under the extension period. 2 Section A: Detailed Output Scoring Output 1: Innovative large scale health initiatives implemented to provide at least 83 million treatments in target countries Output 1 score and performance description: A - Output met expectation Progress against expected results: Sightsavers have, in general, made good progress against this output. They have achieved or overachieved against three indicators, and underachieved against one. Sightsavers underachieved against indicator 1.1 due to the timing of negotiations surrounding one of their significant trachoma elimination grants, and some large scale projects not starting as expected. Sightsaver’s ability to increase the number of drugs administered for NTDs in indicator 1.2 reflects the success of their new fast track initiatives as well as increased organisational capacity for NTD control and elimination, as a result of strategic funding. They have exceeded both of their training indicators; due to the training of village volunteers which is key to Sightsavers approach to delivering elimination programmes for river blindness and trachoma, new initiatives in South Sudan and increased training in East Africa. PROGRESS AGAINST INDICATORS Indicator Statement Milestone/target for 2013/2014 1.1 Number of trachoma surgeries (cumulative) 98,300 1.2 Number of treatments provided under Mass 93,545,000 Drug Administration (MDA) for NTDs (cumulative) 1.3 Number of primary health care workers trained 202,500 in eye health and community NTD workers trained in NTD MDA distribution 1.4 Number of specialist eye health cadres trained 1,480 Actual Achievement 72,712 95,802,341 218,271 1,659 Recommendations: Where Sightsavers have underachieved against indicators they must give a better explanation of why, what they have learnt and what they will do to address it in the future. For example, in 1.1 why did the project not start on time, and what will they do to ensure that this does not happen in future? Impact Weighting (%): 30% Revised since last Annual Review? No Risk: Low Revised since last Annual Review? No 3 Output 2: Innovative approaches piloted to improve eye health and benefit visually impaired and disabled people in target countries Output 2 score and performance description: A - Output met expectation Progress against expected results: Sightsavers have met both target 2.1 and 2.2 and increased the number of innovative initiative that they support. Sightsavers have developed a number of partnerships, for example with Unilever, in order to increase the number of innovative approaches they can fund. They have shared learning from these projects within the organisation and conducted an evaluation of the projects which has found that the Innovation fund has the potential to deliver positive results for Sightsavers and its partners. PROGRESS AGAINST INDICATORS Milestone/target for 2013/2014 2.1 Value of funding allocated to innovative £2,250,000 approaches by mixed internal / external programme panel Indicator 2.2 Lesson learning shared innovation pilots externally from Actual Achievement £2,347,154 Learning from pilots shared externally 19 initiatives shared learning externally 21 Sightsavers and external innovation pilot projects being implemented 21 Sightsavers and external innovation projects being implemented Recommendations: As discussed with Sightsavers, they should reconsider what the value of indicator 2.1 is as it gives no information about the quality of funding allocated. Impact Weighting (%): 15% Revised since last Annual Review? No Risk: High Revised since last Annual Review? No 4 Output 3: Contribution to health systems strengthening in countries where Sightsavers works through delivery of eye health as an integral part of the national health strategy Output 3 score and performance description: A - Output met expectation Progress against expected results: Sightsavers have achieved or overachieved against four indicators and underachieved against one in output 3. They explain that their underachievement for indicator 3.1 is due to technical support for human resources for eye health being embedded within the International Agency for the Prevention of Blindness (IAPD). This has led to programmes focusing on a more holistic health-systems approach and has, in turn, led to a reduction in the number of specific activities on the human resources for eye health at a country level. Against their other indicators they have been successful, despite increasing some of them mid-year to ensure that they were sufficiently stretching. An increased number of people screened at Primary Healthcare level has led to increased awareness of eye health issues, and strengthening of a partnership in South Asia led to an increase in the number of cataract surgeries which explains their overachievement against indicator 3.4. Sightsavers have also made progress in data collection which is ensuring that they fully capture the progress made against this output. PROGRESS AGAINST INDICATORS Indicator Milestone/target for 2013/2014 3.1 No of Sightsavers country offices in sub- 10 Saharan African countries actively working to address the eye health workforce crisis. 3.2 No of Sightsavers countries showing increase 8 in public spend on eye health or availability of eye health services 3.3 No screened for eye conditions 8,000,000 3.4 No of surgeries conducted for non-NTD 225,878 conditions 3.5 No of other non-NTD treatments provided 1,481,013 Actual Achievement 4 8 10,177,862 242,168 1,950,083 Recommendations Sightsavers should consider the wording of indicator 3.1 as it is not clear what is meant by ‘actively working.’ Impact Weighting (%): 25% Revised since last Annual Review? No Risk: Medium Revised since last Annual Review? No 5 Output 4: Disabled and visually impaired girls and boys educated alongside their peers within wider government education systems in programmes supported by Sightsavers Output 4 score and performance description: A+ - Outputs moderately exceeded expectation Progress against expected results: Sightsavers have overachieved against both of their indicators for output 4. They have had particular success in Zambia, Mali, North India, Pakistan and Bangladesh, where programmes have included strategies such as developing the capacity of teacher training institutions to provide high quality training, which has pushed their overall achievement up. The overachievement against indicator 4.2 is largely due to the realignment of an initiative in Zambia and a new project in Mali. This indicator was achieved despite the fact that numbers in some countries have fallen due to the process of portfolio alignment. PROGRESS AGAINST INDICATORS Milestone/target for 2013/2014 4.1 No of teachers trained to provide education for 2,125 children with visual impairment 4,386 Indicator (Gender unknown 4.2 No of disabled pupils enrolled in the education 20 system in programmes Sightsavers supports Boys 4,743 Girls 3,614) Actual Achievement 3,124 4,827 (Gender unknown 595 Boys 4,369 Girls 4,098) Recommendations: Sightsavers should ensure that they fully explain why and how they overachieved their milestones. Impact Weighting (%): 10% Revised since last Annual Review? No Risk: Low Revised since last Annual Review? No Output 5: Strengthened, representative and effective Disabled People’s Organisations and Blind People’s Organisations supported by Sightsavers Output 5 score and performance description: 6 B - Outputs moderately did not meet expectation Progress against expected results: Sightsavers have made mixed progress against this output, achieving or overachieving two indicators and underachieving against one. They overachieved against indicator 5.1, largely due to increasing the number of volunteers supported in community-based rehabilitation short courses by over 400. Sightsavers achieved their target for indicator 5.2, progress against this indicator can be attributed to more effective advocacy as a result of improved global advocacy staff and the provision of more guidance on effective advocacy. They have underachieved against indicator 5.3 which they attribute to their Strategic Alignment Process which led to the closing of 14 projects. While we recognise that the Strategic Alignment process led to the closing of projects it is not clear from Sightsavers explanation how this led to them achieving 95 rather than their milestone of 150. Sightsavers are currently reviewing their logframe to ensure that indicators are appropriate given the Strategic Alignment Process. PROGRESS AGAINST INDICATORS Indicator Statement Milestone/target for 2013/2014 5.1 No of rehabilitation workers trained 5,592 5.2 No of Sightsavers countries where advocacy 17 by BPOs/DPOs and/or disability movement results in national government policies in line with the UNCRPD 5.3 No of initiatives supported through Sightsavers 150 which have resulted in mainstreaming disability within e.g. local government institutions, nondisability civil society organisations (CSOs), and not-for-profit and for-profit partner institutions Actual Achievement 6,131 17 95 Recommendations: Where Sightsavers have underachieved against their indicators they should ensure that they give full explanations of why, what they learnt and what they will do to ensure that it does not happen in the future. Impact Weighting (%): 15% Revised since last Annual Review? No Risk: Low Revised since last Annual Review? No Output 6: Enhanced organisational management and information systems within Sightsavers, to deliver cost effective, quality results and outcomes to beneficiaries. Output 6 score and performance description: 7 A - Output met expectation Progress against expected results: Sightsavers have achieved or overachieved against two indicators and slightly underachieved against one. They have successfully developed their transparency and accountability initiatives, improved their procurement procedures and it is positive to see that they have reached 100% of programmes being approved through the agreed process. Sightsavers completed a full year of IATI compliance and their level of disclosure compared well against their peers in the IATI Annual Report 2013. Sightsavers underachieved against indicator 6.4, however although they did not meet the milestone there was an increase in the number of country office staff working at the required level from 54% mid 2013 to 83% at the end of 2013. This is due to the introduction of a competency assessment framework which allows directors to focus improving specific competency gaps through e-learning, self-study, coaching and mentoring. This indicator was removed by Sightsavers in December 2013 as part of the PPA logframe review process for the extension period. PROGRESS AGAINST INDICATORS Indicator Statement Milestone/target for 2013/2014 6.1 % of organisational income spent on evidence 5.30% building 6.2 Transparency and accountability initiatives to Positive donors, public and beneficiaries assessment of Sightsavers by IATI using CSO assessment toolkit Actual Achievement 5.47% Full SIM Card Dashboard showing latest performance against indicator targets published every six months Second year INGO accountability report submitted to Secretariat for review and published on website with comments 6.3 Value for money initiatives 8 75% of procurement going through Proactis IATI Data published quarterly for the whole period and comparable to other peer agencies 72% of procurement going through Proactis 100% new and 100% of new renewed programmes approved through agreed process 6.4 % of in-country salary costs invested in training 13% country level teams programmes approved through agreed process 9.77% Recommendations: Sightsavers should ensure that, now they have reached 100% for one section of an indicator, they ensure that their indicator is sufficiently stretching in following years. Impact Weighting (%): 5% Revised since last Annual Review? No Risk: Medium Revised since last Annual Review? No Section B: Results and Value for Money. 1. Progress and results 1.1 Has the logframe been updated since last review? Yes 1.2 Overall Output Score and Description: A – Outputs met expectation 1.3 Direct feedback from beneficiaries Sightsavers gathers extensive feedback from beneficiaries, and uses findings to improve programmes as well as to improve sector learning. Sightsavers divides its beneficiary feedback work into feedback from proximate beneficiaries, immediate beneficiaries and ultimate beneficiaries. Proximate beneficiaries Sightsavers have incorporated beneficiary feedback into their Global Trachoma Mapping Project (GTMP). Sightsavers used the same web-based system that they had used to process budgets and claims to collect beneficiary feedback. They found that beneficiaries were pleased to receive eye examinations. Beneficiaries also used the system to advocate for better access to services and clean water. We are pleased that beneficiary feedback has provided a foundation for community advocacy, targeting of surgical support, mobilising additional funding for service provision and informed design of trachoma elimination programmes. Sightsavers also gathered feedback from training programmes; they found that primary health 9 care workers would have liked more opportunity to examine real patients during the training. Sightsavers plan on sharing these results with Tanzania’s National Eye Health Group and will work with the International Centre for Eye Health who is undertaking similar research. Sightsavers have developed a Quality Standards initiative which sets out and assesses minimum effective practice for Sightsavers supported programmes. The dashboard selfassessment approach with peer review from other country offices provides a useful aggregate rating of minimum effective practice to inform action planning. It would be useful to know whether service users also participate in aspects of these assessments, for example on patient safety. Intermediate beneficiaries One of Sightsavers key policy engagements for post-2015 is their Voices of the Marginalised project, a participatory research project which brings the voices of people with disabilities, people with mental health issues and older people into the post-2015 debate by training them to conduct research in their own communities. The results of this research were taken to the UN General Assembly in 2013 and Sightsavers are currently producing a full report. We look forwards to hearing how this work is used and extended. Ultimate beneficiaries Sightsavers have supported research to investigate treatment-seeking behaviour for ocular morbidity, including barriers and drivers to eye-care in Cameroon. We are pleased to see that that research will be published in a peer-review journals, and would be interested in hearing how the feedback collected for this research has led to improved programme design. 1.4 Summary of overall progress Sightsavers have made good progress this year against the majority of their outcomes and outputs, underachieving moderately against one of their outputs. They have demonstrated success in a broad range of areas. It was good to see a clear discussion about how Sightsavers have been successful at engaging with policy process at an international and national level, and that they have also reached large numbers of people with treatments. Sightsavers Strategic Portfolio Alignment has meant that they have underachieved some indicators, despite this we would welcome this approach and appreciate the careful reflection of the difficulties and benefits surrounding this process that Sightsavers have made in their report. However, where this Strategic Portfolio Alignment has caused Sightsavers to underachieve against indicators they needed to give a much clearer explanation of why, what they have learnt and what they will do to ensure it does not happen in the future. 1.5 Key challenges Sightsavers key challenges have been: 1. Strategic Portfolio Alignment – Sightsavers have undergone a process of Strategic Portfolio Alignment which has led to them exiting a number of projects. When exiting projects they have had to ensure that they minimise impact on partners and beneficiaries. In some cases this has caused them to underachieve against specific indicators. Sightsavers are revising their logframe to reflect the outcomes of the portfolio alignment. 2. Conflict situations – Sightsavers works in a number of conflict situations which presents 10 a number of challenges. For example, staff in South Sudan are working remotely from Uganda until they are able to return. Challenging conditions in Bangladesh reduced their ability to monitor and develop programmes. 3. Supply Chain – Drugs donated for trachoma control were found on sale in Nigeria – this led to shipments being put on hold. After a period of review plans to track drug movement were found to be sufficient and shipments could recommence. In future Sightsavers should give more explanation of how this affected their work and how they addressed it as it is not clear. 1.6 Annual Outcome Assessment Sightsavers have made good progress against all of their outcomes, achieving or overachieving against all of their outcome milestones. Their success against their outcomes demonstrates success in a wide range of areas, including providing treatments, supporting school inclusion and influencing policy at a national and international level. They have successfully reached over 91 million people through health interventions and it is positive to hear about Sightsavers influence over UNCRPD reporting. Sightsavers state that they are in the process of more effectively measuring their policy impact and we would be interested to see this in future. 2. Costs and timescale Is the project on-track against financial forecasts: Yes, annual funding through the PPA is disbursed in four equal amounts on a quarterly basis. The full annual allocation was disbursed as expected. Key cost drivers: Sightsavers identifies their key cost drivers as: • Expenditure on fundraising – In 2013 sightsavers conducted a review of cost and structure which concluded that it would be possible to generate the same income for less expenditure. They have subsequently merged two fundraising departments and refocused their activities of those delivering better returns. As a result in 2013 they were able to reach their fundraising target for 10% less than their aim, including restructuring costs. • Staff salaries – Sightsavers have made significant changes to staff structures in the past year which has had an impact on the amount of money spent on staff and enabled them to link programme and financial management more effectively. • Programme structure – In 2013 Sightsavers undertook a full strategic alignment review of their programmes to ensure that their programmes support their strategy and they also assessed their infrastructure to deliver. As a result they will exit a number of countries, including Sri Lanka and Gambia, reducing management costs. Larger and more focused programmes will reduce the administration cost to the organisation. In some cases Sightsavers strategic alignment will mean that they focus on where the need is great and work in higher cost environments, such as South Sudan, when outputs will be lower and 11 inputs more expensive. • Procurement costs – In 2013 Sightsavers purchased 73% of equipment and consumables for programmes through a centralised procurement system increasing savings by block buying where possible. • Exchange rate fluctuations - Sightsavers buy forward US Dollars contracts to protect themselves against movements of currencies against sterling. Since 2009 they have seen an overall gain of £577k. This also ensures stability for programmes and avoid funding disruptions that can undermine programme delivery. • Programme Unit Costs – Sightsavers have focused on budgeting on unit costs for these activities to ensure all partners are consistent with activity costs and to challenge outlying costs with countries or between partners as part of large NTD programmes which started in 2013. They have now started expanding this approach to the planning for some eye health work in Asia focussing on cataract surgery provision. Sightsavers have demonstrated a good understanding of costs and have some good examples of activities to reduce and mitigate these. In future Sightsavers should clearly distinguishing cost categories and what drives these costs, as well as highlighting the relevant importance of different costs. For example, salary savings are highlighted but the absolute or relative amount spent on pay is not. Is the project on-track against original timescale: The project is on track. 3. Evidence and Evaluation 3.1 Assess any changes in evidence and implications for the project Sightsavers identify that throughout the PPA period they have been able to develop an increasing body of evidence which is enabling them to make better use of data and evidence in their work. Sightsavers identify one of their key priorities as strengthening the links between research, programmes and advocacy. They have worked towards this by; using research findings as formative evidence to support design of our programmes, using research data for the purpose of baseline and post-intervention evaluations and using research evidence in the advocacy activities delivered directly by Sightsavers and through other organisations. For example, their study of health seeking behaviour in Cameroon highlighted challenges related to quality of care, which impact on low demand for eye care services in the study region. As a result they redesigned their eye health programme in South West Cameroon with a focus on quality assurance and systematic measurements of post-operative surgical outcomes. Sightsavers is applying learning from the GTMP into the design of trachoma elimination programmes. This will ensure that trachoma programmes will remain embedded within the health system even after the trachoma backlog is cleared. Sightsaver’s review of projects, which was started in 2013 and will continue in 2014, will ensure that projects are aligned with their strategy and are effective in delivering the change we want to deliver. Sightsavers identified 80 projects for exit by the end of March 2014 with exit plans. They are now creating plans for projects which are continuing or being scaled up to 12 their alignment with the organisation’s strategic priorities. By focussing and streamlining their portfolio, Sightsavers expect to secure value for money through a better focus on results with a greater alignment between priorities and our resources. Changes in the Sightsavers structure brought together research, evaluation and programme development functions which has strengthened links between generating new evidence and programmatic learning. However, there are gaps between new evidence and dissemination, country-level learning and advocacy which Sightsavers will aim to address by reviewing the role descriptions of key programme and technical staff, and assessing the need for staff with specialist skills in 2014. This new structure presents an opportunity for Sightsavers to focus on mainstreaming and prioritising evaluation more across the whole organisation. While much of their research is available, not all of Sightsavers evaluation studies are available online, Sightsavers should ensure that these are made publically available in order to facilitate learning and for the purposes of transparency. 3.2 Where an evaluation is planned what progress has been made? The PPAs as a whole are served by an umbrella evaluation strategy, the first of its kind for DFID, which also encompasses the Global Poverty Action Fund. This strategy examines progress at fund and at individual, organisational level. Following the announcement of the extension to the PPA fund in 2013, the evaluation strategy was reviewed and, in addition to the individual progress reviews (IPRs) and meta evaluation that took place in 2012, a further two evaluations are planned for 2014/2015 and 2016/17. The evaluation is managed by an externally contracted evaluation manager. The 2014/15 evaluation has started and focuses on the assessment of the fund-level effects of PPA grants. This fund-level evaluation will use 12 organisations, including Sightsavers, to illustrate the effects of the PPA fund and evidence from all 41 organisations to evaluate progress and outcomes. The aim is to provide timely, fund level evaluation information for the design of any future strategic funding modalities in 2014/15 ahead of fund completion in 2016. The evaluation in 2016/17 will focus on the impact of PPA funding for organisations. 4. Risk 4.1 Output Risk Rating: Low 4.2 Assessment of the risk level Overall Sightsaver’s output risk rating is low. A number of outputs represent a low level of risk, either because the external context is favourable to Sightsavers work or because Sightsavers is clear about the direction they are taking and the work that needs to be done. The output with the highest level of risk relates to innovation, and the inherent risks that are present when piloting new and untested ideas. Some outputs have a medium level of risk associated with them due to the rebalancing of the portfolio. 4.3 Risk of funds not being used as intended Sightsavers underwent pre-grant due diligence checks carried out by KPMG. The pre-grant due diligence assessed capacity to manage the proposed level of DFID support in the 13 following areas: Governance Financial Capacity Operational Capacity Value for Money Results Satisfactory completion of the due diligence process was required before any money was disbursed. This helps to reduce the risk of diverted funding while establishing an environment of accountability and transparency. Organisations also had baseline up-dated due diligence assessments carried out in March 2014 to ensure that processes and strategies were current and complementary to DFIDs due diligence framework and modules. Sightsavers is adhering to the outcome of the March 2014 due diligence assessment as part of their PPA extension MOU. 4.4 Climate and Environment Risk No issues were raised for the attention and action of Sightsavers as a result of the 2011 Environmental Screening process. Sightsaver’s Climate and Environment Strategy is due to be reviewed in 2014. DFID would like to know how Sightsavers are monitoring their strategy, and what their thoughts are on any limitations they face and how they can do more in this area. 5. Value for Money 5.1 Performance on VfM measures Sightsavers do not list VfM measures, which is a limitation of their value for money section in their report. They state that this is because they see programmatic VfM as being synonymous with excellent organisational and programme management and delivery. They use the Bond/Nef VfM-PCM framework to drive VfM measures across organisational processes and the programme cycle management process. 5.2 Commercial Improvement and Value for Money Sightsavers considers economy, efficiency, effectiveness and equity in VfM. This year Sightsavers have developed a better programmatic Management Information System (MIS). They also conducted a fundamental review of their structure and operating model, after significant organisational changes which reduced the number of departments by one. These changes were made to improve their ability to deliver better quality programmes at lower cost. In terms of commercial improvement, in the UK Sightsavers ensure that service contracts are put in place using mechanisms such as competitive tendering, minimum standards of service and staggered payments tied to deliverables whenever appropriate. Within their overseas programme they ensure that procurement activity is carried out in line with their financial framework, and procurement policy and guidelines that ensure appropriate tenders and cost comparison. Sightsavers have a global standard list and centralised procurement system which enables partners to access their global procurement network. Their assessment of partners includes the use of a Financial Assessment Tool to identify weaknesses in cost management and structure support to help them strengthen these capacities. 14 While these changes are all positive, Sightsaver’s reflection on value for money shows limited strategic thinking beyond programme management systems. Sightsaver’s have submitted a VfM offer for the extension period which contains some very welcome activities which we look forward to seeing in future reports. 5.3 Role of project partners Sightsavers works extensively with a wide range of partner, including governments, civil society and the private sector, to achieve a wide range of objectives. Civil society: Sightsavers partnership work with Disabled People’s Organisations (DPOs) and Blind People’s Organisations (BPOs) had led to their increased ability to hold their governments to account. For example, Sightsaver’s partnership with the Caribbean Council for the Blind (CCB) enabled them to raise their profile as a credible partner in eye health and therefore influence the government to commit to the long term provision of eye care services. Government: Sightsavers works with governments to support service delivery and human resource development that demonstrate the eye health interventions can be delivered within existing structures. In Zambia Sightsavers works in partnership with the Ministry of Health, regional and district hospitals to ensure good take up of services by the community. Private sector: Sightsavers also works in partnership with the private sector; for example, they have worked with Unilever to revise their global handwashing programme to include facial hygiene. They have also partnered with Luxottica and their corporate foundation OneSight to pilot an approach to refractive error service delivery through Vision Centres which Luxottica is now scaling up independently. 5.4 Does the project still represent Value for Money: Yes 5.5 If not, what action will you take? n/a 6. Conditionality 6.1 Update on specific conditions n/a 15 7. Conclusions and actions Sightsavers have made good progress this year against both their outcomes and their outputs. They have effectively led coalitions towards the elimination of NTDs. The GTMP has delivered over half of the mapping ever conducted, and Sightsavers have supported their highest ever level of treatments. Sightsavers have also been active in the post 2015 debate, they have supported a number of disabled people’s organisations to engage with the high-level panel process and played a leading role in the Beyond 2015 campaign. It is clear in their report that they have developed effective partnerships and are conducting research projects which are leading to learning in their own programs and in the wider sector. One of Sightsavers key challenges this year, their Strategic Portfolio alignment, is also one of their own successes as they have been able to ensure that all of their programmes are aligned with their overall thematic strategies and their theory of change. It will be interesting to see how the process affects their work in the next year. In future reports Sightsavers need to explain more clearly how they have achieved their milestones as verifying their progress and scoring outputs has been difficult this year, due to the lack of information provided. They also need to more clearly explain why, what they have learnt and how they will address it when they haven’t met milestones. More information is also required in other areas; for example the section on challenges, VfM and risk ratings. Sightsavers is required to submit a final extension logframe by 31 October 2014 incorporating any feedback given on it in the annual report feedback letter and subsequent discussions. They must ensure that learning and results from this PPA period are reflected in their milestones and targets for 2014/2016. Organisations have also been asked to set out the substantive and measureable steps they will be taking to enhance work on transparency and value for money. 8. Review Process Sightsavers submitted a self-assessment annual report of their progress and performance against the PPA log frame during this third year of PPA funding. DFID reviewed this annual report and provided feedback to Sightsavers on both strengths and weaknesses reminding organisations of the need to improve year-on-year on VfM, results and transparency. The feedback incorporated comments from a range of officials in relevant country and policy teams. 16