Type of Review: Annual Review Project Title: Foundation for Innovative Diagnostics (FIND) 2009-14 Date started: 11/2009 Date review undertaken: October 2012 Instructions to help complete this template: Before commencing the annual review you should have to hand: the Business Case or earlier project documentation. the Logframe the detailed guidance (How to Note)- Reviewing and Scoring Projects the most recent annual review (where appropriate) and other related monitoring reports key data from ARIES, including the risk rating the separate project scoring calculation sheet (pending access to ARIES) You should assess and rate the individual outputs using the following rating scale and description. ARIES and the separate project scoring calculation sheet will calculate the overall output score taking account of the weightings and individual outputs scores: Description Outputs substantially exceeded expectation Outputs moderately exceeded expectation Outputs met expectation Outputs moderately did not meet expectation Outputs substantially did not meet expectation Scale A++ A+ A B C Introduction and Context What support is the UK providing? DFID is providing the Foundation for Innovative Diagnostics (FIND) with £6.5 million from 2009-2014 to support the development of diagnostics for a number of neglected diseases of poverty. Providing funding through a Product Development Partnership engages privatesector collaborators to apply their development, manufacturing and distribution strengths and expertise to innovative technologies that would not be a private-sector priority, to achieve maximum sustainable benefit for public health in developing countries. The core diseases covered by FIND’s portfolio are malaria, tuberculosis (TB) and sleeping sickness (human African trypanosomiasis); but they also work on developing diagnostics for 1 non-malarial fevers, visceral leishmaniasis (which causes swelling of the liver and spleen, fever and painful skin lesions), trachoma (a leading cause of preventable blindness), Chagas disease and HIV. Alongside product development, FIND supports the development and strengthening of laboratory facilities in disease endemic countries, in order to facilitate the rapid uptake of new tools. What are the expected results? FIND’s goal is to contribute to a world where patients have equitable access to high quality diagnostics. Its purpose is to drive the development and implementation of accurate and affordable diagnostic tests that are appropriate to patient care in low-resource settings. Expected results include: 1. Development of new Point of Care (POC) diagnostics and improved quality of existing POC tests for use at community level; 2. Extension of existing technologies for use in the diagnosis of multiple rather than single diseases, i.e. as diagnostic platforms rather than disease-specific tests; 3. Expansion of activities so that the programme portfolios include new disease areas such as HIV and neglected diseases (where possible building upon the platforms approach); and 4. Increased use of FIND diagnostics for disease testing amongst poor people in endemic countries once the tests have received WHO endorsement. What is the context in which UK support is provided? There are few existing technologies such as diagnostics, drugs and vaccines to identify, treat or prevent neglected diseases that affect the world’s poorest populations. Where they exist the technologies are either too expensive, require high levels of infrastructure (e.g. constant electrical supply, sterile equipment etc.) and high levels of staff training which are not available in settings with weak health systems. For diagnostics there is a need for “point of care” tests that allow for immediate diagnosis, without the need for expensive laboratory infrastructure and skilled staff able to use and maintain the equipment. Support to develop new diagnostics fits within the DFID research strategy to address the need for new or improved products to combat diseases of the poor, for which prevention or treatment is lacking or inadequate. Development of new technologies will help to achieve the Millennium Development Goals, notably to reduce poverty and child mortality, improve maternal health and to combat malaria and other neglected diseases. Section A: Detailed Output Scoring Output 1: Development of new Point of Care (POC) diagnostics and improved quality of existing POC tests for use at community level Output 1 score and performance description: B – output moderately did not meet expectation Progress against expected results: 2 TB: 2011/12 has been a time for consolidating previous successes in molecular testing and advancing new diagnostics in to the portfolio. Key achievements include: A manual molecular diagnostic test for TB (TB LAMP) was registered in Japan and phase 1 evaluation and demonstration projects were conducted in developing countries; On-going work to improve the performance of drug (rifampin) resistance screening; Adoption of 2 new projects, including one which promises the ability to increase the sensitivity and ease of sputum (phlegm) testing for TB in microscopy-level laboratories; FIND and BD (Becton, Dickenson & Company) announced a new collaboration to promote early and accurate diagnosis of multidrug-resistant TB (MDR-TB) among HIVinfected patients and other vulnerable populations in India, a country that accounts for almost 25% of all TB cases globally. Malaria: Key achievements include: First country-level introductions of a new, safer blood transfer device for point-of-care malaria tests completed allowing for the simplification and improved safety of rapid diagnostic test preparation by health workers. Near completion of field studies of rapid diagnostic test (RDT) screening for malaria in pregnancy in Uganda and Burkina Faso Agreement of a new initiative between FIND and University College London (UCL) to assess the feasibility of new approaches to testing for non-tolerance of certain (nonartemisinal) anti-malarial drugs (G6PD testing) allowing for safe treatment of malaria Sleeping Sickness (human African trypanasomiasis): Key achievements include: Identification of biomarkers in the cerebrospinal fluid of sleeping sickness patients that will allow for the distinction between stage 1 and stage 2 disease with a high degree of accuracy – such distinction is critical given that patients with stage 2 disease can suffer severe adverse effects, potentially even death; Signing of an agreement with Standard Diagnostics to develop a rapid diagnostic test that tests for different stages of sleeping sickness and for cure. Recommendations: As the TB portfolio in particular starts to focus upon a range of higher risk projects care will need to be taken to ensure all efforts are made to consolidate work in the areas of greatest promise and halt work in failing projects at the earliest opportunity. Impact Weighting (%): 40% Revised since last Annual Review? Yes – to reflect balance of work in portfolio, following an assessment of risks Risk: Low/Medium/High Medium Revised since last Annual Review? No Output 2: Extension of existing technologies for use in the diagnosis of multiple rather than single diseases, i.e. as diagnostic platforms rather than disease-specific tests. Output 2 score and performance description: B – output moderately did not meet expectation Progress against expected results: Strong progress has been made although not all milestones for the period have been met. Key successes include: Entry of an assay (test) for measuring HIV viral load, and intended to help synergise TB and HIV care, into late stage feasibility testing; 3 Development of the first ever prototype rapid diagnostic test (RDT) for sleeping sickness by FIND and their business partner, Standard Diagnostics (SD), in Korea – early data from on-going trials in Angola and the Democratic Republic of Congo (DRC) suggest this new rapid test performs as well as pre-existing tests which produce results in slower time; Completion of the first field applicable molecular diagnostic test for use in communitybased settings (HAT LAMP) by FIND and their partner, the Eiken Chemical Company; Feasibility studies to develop manual (LAMP) diagnostic tests for both visceral leishmaniasis and Chagas disease initiated Manual malaria diagnostic test (malaria LAMP) completed field trials and is being prepared for market release. Recommendations: FIND set themselves 17 milestones linked to outputs 1, 2 and 4for 2011; of these 11 were for typical product development projects and 6 were for non-typical and implementation projects. Overall, ten milestones were met, 6 were revised and one cancelled (that for the roll-out of the Xpert MTB/RIF assay after it was decided that WHO would take the lead in guiding the implementation of this technology post endorsement). The four main reasons for milestone delays are: technical (difficulty in identifying thermostable targets in 1 project); clinical trial delays (in 3 projects, delays due to slow ethical approval, slow enrolment because of declining endemicity, and a change in principal investigator); and lastly, complications in partner negotiations (for 2 projects). Some further progress has been made in the first half of 2012 and FIND has revised its milestone-setting practices in recognition that some have to date, been over-ambitious, but further efforts are required to ensure these milestones are met in a timely manner. Given that parts of the portfolio associated with output 1 are likely to become higher risk in coming years, FIND’s primary strategic challenge in the coming years will be to continue to select areas of work where they can have the greatest impact and have lower levels of risk. This will also be true for activities relating to output 3. Impact Weighting (%): 15% Revised since last Annual Review? No Risk: Low/Medium/High High Revised since last Annual Review? No Output 3: Expansion of activities so that the programme portfolios include new disease areas such as HIV and neglected diseases (where possible building upon the platforms approach). Output 3 score and performance description: A – output met expectation Progress against expected results: Progress has been relatively strong in this part of FIND’s portfolio, with developments seen across HIV, visceral leishmaniasis and Chagas disease: The TB programme has been expanded to include other diseases where important synergies exist, particularly across HIV and sexually transmitted diseases (STDs) The sleeping sickness programme has been expanded to include leishmaniasis and congenital Chagas disease, with feasibility tests for point-of-care (LAMP) diagnostics for both diseases initiated; Plans to develop trachoma diagnostics are also under development 4 Recommendations: FIND need to be cautious about spreading resources too thinly across too large a range of diseases. Emphasis should remain on the extension of existing diagnostic platforms to new disease areas. Impact Weighting (%): 25% Revised since last Annual Review? Yes to reflect balance of work in the portfolio, following an analysis of risks Risk: Low/Medium/High Medium Revised since last Annual Review? No Output 4: Increased use of FIND diagnostics for disease testing amongst poor people in endemic countries post WHO endorsement and introduction Output 4 score and performance description: A+ – output moderately exceeded expectation Progress against expected results: As various technologies have advanced through the product development pipeline and been endorsed by the WHO, FIND has increased its efforts towards ensuring the availability and use of their diagnostics on the ground in at-risk communities. Activities have included efforts to promote new products, working with partners to reduce technology costs for low and middle income countries, and laboratory strengthening and scale-up projects. Key activities undertaken in the period 2011/12 include: By the end of 2011, liquid culture for TB and phenotypic drug susceptibility testing (DST), the line probe assay for genotypic DST, and a rapid TB speciation test had been introduced to 15 high-burden countries, and the Xpert MTB/RIF for case and multi-drug resistant TB detection to two. Publication of 23 peer-reviewed academic papers since November 2011, with over 90 citations in other articles; Provision of technical support to WHO in the development of policy guidance for the use of the rapid, automated TB test (Xpert MTB/RIF), previously developed by FIND and partners, and endorsed by the WHO in 2011; Deep engagement in early implementation efforts associated with the role out of the automated TB Xpert test, including laboratory capacity-strengthening activities, and Successfully advocating for lower pricing for low and middle income countries (as indicated by an August 2012 announcement that a number of donors are to subsidise the cost allowing for a price reduction from $16.86 per diagnostic cartridge to $9.98 in 145 high-burden countries); On-going quality control for rapid diagnostic tests in partnership with WHO and expansion to include other types of (recombinant antigen) tests; Conduct of a pilot test of the use of SMS (text message) reporting for malaria diagnosis which has led to the national scale up of the approach by the Ministry of Health in Uganda FIND worked with partners including the National Malaria Control Programmes in Senegal and Zambia to assess the impact of wide-scale rapid diagnostic tests (RDTs) on disease reporting and drug consumption with a view to build the evidence base to guide the expansion of RDT use; 5 On-going work towards enhancing the capacity for diagnostic testing for TB, malaria and HIV through laboratory strengthening in Vietnam, Botswana, Dominican Republic, South Africa, Tanzania and Lesotho Recommendations: FIND’s efforts in this area have been impressive during the year. However they may need to balance efforts in this area with the need to maintain an active and progressive diagnostics development pipeline for the future. At the end of 2011 the ‘downstream programme team’ responsible for the delivery of this output began a process of restructuring. FIND must manage this change carefully, to ensure success, to ensure such strong performance in this area is to be maintained. Impact Weighting (%): 20% Revised since last Annual Review? No Risk: Low/Medium/High Medium Revised since last Annual Review? No Section B: Results and Value for Money. 1. Progress and results 1.1 Has the logframe been updated since last review? No 1.2 Overall Output Score and Description: A – Output met expectation 1.3 Direct feedback from beneficiaries FIND has worked to ensure that the diagnostics it develops are appropriate for use in developing countries and can reach those most in need. FIND takes a people-centred approach with a focus on ‘introducing new and improved diagnostic tests to shorten the delay before treatment, to halt transmission, and to minimise the impact of disease on families and communities’ (p.3, The Diagnosis Path to a Better World – available on the FIND website: www.finddiagnostics.org). FIND works closely with governments, regional and district health authorities to facilitate the introduction of new tools into existing systems, supporting the upgrade of laboratories, strengthening technical capacity and ultimately roll-out of new diagnostic tools enabling poor people in communities to access the diagnostics and the right treatments required. 1.4 Summary of overall progress FIND has performed well in the period 2011-12, with slight under-achievements in some areas of their work being offset by over-achievement in others. In the past year while fewer new diagnostics have been endorsed by the WHO and entered the global market than previous years, FIND has continued to demonstrate the development of diagnostics across all stages of the product development pipeline and all three disease areas (TB, malaria, and sleeping sickness). However, they recognise they have not met all their point of care milestones for the year and need to focus upon taking forwards their antigen detection rapid diagnostic testing work particularly for TB. Their work on expanding the diseases covered and developing 6 diseases clusters and increasing use of diagnostics has been strong. 1.5 Key challenges Through the successful development and WHO prequalification of a number of new diagnostic tests FIND has significant challenges to ensure that the new diagnostics will have the desired impact in disease endemic countries. It is clear that FIND is reorganising to ensure sufficient capacity to introduce new diagnostics and associated appropriate uptake. Changes in the senior management and associated organisational restructuring that occurred in 2011-12 are likely to pose some challenges in the period 2012-13. However, FIND is working to ensure these changes are managed as smoothly as possible. FIND needs to ensure that it works with partners who are able to conduct ongoing surveillance of new products once they are being used in the field. Volatile exchange rates and the prolonged effects of the global economic downturn have had an impact on financial operations throughout the year. In common with other Swiss-based organisations the escalation in the value of the Swiss Franc against US $ has greatly increased the Geneva-based costs (e.g. WHO has reported increases of some 40% in operating costs). Many of FIND’s staff are based outside of Switzerland and rigorous financial management is mitigating some of the effect of the currency fluctuations. Finding, reaching and staffing appropriate trial sites in endemic areas, particularly for lower burden diseases such as sleeping sickness, continues to pose challenges. However, FIND’s continuing emphasis on laboratory-strengthening activities in-country helps to reduce these challenges over time. 1.6 Annual Outcome Assessment A – Outcome met expectation FIND has made good progress against its outcome i.e. to drive the development and implementation of accurate and affordable diagnostic tests that are appropriate to patient care in low-resource settings. We anticipate with the changes in management that FIND will continue to perform well during the remainder of the funding period. During the past year FIND has been successful, through a highly competitive process to attract significant funding from the German Government, in its first open competition for product development partnership funding. 2. Costs and timescale 2.1 Is the project on-track against financial forecasts: Yes 2.2 Key cost drivers Diagnostics development is a costly process, especially in the latter stages of development and/or when working on lower burden diseases (which may be targeted for elimination). As new products progress through the pipeline they enter into successively more costly phases of development. The programme is aware and actively trying to manage resources to ensure 7 that there are funds available to test the most promising products as they are developed. This includes widening partnership with the private sector in low, middle and high income countries and leveraging of resources, in-kind contributions and expertise; working with other not-forprofit organisations to share costs wherever possible. Further, diagnostics development remains cheaper than research and development activities in other areas such as vaccines and drug development. FIND’s emphasis on the use of transferable diagnostic platforms further lowers costs and risks. FIND has expanded its portfolio of diseases covered and increased its efforts to ensure diagnostics reach the people most in need. There is a need to ensure a balance across the whole programme of work, within financial constraints, to ensure an active and progressive diagnostics development pipeline for the future During 2012 obtained a significant new funding commitment (EUR7.5million) from the German Federal Ministry of Education and Research, which will run to November 2015, with preexisting donors continuing to support FIND. A two-year, US$11 million, TB grant from the Bill and Melinda Gates Foundation was also granted during 2012. 2.3 Is the project on-track against original timescale: Yes 3. Evidence and Evaluation 3.1 Assess any changes in evidence and implications for the project No significant changes to report. Diagnostics remain an underserved area and FIND continues to be one of the few groups working in the area, with a recognised track record focused solely on diagnostics. In spite of the global financial situation, FIND continues to successfully mobilise funds in an ever more competitive funding environment slight reductions in funding have occurred, but these have only acted to push them towards minimising their operating costs and maximising the efficiency of resource utilisation further. All diseases within their portfolio continue to represent key areas of diagnostic need. 3.2 Where an evaluation is planned what progress has been made? Not applicable 4. Risk 4.1 Output Risk Rating: Medium/High 4.2 Assessment of the risk level Following internal DFID discussions about the risk to the programme it moves from medium to medium/high risk. Product development is high risk and potential new diagnostics can fail at any stage in the development process. Risks are however lower than in other areas of innovation such as vaccine development. The product development partnership model represents a mechanism to mitigate the risks associated with the development of diagnostics (as well as vaccines and drugs) for diseases where there is little likelihood of private-sector diagnostic companies recovering the costs of development. FIND’s strategy to manage a portfolio of diagnostic platforms (rather than single candidates) that can be used across a range of diseases, 8 reduces the overall risk. FIND and their partners have robust mechanisms to manage their portfolios of potential diagnostic products , drawing on global experts to oversee the development process and help teams to identify milestones and stop/go decision points. . As the number of products reaching commercialisation in recent years increases, there is a concurrent portfolio shift towards a larger number of early stage projects which naturally represent higher risk. FIND has strong mechanisms in place to minimise these risks with strong go/no go decision points built in to the product development process. FIND experienced significant management and organisational changes in late 2011, with a new Chief Executive Officer being appointed in 2011 and a subsequent reduction in the number of staff employed by the programme; the long-time Chief Financial Officer (CFO) also retired at the end of the year and a new CFO has taken on the interim-role. FIND is in the process of developing a new 5-year strategy and revising its organisational structure and systems to improve efficiency and reduce operational costs. They have established a permanent Scientific Advisory Committee which will complement the ad-hoc committees to provide external scrutiny for managing individual projects within the portfolio and strengthen both other committees and the Board. While these changes appear to be being managed smoothly, such extensive organisational changes do not come without their risks. These points are reflected in the re-assignment of this programme from ‘medium’ to ‘medium/high’ risk. 4.3 Risk of funds not being used as intended This is low risk. An external independent Financial Audit is performed annually to certify the availability of funds and assess adequacy of funds. Copies of the unqualified Audited Financial Statements for 2011 have been examined by DFID. During the year FIND changed its revenue recognition policy to better reflect the funds available to the organisation at the end of each year. This change in accounting priority, first applied for the period 2011 with retroactive effect on prior years, revealed an accumulated deficit. However the auditors (Deloitte) highlighted that there was sufficient cash to cover FIND’s 2012 operations. FIND’s management and Board of Directors have since taken active measures to resolve the situation. As of August 2012, FIND has secured unrestricted funds from various donors to cover the accumulated deficit. The provision of core funds to manage its portfolio of potential diagnostics is a way to manage the risk that any one project is unsuccessful and that work will stop. The organisation is able to reassign funds to more promising projects and ensure that work continues. FIND has a strong a governance structure and robust practices. In response to previous external reviews, including a 2011 one co-funded by the Bill and Melinda Gates Foundation and the Dutch Government, these have been recently strengthened further (see FIND’s 2011 Annual Funders report for further detail). While this review document has not yet been made public, its conclusions and recommendations have been discussed at length during meetings of the PDP Funders Group and DFID have discussed them with FIND staff members. 4.4 Climate and Environment Risk There are no significant environmental impacts of FIND’s work programme at this time. FIND works with regulators to ensure that environmental issues (associated, for example, with used product and packaging disposal) are appropriately addressed and/or studied as part of the development process, prior to the adoption of tests. The WHO prequalification process for 9 any new diagnostic involves an assessment of potential climate and environment risks. In the longer terms the environmental impacts of FIND’s activities should be positive with reduced inappropriate treatments of disease in poor populations contributing to more effective and efficient utilisation of drugs and associated health services. 5. Value for Money 5.1 Performance on VfM measures Funding diagnostics development through a product development partnership (PDP) such as the Foundation for Innovative Diagnostics (FIND) provides value for money through: the use of a portfolio approach which allows funding to be redistributed if individual projects are stopped if they do not meet their milestones; the leveraging of contributions (resources, expertise, funding, access to drugs and other in-kind resources) from the private sector (in low, middle and high income countries); support for the continued development of the most promising candidates; facilitating opportunities to explore innovative partnerships with private and public sector organisations (in many different countries including low and middle income countries) to reduce costs. FIND further enhances its value for money through strong partnership working with other PDPs (e.g. the TB Alliance) as well as policy-makers, influencers, operational researchers and programme staff on the ground – such involvement significantly increases the likelihood and timeliness of diagnostic uptake in endemic countries. 5.2 Commercial Improvement and Value for Money Through its internal processes, with a focus on the development of new disease diagnostics from existing technology platforms, the programme is able to provide a competitive environment for innovation and improved value for money. In addition the organisation works with the diagnostics industry which improves value for money, by leveraging in resources, staff time and expertise from other organisations 5.3 Role of project partners DFID is one of a number of donors all of whom are involved through regular discussions with the programme directly and through various international and WHO based fora. All donors are aware of the financial constraints and the need to identify ways to increase value for money. Ensuring value for money in developing products for use in low income countries, where there is no viable commercial market, is central to the way PDPs work with their partners from a range of different backgrounds, including pharmaceutical companies, other private sector organisations, academic researchers, advocacy organisations and local community groups. 5.4 Does the project still represent Value for Money : Yes 5.5 If not, what action will you take? 6. Conditionality 10 6.1 Update on specific conditions Not applicable 7. Conclusions and actions Overall FIND has made good progress over the 2011/12 period with slight underachievements under outputs 1 and 2 being offset by strong performance under outputs 3 and 4, supporting the roll-out of diagnostic products among populations at need. There have been some changes in management structures over the cause of the year, the impacts of which appear to have been managed smoothly, and will be monitored closely during the coming year. 8. Review Process The review was carried out by members of the human development research team in DFID, following review meetings and discussions with the programme, independent scientific experts and other funders. A member of the Product Development Partnership Funders Group was an independent member of the review team. Further supporting materials included reports from the FIND website, annual reports and regular FIND email updates As the new Product Development Partnership Competition (for the period 2013-18) was launched in February 2012, there has been minimal contact with FIND to minimise the risk of conflict of interest. All discussions with the programme have been limited to reviewing progress against the existing performance framework, risk, financial and programme management. However, a copy of this annual review was shared with them before submission. When the competition is complete, by end of 2012, further discussions will take place. Given management and organisational changes in 2011-12 we will monitor progress closely over the coming year. 11