Evaluating the Implementation of the Effective Behavioral Intervention for People who Inject Drugs-“Psycho-medical Intervention Model” Request for Applications Solicitation #4044-6 Date of Issue: March 4, 2014 Deadline for Submissions: April 4, 2014 Submit Proposal to: Electronic submissions: grants@respond.org.ua Questions? Please submit questions via email only by 6 p.m. March 14, 2014 to grants@respond.org.ua Purpose In the framework of the USAID RESPOND Project, Pact is announcing this Request for Applications (RFA) to solicit project proposals for funding initiatives aimed at Implementation Science: Studying the adoption and implementation of effective behavioral interventions for key populations in Ukraine. Implementation Science (IS) can be defined as the study of methods to improve the uptake, implementation, and translation of research findings into routine and common practices. It examines methods of systematic application of research to practice and helps identify processes and strategies for increasing adoption of innovative and effective practices, such as effective behavioral interventions (EBIs) for HIV prevention, care and treatment for key populations. The purpose of this RFA is to solicit proposals for research that will examine the process and immediate outcomes of the adoption and implementation of a selected international EBI in the Ukrainian context. In a separate RFA, the RESPOND Project will be awarding community based organizations (CSOs) working with people who inject drugs (PWID) to implement the EBI known as the Psycho-medical Intervention Model (PIM). RESPOND expects to award up to six EBI grants to CSOs working in regional centers and smaller towns of Cherkasy, Poltava and Zaporizhzhya Regions. This IS RFA seeks to fund a research organization (IS grantee) who will be joined with EBI grantees to study their adoption and implementation process and outcomes. The IS research findings will be used to guide scale-up of the EBI in Ukraine and strengthen evidence-based HIV/AIDS programs. The RESPOND Project anticipates awarding one IS research grant to fund study applications submitted in response to this solicitation. Applications must be submitted by 12 pm, April 4, 2014. The chosen project will be awarded up to $150,000.00. The proposed project term (period of performance) should be June 1, 2014 – January 31, 2016 (20 months). Awards under this solicitation are anticipated to be issued by June 1, 2014. This RFA is issued as a public notice to ensure that all interested parties have a fair opportunity to submit applications for funding. This RFA does not constitute an award commitment on the part of the RESPOND Project, nor does it commit to pay for costs incurred in the preparation and/or submission of applications, or to procure or contract for services or supplies. Furthermore, the RESPOND Project reserves the right to reject any or all proposals submitted, to negotiate with any applicants considered qualified, or to make awards without further applicant negotiations. I. Program Overview The goal of the USAID RESPOND Project is to assist the Government of Ukraine and civil society to reduce levels of HIV transmission among key populations and their sexual partners through sustainable country-led initiatives. In order to reach this goal, the USAID RESPOND Project has established the following objectives: 1. Increase the quality of HIV/AIDS services targeted at key populations and their sexual partners; 2. Strengthen the capacity of Ukrainian institutions and organizations to deliver quality HIV/AIDS programs. II. Technical Areas for Intervention A. Background Ukraine’s HIV response has demonstrated progress in recent years. Particular areas of strength include policies that guide a national response, mobilization of resources from the Government, civil society and 2 donor organizations leading to greater access to HIV services, and strengthened partnerships and platforms for collaboration between Government and civil society to decentralize and deliver services in the community. Civil Society Organizations (CSOs) have created a strong system for delivery of preventive services to key populations that supplements the public health care system. Nevertheless, the HIV epidemic continues in Ukraine. At the beginning of 2012, 230,000 people aged 15 and over were living with HIV. The HIV prevalence in adults aged 15-49 was estimated at 0.76% percent in 2011. The epidemic is concentrated among key populations: people who inject drugs (PWID), female sex workers (FSW), men who have sex with men (MSM), prisoners and most-at-risk adolescents (MARA). HIV prevalence consistently exceeds 5% in key populations. In 2011, HIV prevalence among key populations detected through bio-behavioral surveillance ranged from 6.4% in MSM to 21.5% in PWID. There was uneven geographic distribution with 77.1% of HIV cases in urban areas.1 About half of people living with HIV (PLHIV) are not aware of their status. In 2011, a record high of 21,177 new HIV cases were registered, along with 9,189 AIDS cases and 3,736 AIDS related deaths. In 2012, there were 20,743 newly registered HIV cases. This marks the first time since 2002 that the number of newly registered cases of HIV has not risen from the previous year. Increases in HIVrelated mortality and morbidity has Figure 1. HIV/AIDS morbidity and mortality 2000-2012 become a serious problem in the health sector, aggravated by losses in the continuum of care and late detection of HIV cases. There is an urgent need to further expand access to effective HIV prevention services for key populations. Program monitoring data reveals that the coverage of prevention services based on the estimated number of PWID, FSW, MSM and prisoners remains low. Similarly, the most recent biobehavioral surveillance data for each key population shows that coverage with the most basic prevention services (received condoms in the last 12 months and know where to get an HIV test) is low for PWID, FSW, and MSM, and well below the level needed to achieve impact. There are no equivalent data for MARA or PLHIV.2 A standardized package of prevention services based on evidence of effectiveness is needed for each key population. While most core components of HIV prevention and treatment services are accessible to some people in some areas, there is a considerable variation on coverage across regions of the country, and complete service packages are not widely available. Complex legal, regulatory and political constraints also make the provision and expansion of HIV prevention to key populations difficult. In addition, there is a lack of evidence about what interventions contribute to risk reduction and how to effectively implement key interventions. 1 Ministry of Health of Ukraine. Ukraine Harmonized AIDS Response Progress Report. Reporting period: January 2010- December 2011”, Kyiv. 2012 2 The Ukraine Harmonized AIDS Response Progress Report shows the coverage of prevention services based on the Alliance’s program monitoring data and estimated number of each key population. Bio-behavioral surveillance counts the number of covered individuals as part of those who responded positively to two questions (Have you received in the last 12 months condoms? and Do you know where to address when you need to test for HIV?). 3 PWID Since 2010, the level of HIV infection among PWID has dropped. However, injecting drug use remains a driving force of the HIV epidemic in Ukraine, and PWID continue to be a great risk for HIV. According to the official statistics, in the second half of 2013, the percentage of persons infected with HIV as result of drug injection was nearly 30%.3 Bio-behavioral research by the International HIV/AIDS Alliance in Ukraine documents 82% of PWID in 2009 and 80% of PWID in 2011 using opioid extracts or heroin, and 40% and 35% of PWID using stimulator drugs respectively. In 2011, 21% of PWID used both types of drugs.4 The frequency of condom use among PWID is low and inconsistent. Bio-behavioral research shows that only half of PWID who had sexual contacts within the last 30 days used condoms during their last intercourse with any partner (54.5% – in 2009 and 47.8% – in 2011).5 PWID are a priority population for Ukraine’s national response to the epidemic. The draft National Target Social Program in Response to HIV/AIDS for 2014-20186 requires provision of the WHO and UNAIDS recommended comprehensive preventive service package to PWID. Accessibility of MAT has greatly improved. As of January 2014, MAT is provided in all 27 regions of Ukraine – at 163 MAT sites for the total of 8,525 clients, of whom 3,591 are living with HIV.7 Unfortunately, the level of enrollment is still low compared to the existing need. The draft National Target Social Program in Response to HIV/AIDS for 2014-2018 aims to improve enrollment of PWID into the existing MAT programs, as well as to design and introduce MAT programs at the local level as part of primary care and family practice. Access to antiretroviral therapy (ART) in Ukraine in the last years has improved. However, PWID comprise 19,4 % of persons on ART. As of January 1, 2014,8 the number of officially registered PWID who live with HIV and are eligible for treatment is 15,287 persons. Of them, only 10,834 receive ART, which demonstrates that PWID in general have limited access to treatment and medical services. The levels of incidence and morbidity caused by AIDS are highest among PWID, which is explained by their late enrollment into medical care, co-infections, depression, negative life events, late enrollment into ART, and low adherence to treatment.9 The main reasons for the limited impact of the national HIV response on PWID are low coverage, inadequate scope and quality (including the inadequate evidence 3 HIV Infection in Ukraine. Information Bulletin No.40. Kyiv, 2013. O.M.Balakiryeva, T.V. Bondar, Y.V. Serda, Y.O. Sazonova. Monitoring of the Spread of HIV among People Who Inject Drugs as a Component of Second Generation Epidemiological Surveillance (on the Basis of the 2011 BioBehavioral Research): Analytical Report. International HIV/AIDS Alliance in Ukraine, Kyiv, 2012. 5 National Report on Monitoring Progress Towards the Ungass Declaration of Commitment on HIV/AIDS: Ukraine. Reporting Period: January 2008–December 2009, Kyiv, 2010. 6 draft National Target Social Program in Response to HIV/AIDS for 2014-2018: 4 http://dssz.gov.ua/index.php/gromadske-obgovorennya/1897-proekt-zakonu-ukrajini-prozatverdzhennya-zagalnoderzhavnoji-tsilovoji-sotsialnoji-programi-protidiji-vil-infektsiji-snidu-na-20142018-roki 7 http://ucdc.gov.ua/uk/statystyka/profilaktyka/zamisna-pidtrimuvalna-terapiya 8 http://ucdc.gov.ua/uk/statystyka/likuvannya/art 9 Mimiaga, M.J. et al., “We fear the police, and the police fear us”: Structural and individual barriers and facilitators to HIV medication adherence among injection drug users in Kiev, Ukraine AIDS Care, November 2010. 22(11): 1305–1313. 4 base), and high costs of programs. Progress is impeded by lack of policy support, health systems deficiencies, lack of data demand and use for decision making (including inefficient resource allocation and use), high levels of stigma and discrimination, and financing and human resource constraints. B. Effective Behavioral Interventions An Effective Behavioral Intervention or EBI is an evidence- and theory-based method or procedure for delivering an HIV service. It is not as broad as an HIV service (such as counseling and testing), but rather a specific program and set of tools for delivering that service (such as a clinic-based couples HIV counseling and testing session using explicit materials and protocols for skills building in safer sex). An EBI, for the purpose of this RFA, is comprised of the following characteristics: Has been proven effective at contributing to measurable change in a specific target population, based on research studies using rigorous protocol and scientific methods; Is based on behavioral theory; Is designed for specific target populations and behaviors related to HIV/AIDS; Strategically combines effective educational and skills building approaches; Includes planning, implementation and monitoring materials; Includes predefined core elements of an intervention that are obligatory for implementation to expect the intended outcomes. The US Center for Disease Control and Prevention supported the testing, packaging and dissemination of over 75 EBIs in the United States. Many interventions have been successfully adapted and implemented worldwide. In 2013, the RESPOND Project, in consultation with key stakeholders and in partnership with community based organizations, adapted and piloted 3 EBIs in Ukraine: Street Smart for MARA, Project Start for prisoners and Mpowerment for MSM. The Project is continuing this adaptation with an intervention for PWID: Psycho-medical Intervention Model (PIM). This intervention was identified as appropriate for the Ukraine context and complimentary to the strong PWID work implemented by the HIV community. PIM is a comprehensive, individual level (one-on-one) risk reduction and behavior change intervention aimed at reducing high risk behaviors for infection and transmission of HIV and viral hepatitis among PWID. It is also focused on linking PWID to appropriate drug treatment, testing and disease treatment (HIV, STI, Hepatitis, TB, etc.) and other health services. PIM was developed and evaluated in Puerto Rico and the United States and has since been adapted and successfully implemented globally. This intensive intervention is delivered through 7 structured sessions during a 3 to 6 month period. All sessions combine individualized counseling with comprehensive case management intended to support positive behavior change. For the purposes of this pilot, PIM will be implemented with two populations: 1) PWID who are not currently enrolled in MAT, focusing on risk reduction 2) PWID who are receiving MAT services, focusing on case management and psychosocial support PIM will be implemented by SCOs in three regions of Ukraine (Cherkasy, Poltava and Zaporizhzhya) in two distinct location types: in regional capitals, and in smaller towns/districts of those regions. RESPOND project expects to fund up to six CSOs, each working in one or both types of locations. EBI grantees will be expected to serve up to 100 PWIDs at each location over the grant period, of whom 75% will be those who are not enrolled in MAT, and 25% already receiving MAT. The former will be recruited among clients of needle and syringe projects run by CSOs under the HIV/AIDS Alliance programs; the latter will be recruited among clients of MAT programs at narcological dispensaries or AIDS centers. 5 A detailed description of PIM is provided in Attachment A and a behavior change logic model is included in Attachment B. Selection of this EBI was based upon a detailed review of the latest epidemiological, behavioral, contextual and program data in Ukraine and an in depth analysis of the corresponding gaps in services provided to particular key populations. The intervention has been modified by technical experts for the Ukraine context. The Implementation Science (IS) grantee (research institution) will be tasked with monitoring the implementation process and immediate outcomes of the implementation of the EBI in the Ukraine context. The IS grantee will be joined with EBI grantees who will adopt the EBI and implement it during the grant period. The RESPOND Project will train EBI grantees in the PIM intervention and provide ongoing technical assistance for implementation. The IS grantee will also require extensive orientation to the PIM intervention and will be supported by the RESPOND Project during the IS period. C. Implementation Science Extensive research has been conducted internationally to determine the most effective methods for delivering HIV prevention, treatment and care. However, challenges remain with the translation of research into practice and the implementation of proven effective interventions in diverse contexts. Internationally, there is growing recognition of the need to conduct implementation science research to strengthen and expand evidence-based programming. Implementation Science (IS) can be defined as the study of methods to improve the uptake, implementation, and translation of research findings into routine and common practices. It examines methods of systematic application of research to practice and helps identify processes and strategies for increasing adoption of innovative and effective practices, such as effective behavioral interventions for HIV prevention, care and treatment for key populations. IS study results are used to guide the delivery of evidence-based practices at scale under routine service delivery conditions. The RESPOND Project sees IS as a key tool for strengthening the evidence base of HIV programming in Ukraine. For this RFA, IS will be used to examine how CSOs (EBI grantees) adopt and implement an internationally developed EBI in the Ukraine context. The IS grantee will be joined with up to six EBI grantees in three regions (Cherkasy, Poltava and Zaporizhzhya) to follow the process of implementing the intervention (fidelity to intervention, challenges to implementation, modifications or adaptations) and determine the immediate outcomes. The IS grantee will be expected to design the IS research protocol and tools in consultation with research specialists from the RESPOND Project. The protocol will have to be approved by the IRB or relevant national agency authorized to provide ethical clearance. The agency should be approved by the RESPOND project. Documentation provided by RESPOND to assist IS grantees in the development of an application, and later research protocol includes (in the order of importance): The EBI intervention materials including implementation manual A copy of process tools utilized by the PIM implementing agency (titled Workbook) Original research findings Research questions to be answered by the IS grantees include: Is the PIM intervention implemented with fidelity? o Do the program components comply with the guidelines and protocol for implementation? o Are those components implemented correctly and consistently? 6 o Did the EBI grantee alter core elements/key characteristics of the PIM intervention to adapt to the local context? What were the outputs of alterations? IS grantee will be expected to develop tools for EBI grantees to use in documenting the process of implementing the PIM intervention; IS grantee should consider using the generic intervention tracking tool (Attachment C) and develop relevant intervention fidelity tools using PIM monitoring and evaluation field guide (Attachment E) and Attachments (A, B, D). The original description of PIM intervention can be found at: https://www.dropbox.com/sh/6934ouuzv05ke7z/sWB7k8L-mc ; IS grantee will offer support to ensure EBI grantees in documenting intervention implementation to ensure this is done accurately. What is the quality of PIM implementation? Proposals should describe the following: o The approach to be used in evaluating service providers’ performance. This includes criteria for assessing performance and the desired performance standards. o Examples of tools to be used in assessing program quality, including staff capacity, skills, and performance. What is the reach of intervention implementation? Proposals should describe the approach to be used for assessing the following: o the extent to which the program served the targeted number of beneficiaries and the correct target population, as defined by the eligibility criteria; o the percentage of intervention participants who complete the expected number of sessions. What was the effectiveness of PIM implementation? The IS grantee will be expected to conduct research to answer the question: Did the intervention produce significant positive changes in selected outcomes? Proposals should describe the approach for meeting this objective. When selecting the outcome measures, IS grantee should be guided by the original studies that produced the evidence supporting PIM. (Although the original research tools are not available, the research papers provide information on the list of assessed characteristics.) IS grantee should aim to follow study participants during the maximum possible period of time, balancing between the feasibility considerations and the task of assessing the longer-term outcomes. Again, the original research papers provide guidance on the appropriate follow-up period. Outcome measures may be expanded to include different levels of outcomes tailored to the behavior change logic models (provided in Annex B). Standard indicators for monitoring the HIV epidemic in Ukraine should be utilized to the maximum extent; Differences in outcomes between different organizations/locations should be explained (correlations should be explored with process monitoring indicators/barriers/exposure to other services); Outcome measurements should evaluate individual changes (with or without control group depending on feasibility considerations). How does the context in which the PIM intervention is implemented influence the success of the EBI? What factors explain the consistency, completeness, and correctness of service delivery? What are the local barriers to intervention implementation? 7 How can they be overcome? Are there additional external factors that might lead to expected outcomes aside from the EBIs? The factors may include geographic location in or outside the regional capital, exposure of EBI clients to other services or interventions that are implemented by the same or different service provider in parallel with the EBI implementation. In their technical proposals applicants may propose revised list of research questions as deemed feasible to better meet the goals and objectives of the studies. The rationale for revisions (either additions or removals) of research questions should be explained in the proposal. III. Monitoring and Reporting The IS grantee will be expected to provide regular reports and updates to RESPOND project on the process of research implementation. The IS grantee is encouraged to use mobile data collection mechanisms. Within the first month of the study, the IS grantee will submit to RESPOND project: - Finalized research protocol with all research tools; - Ethical clearance of the research protocol. Throughout the study, the IS grantee will submit to RESPOND project regular reports on the study progress and intermediate results according to the milestones agreed upon in the grant agreement. At the end of the project implementation period the IS grantee will submit the following deliverables to RESPOND Project: Final research protocol should it be revised; Quantitative data-set (in SPSS format, including the data protocol); Summary information from qualitative tools; Final research report. IV. Application Information A. Administration of the Sub-Grants The sub-grants will be awarded as part of the RESPOND Project’s activities under the cooperative agreement AID-121-A-12-00001 with the US Agency for International Development (USAID). Awards will be administered in accordance with the USAID policies and procedures. B. Eligibility Prime applicants may include research organizations, universities, or other entities with extensive experience in research, monitoring and evaluation, primarily in the field of HIV/AIDS and other health and social issues. All applications should: • • Be submitted before the specified deadline; Be accompanied with a complete application documentation package (see “An acceptable application package” below). 8 The sub-grants will have to comply with USAID regulations and relevant U.S. assistance legislation and policies regarding excluded parties and anti-terrorism regulations. The following organizations/programs are NOT eligible to apply for grants under this RFA: Political parties, and individuals; For-profit firms/companies; International non-governmental organizations; Organizations whose names appear on the Lists of Parties Excluded from Federal Procurement and Non-procurement Programs found at ; Organizations whose names appear on the Office of Foreign Assets Control (OFAC) Specially Designated Nationals List found at http://www.ustreas.gov/offices/enforcement/ofac/sdn/index.shtml; and Organizations whose names appear on the UN Security Council’s Terrorist List at http://www.un.org/sc/committees/1267/consolist.shtml The RESPOND Project will not provide funding for: Repaying of existing financial and other debts of the organization Activities that are not related to the application goal and objectives Participation in academic programs and trainings abroad Activities of political and religious nature Construction activities The following restricted goods and services shall not be procured with grant funds without USAID approval: (i) Agricultural commodities, (ii) Motor vehicles, (iii) Pharmaceuticals, (iv) Pesticides, (v) Used equipment (vi) U.S. Government-owned excess property, or (vii) Fertilizer. The grantee must not, under any circumstances, procure any of the following ineligible commodities and services: (i) (ii) (iii) (iv) (v) (vi) Military equipment, Surveillance equipment, Commodities and services for support of police or other law enforcement activities, Abortion equipment and services, Luxury goods and gambling equipment, or Weather modification equipment. C. Application Format All proposals received by the deadline will be reviewed for responsiveness to the program requirements and compliance with preparation guidelines provided below. Proposals and budgets that are nonresponsive to any of the below criteria will not be considered for further review. Applications should be submitted by 12 pm on April 4, 2014 via e-mail to grants@respond.org.ua with “На конкурс дослідницьких грантів 4044-6” in the Subject line. 9 Applications can be submitted in hard copy, only if e-mail submission is impossible (please do NOT use both options) to: вул. Малопідвальна, 15-Б, м. Київ, 01001. Hard copy applications should be received by the RESPOND Project personnel by the specified deadline. If you are submitting your application in hard copy, please include only photocopies of any official documents (such as your NGO’s certificate of registration); do NOT submit any originals, as the RESPOND Project will not return the submitted documents. An acceptable application package should include: Completely filled-in Application Form in English (preferred) or Ukrainian/Russian10 (template is attached); Indicative budget and budget narrative (template is attached). Please note that indicative budget should be based on the anticipated number of research sites and sample size. The final budget will be adjusted based on the number and geographical location of the selected EBI grantees, final sample sizes and finalized research protocols; Résumés of the key project staff; Scanned copies of the certificate of state registration, charter, and any other documents proving the applicant’s legal status. Please note that successful applicants must commit to initiate project implementation no later than June 1, 2014, and send the project manager (researcher) to the training on PIMs that will be conducted by RESPOND project in June, 2014. D. Question and Answer Period There will be an open question and answer period until March 14, 2014. Interested applicants may submit questions in writing by email to grants@respond.org.ua with the subject “Запитання на конкурс 4044-6”. Answers to all questions that arrive by that date will be combined into a FAQ file and mailed back to all those, who asked them, by March 21, 2014. Please note that no assistance will be provided by any RESPOND Project staff to any organization for the preparation of applications. No requests for meetings or phone calls related to this solicitation will be accepted during the application period. Prospective applicants are encouraged to respond to the solicitation in accordance with the guidelines provided. V. Evaluation Process and Criteria A. Evaluation Process Upon completion of the compliance review, all compliant applications will be subjected to a technical review by a review panel made up of representatives from the RESPOND Project and other key stakeholders (international NGOs involved in HIV/AIDS related work, primary recipients of the Global Fund grant). Final grant winners will be selected by a consensus of all technical reviewers. 10 When the selection committee makes a decision on the awardees of this RFA, the successful organizations will be asked to provide an English Language translation of their application. 10 B. Evaluation Criteria A total of 100 points are possible for the complete application. The relative importance of each criterion is indicated by the number of points it is assigned. Applicants should note that these criteria (1) serve as the standard against which all applications will be evaluated and (2) serve to identify the significant matters applicants should address in their proposals. Relevant Expertise and Past Performance ......................................................................... (35 points) Technical and Research Expertise and Capacity: Does the applicant have relevant experience and expertise in the area of process and outcome evaluation, ideally in related technical areas (HIV/AIDS, health, social services). Has the applicant described and provided examples of research methodologies and instruments used previously. Has the applicant proposed individuals with relevant experience– including the principal investigator(s), co-investigator(s), and collaborating investigator(s). Past Performance: Does the applicant demonstrate prior experience managing (technically, administratively, and financially) a project of similar type and complexity and to deliver the required results? Does the applicant have relevant publications, particularly in peer reviewed journals? Relevant clientele: Does the organization currently work, or have previous experience, with community based non-governmental organizations and/or key populations? Proposed Technical Approach ........................................................................................... (40 points) Research Design and Methods: Has the applicant: o Articulated the research goal and objectives o Described the proposed study design, including how the design will facilitate a feasible approach to producing generalizable results that answer the proposed research question(s). o Justified the research design and methodology, including an overall description of the target/source population and sampling plan, the observation/data collection framework, data analysis and management plans, and the definition and measurement of key variables (for example, exposure, outcome, confounding, and/or effect modifying variables). o Included a discussion of how human subject protections and gender considerations are reflected in the research approach and outcomes of interest. Project Management and Implementation ........................................................................ (25 points) Management and key personnel: Has the applicant clearly described how the proposed project will be managed, reporting structures, and relationships among organizational units? Are the proposed staff already employed by the organization? Do they have relevant program, managerial, or financial experience? If local staff will be recruited, what is the strategy of hiring and training these local staff to run the study? Implementation: Is the proposed implementation schedule realistic and achievable within the proposed budget and timeframe? Does the applicant have an existing presence in the geographic region where they are proposing to implement activities? Does the applicant have an existing and established network of local partners? What is the rationale provided for partnering with other organizations? Cost effectiveness and cost realism: The total budget will be evaluated for reasonableness and realism as it relates to the proposed project description. The overall budgetary competitiveness of the application may be determined based on composing an average ratio of activity vs. administrative costs as well as costs vs. expected impact. Other issues that will be considered are: does the applicant demonstrate that proposed results will be achieved with the most effective use of available resources? Does the applicant’s technical approach support the costs proposed? 11 12