NIH and the Grant Review Process Dawn M Elliott, PhD BIOMEDICAL ENGINEERING Outline • What’s up with the NIH? • What happens to my grant after it is submitted? • What happens at a study section? BIOMEDICAL ENGINEERING National Institutes of Health (NIH) The steward of medical and behavioral research for the nation. Composed of 27 Institutes and Centers (ICs) Provide leadership and financial support NIH Public Health Mission: To enable discovery of new knowledge that leads to better health for the nation Support peer-reviewed scientific research at universities, medical schools, hospitals, and research institutions Train research investigators. Develop and disseminate credible health information based on scientific discovery. BIOMEDICAL ENGINEERING NIH = National Institutes of Health NCI – National Cancer Institute NEI – National Eye Institute NHGRI - National Human Genome Research Institute NHLBI - National Heart, Lung, and Blood Institute NIA - National Institute on Aging NIAAA - National Institute on Alcohol Abuse and Alcoholism NIAID - National Institute of Allergy and Infectious Diseases NIAMS - National Institute of Arthritis and Musculoskeletal and Skin Diseases NIBIB - National Institute of Biomedical Imaging and Bioengineering NICHD - National Institute of Child Health and Human Development NIDA - National Institute on Drug Abuse NIDCD - National Institute of Deafness and Other Communication Disorders NIDDK - National Institute of Diabetes and Digestive and Kidney Diseases NIDCR - National Institute of Dental and Craniofacial Research NIEHS - National Institute of Environmental Health Sciences NIGMS - National Institute of General Medical Sciences NIMH - National Institute of Mental Health NINDS - National Institute of Neurological Disorders and Stroke NINR - National Institute for Nursing Research BIOMEDICAL ENGINEERING A Simple View of the NIH For help with the business aspects – Listed on the eRA Commons link to your submitted application Intramural Research Program About the scientific and technical aspects – Listed in FOA and IC’s programmatic descriptions For questions during the review – Grants Management (GMS) Listed on the eRA Commons link to your submitted application Extramural Research Scientific Program Review Scientific Program (PD/PO) (SRO) BIOMEDICAL ENGINEERING Program Director/Officer (PD/PO) Roles and Responsibilities Scientific Public Face of the Government Pre-application and post-review scientific contact; Responsible Steward of Public Funds Monitor award and progress; ensure proper use of public fund Scientific Portfolio Builder Help to set/implement IC priorities; design/execute specific initiatives; make funding recommendations BIOMEDICAL ENGINEERING Scientific Review Officer (SRO) Federal Official responsible for implementing review policies and procedures and a fair, unbiased and competent review Primary NIH contact with PIs during review phase Manager of all aspects of the review process: Analyze applications for completeness, scientific content and determines who will review them Manage and oversee scientific peer review meetings to ensure the fairness and consistency; legally responsible for ensuring NIH regulations and policies are followed Prepare summary statements reflecting recommendations from the review meeting BIOMEDICAL ENGINEERING Grants Management Specialist (GMS) Provide advice on all business-related aspects of NIH grants such as budgets Monitor the business management practices of grantee organization to assure awarded funds are spent properly Assure grantees fulfill requirements regarding laws, regulations and administrative grant policies Pre-Award Steps: Just-in-time (JIT) information Eligibility verification statement Human and Animal subjects training and approvals Other support for key personnel Consortium/subcontract information Post-Award Advice/Guidance Annual Progress Reports Financial Status Reports Closeout activities GMS issues the Notice of Award! BIOMEDICAL ENGINEERING Who to Contact When? Application in Contact YOUR GRANTS OFFICE, or grant.gov, or NIH eRA Help for issues related to submission. Contact PD/PO for IC scientific mission relevance of your research, and advice on grant mechanism, IRG selection and/or revision; and GMS for budget related issues. Contact SRO for any review related issues such as changing IRG, sending in supplements, indicating conflicts etc. Peer Review Contact PD/PO for revision and funding. Once funded, contact PD/PO for scientific relevant issues and GMS for process and/or policy B I O M E D I issues. CAL ENGINEERING Finding NIH Grant Opportunities All applications must be submitted in response to a Funding Opportunity Announcement (FOA) FOAs are posted online in the NIH Guide for Grants & Contracts and at www.Grants.gov (under “Find Grant Opportunities”) – All of the NIH FOAs (unsolicited and solicited) found at the NIH Guide http://grants.nih.gov/grants/guide/index.html – Weekly NIH Funding Opportunities and Notices published – Sign up at http://grants.nih.gov/grants/guide/listserv.htm BIOMEDICAL ENGINEERING Types of NIH Applications “Unsolicited” or “investigator-initiated” – Majority of NIH funded applications – Research ideas come from PIs “Solicited” – NIH publishes Funding Opportunity Announcement (FOA) to solicit specific research topics or types Program Announcement (PA) Request for Applications (RFA) BIOMEDICAL ENGINEERING Some NIH Funding Mechanisms Research Project Grants – RPG (R01) – Requires high likelihood of success and strong preliminary data – Under $500,000/year , up to 5 years – >$500K direct cost requires permission to apply NIAMS Small Research Grants (R03) – New Investigators only, limited to 2 R03 awards/career – $50,000/yr direct costs, 3 year maximum, not renewable Developmental/Exploratory Grants (R21) – Ground breaking, potentially high yield research – $275K direct costs over two years, not renewable – not recommended for New PIs to obtain preliminary data BIOMEDICAL ENGINEERING NIH New Investigator Policy New Investigator (NI): Principal Investigator (PD/PI) who has not previously competed successfully as PD/PI for a significant NIH independent research award; but may have received the following: fellowships (F), career awards (K), R00, R03, R15, R21, R34, R36, R41, R43 NIH expects to support NIs at success rates equivalent to that of established investigators This policy applies only to the R01 mechanism The NIH strongly encourages Nis to apply for R01 grants when seeking first-time NIH funding Advantage at Review – clustered together to be reviewed Advantage at Funding – higher percentile for funding All PIs on a Multi-PI application must be NIs BIOMEDICAL ENGINEERING Outline • What’s up with the NIH? • What happens to my grant after it is submitted? • What happens at a study section? BIOMEDICAL ENGINEERING Review Process for a Grant BIOMEDICAL ENGINEERING NIH Dual Level Review System First Level – Peer Review Scientific Review Group (SRG) Independent outside review Output: Priority Score Evaluate scientific merit, significance and Summary Statement Recommend length and level of funding Second Level – Council Review 3-7 months Scientific Advisory Council Assesses Quality of SRG Review of Grant Applications Makes Recommendations to the Institute/Center (IC) on Funding Evaluates Program Priorities and Relevance 1-3 months Output: Funding Recommendations NIH IC Director Output: Awards or Resubmission BIOMEDICAL ENGINEERING Two Level Review Process Center for Scientific Review (CSR) Receipt, Referral, & Review – Receives all grant applications – Assigns (“Refers”) to o study sections for review o ICs for potential funding – Reviews most of the NIH grant applications – CSR does not fund grants NIH Institutes and Centers (ICs): Secondary Review, Funding Decisions, Management, & Oversight – Program Directors, Grants Management Specialists, and IC specific Scientific Review Officers – Fund and manage grants and contracts BIOMEDICAL ENGINEERING Who Makes Final Funding Decisions? The Institute or Center Director Taking the recommendations from the Council and Program Directors, consider the following factors: Scientific Merit Contribution to Institute Mission Program Balance Availability of Funds BIOMEDICAL ENGINEERING NIH Grant Application Process – Summary Grant application in the CSR; is logged in and given a unique ID number application assigned to an integrated review groups (IRG) and to a Study Section for initial peer review. application also assigned to NIH IC based on research topic PI can log in to the eRA Commons to get assignment information within 6 weeks after the CSR receives application SRO sends applications to reviewers 1 month prior to the Study Section meeting for their review and preliminary scores Application is either discussed (if score is in top ~50%) or not discussed (if scores is in bottom ~50%) at the Study Section meeting (View mock study section at http://www.csr.nih.gov/Video/Video.asp) BIOMEDICAL ENGINEERING NIH Grant Application Process – Summary 2 days after review meeting, PI can see priority score or determine that application was not discussed in the Commons Roughly 4 weeks after review, summary statement will be posted on the NIH Commons, or 1-2 weeks for new PI Applications undergo second-level review by the Institute advisory Council IC will request “Just In Time“(JIT) materials if application is within an IC’s pay line or close to it All the administrative issues raised in the summary statement must be addressed prior to funding For most to-be-funded applications, you will receive Notice of Award (NoA or NGA) within 6 to 8 weeks of Council meeting First time applications that are not funded can be revised based on feedback from the review and resubmitted for reconsideration BIOMEDICAL ENGINEERING Relevant Scientific Review Groups One of the five divisions – the Division of Translational and Clinical Sciences includes: Musculoskeletal, Oral & Skin Sciences (MOSS) IRG reviews applications on structural systems prerequisite for physical form, mechanical function, movement, & integrity of the body. Some study sections are: • • • • • • • Oral, Dental and Craniofacial Sciences Study Section [ODCS] Skeletal Biology Development and Disease Study Section [SBDD] Skeletal Biology Structure and Regeneration Study Section [SBSR] Skeletal Muscle Biology and Exercise Physiology Study Section [SMEP] Musculoskeletal Rehabilitation Sciences Study Section [MRS] Arthritis, Connective Tissue and Skin Study Section [ACTS] Musculoskeletal Tissue Engineering Study Section [MTE] Surgical Sciences, Biomedical Imaging, and Bioengineering (SBIB) IRG review applications for research grants that address topics in a variety of areas at the interface between a physical science or engineering and biomedical or clinical research. Some study sections are: Bioengineering, Technology, and Surgical Sciences [BTSS] Medical Imaging Study Section [MEDI] BIOMEDICAL ENGINEERING Center for Scientific Review • The CSR study section rosters are public • You can request that your proposal be reviewed by a particular study section • Often, program officers from several institutes attend each study section • A few grants are not reviewed by CSR, but are reviewed by institute-run subcommittes Examples: training grants, K-awards, some R03s, and special initiatives BIOMEDICAL ENGINEERING Outline • What’s up with the NIH? • What happens to my grant after it is submitted? • What happens at a study section? BIOMEDICAL ENGINEERING NIH Study Section Meeting • Each Study Section has 12-23 members university, government, industry scientists “regular” and “ad hoc” • One regular member is chair • Scientific Review Administrator (SRA) is NIH’s overseer and works for CSR • Up to 60-100 proposals reviewed in a session BIOMEDICAL ENGINEERING NIH study section meeting BIOMEDICAL ENGINEERING NIH Study Section Meeting • Each proposal is assigned to a primary reviewer a secondary & usually a tertiary reviewer can have 1-3 “readers” • Each reviewer has about 10 reviews to write and several proposals to read • Everyone is free to discuss/comment • Everyone scores every proposal BIOMEDICAL ENGINEERING Review Formats OVERALL IMPACT Reviewers will provide an overall impact score to reflect their assessment of the likelihood for the project to exert a sustained, powerful influence on the research field(s) involved, in consideration of the following five scored review criteria, and additional review criteria. SCORED REVIEW CRITERIA Reviewers will consider each of the five review criteria in the determination of scientific and technical merit, and give a separate score for each. Strengths and weaknesses will be identified for each of the five review criteria 1. Significance 2. Investigator(s) 3. Innovation 4. Approach 5. Environment BIOMEDICAL ENGINEERING NIH Scoring System Impact Full Description Score – Descriptor High Exceptionally strong with essentially no weaknesses 1 – Exceptional Extremely strong with negligible weaknesses 2 – Outstanding Very strong with only some minor weaknesses 3 – Excellent Medium Strong but with numerous minor weaknesses Low 4 – Very Good Strong but with at least one moderate weakness 5 – Good Some strengths but also some moderate weaknesses 6 – Satisfactory Some strength but with at least one major weaknesses 7 – Fair A few strengths and a few major weaknesses 8 – Marginal Very few strengths and numerous major weaknesses 9 – Poor Minor weakness: Easily addressable weakness that does not substantially lessen impact. Moderate Weakness: Impact lessened. Major Weakness: Impact severely limited. Overall Impact Score = Panel Average x 10 BIOMEDICAL ENGINEERING Reviewers • Reviewers are not blinded to the applicants because they must assess their qualifications • The applicants will be told who was on the review panel • Reviewers leave the room during the discussion if they work at the applicant’s institution are otherwise close to the applicant BIOMEDICAL ENGINEERING NIH study section meeting • “Streamlining” or triage at start reviewers provide list of proposals they reviewed that were in bottom half if assigned reviewers agree and no one objects, proposal not scored or discussed anyone can object, no argument necessary • Usually < half streamlined • Norm is ~10-20 min. per discussed proposal BIOMEDICAL ENGINEERING NIH study section meeting • Initial level of enthusiasm (score) • Primary reviewer presents the proposal description positive and negative aspects • Secondary & tertiary reviews follow detail depends on extent of agreement • Readers comment, general discussion • Reviewers give final scores (often change) • Everyone writes down their own score (must be within range OR write down why scoring outside the range) BIOMEDICAL ENGINEERING Ethics, Etiquette, and Politics • The SRA, chair are ethics watchdogs no conflicts of interest, real or perceived no discussions of application between reviewer and applicant, before or afterward all discussions of applications between reviewers must occur in session • The mood of the room is professional • Other NIH administrators present BIOMEDICAL ENGINEERING Summary Statement Review results are documented by the Scientific Review Officers (SROs) in a summary statement and made available to the PI and NIH Institute/Center where a funding decision is made. A priority score and, in some cases, a percentile will be posted on Commons account if application is discussed. Proposals will receive a summary statement that contains: – Impact/Priority Score and possibly a Percentile Ranking and overall Resume and Summary of Discussion (if discussed) – Essentially Unedited Critiques from individual reviewers (2-4) – Budget Recommendations – Administrative Notes (animal, human, overlap, etc.) For questions on the summary statement, applicants should contact the Program Director, NOT Scientific Review Officer! BIOMEDICAL ENGINEERING Final thoughts • Thanks to Tom Buchanan (UD) and Gayle Lester (NIH) for providing slides • Good luck! • Grant writing can be the most intellectually engaged part of your job • The review process is not perfect, but it is pretty good and quite fair BIOMEDICAL ENGINEERING