AMERICA’S ARMY: THE STRENGTH OF THE NATION CBA Four-Day TRAINING SLIDES UNCLASSIFIED Cost-Benefit Analysis (CBA) Four-Day Training Briefing Day 1 CBA Introduction and Overview 25 June 2012 Visit our CBA Website for more information regarding locations, signing up, upcoming training sessions, and more https://cpp.army.mil 1 CBA Four-Day TRAINING SLIDES UNCLASSIFIED Welcome • The Army's senior leaders are committed in making resource-informed decisions by means of CBAs • Army leaders have identified cost culture as one of the highest priorities in adapting to an increasingly resource-constrained environment. Mr. Stephen G. Barth Deputy Assistant Secretary of the Army (Cost & Economics) AUSA National Meeting October 2010 2 Class Participation Guidelines CBA Four-Day TRAINING SLIDES UNCLASSIFIED Participants are expected to: • • • • • • • • Attend all four days of training Be punctual for each session Participate in discussions Relate his or her own experiences Ask questions Listen to others Avoid disrupting the class (i.e., side conversations) Refrain from using wireless devices during class: – Turn cell phones to either “off,” “silent,” or “vibrate” – Unless an emergency, do not use cell phones Please, wait until the break 3 Evaluation CBA Four-Day TRAINING SLIDES UNCLASSIFIED Each student will be assigned a final grade based on: • • • • Attendance Participation in mini-case exercises Performance on CBA Capstone Case Study Performance on final exam: writing a 2-hour CBA* * Individuals with an average grade (attendance, mini-case exercises, CBA Capstone Case Study) in the top 25% of the class will be waived from the final exam and may leave a day early. 4 CBA Four-Day TRAINING SLIDES UNCLASSIFIED Final Exam and Grading Procedures • Given a case study, individually perform and write a CBA (2 hours). • The final product will be evaluated one-on-one by an instructor, and assigned a grade of A (“We think you’ve got it”), B (“Pass, but study more”), or C (“Not yet mastered CBA methodology”). • Grade will determine access to class materials on AKO. • Not grading for grading’s sake, but a chance for free one-on-one hands-on evaluation. 5 Four-Day CBA Training Objectives CBA Four-Day TRAINING SLIDES UNCLASSIFIED Objectives: • Provide an overview of the Army’s CBA policies, regulations, methodology, and roles • Discuss CBA workflow automation tools • Offer additional tools to develop quality CBAs, such as: – Analytical and graphical tools and techniques – Cost analysis methodologies, databases, and models – Financial and operational benefits analyses • Review case studies and conduct exercises to illustrate the application of these tools and methodology 6 CBA Four-Day TRAINING SLIDES UNCLASSIFIED Purpose of the Class • The aim of the class is NOT to give an introduction to Cost-Benefit Analysis. A fourhour class exists for that purpose, as well as a CBA Guide. • The purpose of this course is to provide rigorous, analytical instruction, opportunities for handson application in performing Cost-Benefit Analyses, and one-on-one evaluation of work produced. 7 Four-Day CBA Training Schedule Monday UNCLASSIFIED CBA Introduction and Overview Step 1: Problem/Opportunity and Objective Step 2: Define CBA Boundaries and Parameters Tuesday Step 3: Define Alternatives CBA Four-Day TRAINING SLIDES Capstone Groups Assigned Step 6: Alternative Selection Criteria Step 4: Develop Cost Estimates for Each Alternative Step 7: Compare Alternatives Mini-case # 4 Step 8: Report Results and Recommendations Step 5: Benefits Mini-case #5, 6 Mini-case #1, 2, 3 Wednesday Thursday Capstone Case Study Presentation and Review Mini-case Exercises: #7, 8, 9, 10 Capstone Case Study Groups Meet 8 Day 1 Agenda 1200 – 1330: “CBA Introduction and Overview” 1340 – 1425: “Step 1: Problem/Opportunity and Objective” 1435 – 1520: “Step 2: Define CBA Boundaries and Parameters” 1530 – 1700: Mini-case exercises #1, 2, 3 CBA Four-Day TRAINING SLIDES UNCLASSIFIED • • • • 9 Key Learning Objectives CBA Four-Day TRAINING SLIDES UNCLASSIFIED The goal is to understand: • • • • • • • • What a CBA is Guidance from senior leaders Value of a CBA Responsibilities of key players Role of CBA in HQDA-level decision-making process Process of CBA (high-level perspective) Structure of a CBA Pre-CBA Considerations 10 CBA Four-Day TRAINING SLIDES UNCLASSIFIED A Note About Perspective Although this course draws largely on policies and activities at Headquarters, Department of the Army, the content and guidance are readily transferrable to subordinate command and installation level. 11 CBA Four-Day TRAINING SLIDES UNCLASSIFIED POLICY GUIDANCE 12 CBA Policies: OSD and the Army Department of Army Directive (Jan 07, 2011) (Dec 30, 2009) CBA Four-Day TRAINING SLIDES UNCLASSIFIED The Secretary of Defense Directive (Dec 27, 2010) (Aug 16, 2010) • “every new proposal or initiative will come with a cost estimate” • “effective 1 Feb 2011, calculate costs associated with [studies & events]” • “Require a cost estimate for all program and policy proposals” • “use Cost-Benefit Analysis (CBA) or similar analytical approaches/tools to support resourceinformed decision making” • “each unfunded requirement and new or expanded program…be accompanied by a thorough cost-benefit analysis” 13 CBA Four-Day TRAINING SLIDES UNCLASSIFIED Impact of the Army Directive • USA/VCSA memo was sent to HQDA principal officials (see back-up section for complete list of addressees) • As expected, the requirement is “trickling down.” – HQDA officials are requesting CBAs from the field – Subordinate commands are requiring CBAs internally 14 Army Leadership Expectations Leadership Expectations: CBA Four-Day TRAINING SLIDES UNCLASSIFIED • Ensure the CBA results and efficiencies comply with Department of Defense, Department of the Army, and congressional directives • Allocate limited funding to achieve Army’s strategic priorities efficiently • Collaborate with stakeholders to develop effective and efficient solutions • Use CBA to: – Make resource-informed decisions – Deliver strong value proposition for the Army 15 CBA Four-Day TRAINING SLIDES UNCLASSIFIED CBA DEFINITION AND DESCRIPTION 16 What is a CBA? CBA Four-Day TRAINING SLIDES UNCLASSIFIED Cost-Benefit Analysis: • Is a structured methodology used to identify alternative solutions to a problem, determine the costs and benefits of each alternative, define the appropriate decision criteria, and select the best alternative. • Produces a strong value proposition – a clear statement that the benefits outweigh the costs and risks. • In English: 1. 2. 3. 4. Define a problem or opportunity Identify alternatives Determine their costs and benefits Evaluate and select the best alternative 17 CBA and the “Cost Culture” CBA is part of a high-priority initiative to inculcate a cost culture throughout the Army. CBA Four-Day TRAINING SLIDES UNCLASSIFIED • In any organization, “culture” is the beliefs and principles that guide the behavior of the people in that organization. – For example: The Army’s military culture is based on mission accomplishment, selfless service, valor, and dedication. These concepts establish the foundation for how Soldiers and Civilians go about their duties. • In a cost culture: – Cost is an integral part of every decision – Soldiers and Civilians strive to find better and cost effective ways to operate the Army enterprise – Leaders at all levels engage in cost control and management activities, which are supported by talented cost staffs 18 CBA Four-Day TRAINING SLIDES UNCLASSIFIED VALUE OF CBA 19 Why Do We Need CBAs? CBA Four-Day TRAINING SLIDES UNCLASSIFIED Purpose: • Supplement (but not replace) professional experience, subject matter expertise, and military judgment with rigorous analytical techniques • Make best possible use of constrained resources • When making resource decisions: – – – – – Ensure that all decisions are resource-informed Treat cost a consideration from the outset, not as an afterthought Understand how much benefit will be derived Identify billpayers Consider second- and third-order effects 20 CBA Four-Day TRAINING SLIDES UNCLASSIFIED REQUIREMENT FOR HQDALEVEL REVIEW 21 CBAs Requiring HQDA Review UNCLASSIFIED – – – – CBA Four-Day TRAINING SLIDES Unfunded requirements, new program proposals, or expansions being presented to the Senior Leaders of the Department of the Army. Issues presented to HQDA forums/processes: POM/BES Army Campaign Plan (ACP) Army Requirements and Resourcing Board (AR2B) Force Design Update (FDU) – – – Army Requirements Oversight Council (AROC) Training Resources Arbitration Panel (TRAP) … and more to follow Issues that are important to the Army leadership, OSD, or Congress 22 CBA Four-Day TRAINING SLIDES UNCLASSIFIED CBARB • The Cost-Benefit Analysis Review Board, or CBARB, reviews each CBA submitted to HQDA and makes a recommendation to the Deputy Assistant Secretary of the Army (Cost and Economics) as to whether the CBA is suitable to support decision making. 23 CBA-RB Role for CBAs Submitted to HQDA CBA is submitted UNCLASSIFIED • CBA-RB reviews CBA: – – – – • Cost estimate Analytical rigor Assumptions Methodology and logic DASA-CE decision, based on CBARB recommendation: – CBA Four-Day TRAINING SLIDES CBA-RB reviews CBA and makes recommendation – Is the CBA suitable or adequate to support decision making? DASA-CE approval is not approval of the recommendation in the CBA DASA-CE approves CBA • Decision Maker uses CBA to make resource-informed decision CBA-RB members: – – – Board chair - Division Chief Standing members: Army Budget Office (ABO) PAED G-3/5/7 Other members, as needed based on the subject matter: Appropriate DASA(CE) divisions PEG representatives (as determined by PAED) ABO appropriation sponsors HQDA functional proponents Manpower specialist from G-1 Other functional proponent(s) Commands and installations are encouraged to establish similar teams to review and validate CBAs 24 Questions for Reviewers CBARB will determine whether the CBA is technically and functionally sound Problem Statement, Assumptions, and Constraints CBA Four-Day TRAINING SLIDES UNCLASSIFIED • • • • Is the Problem Statement clear, and does it accurately identify the issue? Are the assumptions clearly stated and realistic? Are all relevant constraints identified? Is the Problem Statement, assumptions, or constraints structured in a manner that is clearly intended to favor one alternative? Alternatives Development • • • • Is each of the alternatives feasible? Are the alternatives distinctly different? Are there obvious alternative that are not presented? Does the CBA adequately identify (with supporting documentation) the costs and benefits of each alternative? Accuracy • • Is the CBA technically correct (math, formulas, models, data sources, etc.)? Is the CBA functionally correct (facts, not opinions)? Analysis and Conclusions • • • • • • • Are the decision criteria clearly identified? Does the CBA use appropriate analytical techniques for the situation? Is the recommended alternative compatible with the assumptions and constraints? Does the analysis clearly explain how the recommended alterative is better than the others at satisfying the decision criteria? Does the recommended alternative satisfy the Problem Statement? Have the risks been adequately expressed in the analysis and recommendation? Does the decision briefing (or other final product) support the recommended alternative? 25 CBA Four-Day TRAINING SLIDES UNCLASSIFIED METHODOLOGY OVERVIEW 26 Surprisingly Simple CBA Four-Day TRAINING SLIDES UNCLASSIFIED CBA is easy to do! It’s not rocket science. 27 Eight-Step Methodology 1. Define Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative CBA Four-Day TRAINING SLIDES 5. Identify Quantifiable and Non-Quantifiable Benefits 6. Define Alternative Selection Criteria 7. Compare Alternatives 8. Report Results and Recommendations 28 UNCLASSIFIED Cost Benefit Analysis and the MDMP CBA Methodology Military Decision-Making Process (MDMP) * 1. Define Problem/Opportunity and Objective Receive Mission 2. Define Scope; Formulate Facts and Assumptions Analyze Restated Mission (includes assumptions and constraints) 3. Define Alternatives Develop Alternatives 4. Develop Cost Estimate for each Alternative CBA Four-Day TRAINING SLIDES Analyze Alternatives 5. Identify Quantifiable and Non-Quantifiable Benefits Compare Alternatives 6. Define Alternative Selection Criteria Approve Alternatives 7. Compare Alternatives 8. Report Results and Recommendations Issue Implementing Orders * As prescribed in FM 5-0. 29 CBA is Not a Linear Process Objective Recommendation Assumptions Sensitivity Analysis CBA Four-Day TRAINING SLIDES UNCLASSIFIED Alternatives Compare Alternatives Selection Criteria Benefits Estimate Cost Estimates At any step in the process, the team’s findings and analysis might make it necessary to revisit previous steps. Significant findings might require asking the decision maker for revised guidance. 30 Step 1: Define the Problem/Opportunity and Objective 1. Define the Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters Before beginning, determine whether the proposal is realistic and will be seriously considered. UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives 8. Report Results and Recommendations • The Problem Statement clearly defines the problem/opportunity that: – Requires a solution – Describes what the effort will accomplish • The objective of the analysis: – Describes the role of the CBA: what is the decision to be made, and how does the CBA inform and support it. 31 Step 2: Define CBA Boundaries and Parameters 1. Define the Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives The Boundaries and Parameters of a CBA are the specifications that make an analysis feasible and practicable. They are expressed by Scope, Facts, and Assumptions. • Scope: Defines the range of coverage encompassed by an initiative or proposal along specific dimensions like time, location, and organization. • Fact: A verifiable statement that is real and something that has happened or is happening. • Assumption: A condition or situation over which we have no control but is essential to the success of our proposed solution. 8. Report Results and Recommendations 32 Step 3: Define Alternatives 1. Define the Problem/Opportunity and Objective 2.Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative • Alternatives: – Potential solutions to the Problem Statement, given Scope, Facts, Assumptions, and Constraints. – They must include the status quo or current state, if applicable. 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives 8. Report Results and Recommendations 33 Step 4: Develop Cost Estimate for Each Alternative 1. Define the Problem/Opportunity and Objective Cost Estimates: 2. Define the Scope; Formulate Facts and Assumptions • Capture the total cost of each alternative over the appropriate period of analysis. UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria Types of Cost Estimates: • • • • Historical Parametric Analogy Engineering 7. Compare Alternatives 8. Report Results and Recommendations Document the cost estimate with data sources, computations, rationale, etc. as this is essential to the review/validation process. 34 Step 5: Identify Quantifiable and Non-Quantifiable Benefits 1. Define the Problem/Opportunity and Objective 2.Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives • Benefits: “Benefits of a chosen alternative are results expected in return for costs incurred. They are the quantitative and qualitative results expected or resulting from the implementation of a project/initiative (which may include but are not limited to the following: equipment, facilities, hardware, systems, etc.).” (CBA guide, “Step 5”) 8. Report Results and Recommendations 35 Step 6: Define Alternative Selection Criteria 1. Define the Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives • The standards upon which the decision will be based – Criteria must be consistent with the Problem Statement and the benefits 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits 6. Define Alternative Selection Criteria CBA Four-Day TRAINING SLIDES Alternative Selection Criteria: CBAs must: • Identify the recommended decision criteria • Elucidate how much each alternative satisfies the criteria 7. Compare Alternatives 8. Report Results and Recommendations Leadership Engagement: The Lead Analyst should work with the Functional Manager to ensure they agree on the selection criteria, particularly if criteria will be weighted in the evaluation phase 36 Step 7: Compare Alternatives 1. Define the Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives 8. Report Results and Recommendations Alternative Comparison: Compare alternatives using the selection criteria to identify the preferred alternative. Billpayer Analysis: Identify the billpayer if there is a bill associated with the recommended alternative. Effects Analysis: Identify the positive and negative impacts of the 2nd and 3rd order effects. What must be done to manage the negative impacts? Sensitivity Analysis: Determine the robustness of the conclusions. If anything changes (i.e., assumptions, costs, benefits) would the recommendation change? Risk Analysis: Identify the high-risk aspects of the recommended alternative and define appropriate risk mitigation measures. 37 Step 8: Report Results and Recommendations 1. Define the Problem/Opportunity and Objective 2. Define CBA Boundaries and Parameters Results and Recommendations: • • UNCLASSIFIED 3. Define Alternatives 4. Develop Cost Estimate for each Alternative • • Summarize the analysis Make conclusive statements about each of the alternatives and how they were evaluated Present specific recommended solution Include documentation used in all steps 5. Identify Quantifiable and Non- Quantifiable Benefits CBA Four-Day TRAINING SLIDES 6. Define Alternative Selection Criteria 7. Compare Alternatives 8. Report Results and Recommendations 38 Packaging the Complete Product Preferred document format is a narrative. CBA Four-Day TRAINING SLIDES UNCLASSIFIED • Narrative provides all the words that would accompany a briefing and therefore is more clearly understood • Cost estimates are easier to document by including spreadsheets Key elements for both formats: • Clarity: • • Does not contain vague, unsubstantiated statements/data Presented in suitable terms for the intended recipient • Analytical rigor: • Steps are supported by and consistent with the preceding steps • Completeness: • Key deliverables are addressed at each step of the methodology CBA examples of narrative and briefing forms are in “Appendix E,” CBA Guide, https://cpp.army.mil 39 CBA is Not Rocket Science CBA Four-Day TRAINING SLIDES UNCLASSIFIED At the conclusion of this class, if you continue to follow the methodology we teach, you’ll find that a CBA is 40 CBA Four-Day TRAINING SLIDES UNCLASSIFIED IMPORTANT: CBA Guide • Establishes the standard procedure for preparation of CBAs, located at https://cpp.army.mil under “Documents” tab. • All preparers should refer to and follow the procedures set forth in the CBA guide. These are the standards against which all CBAs will be evaluated. 41 CBA and Army Decision Making CBAs: CBA Four-Day TRAINING SLIDES UNCLASSIFIED • Are becoming embedded in the Army’s decision-making processes • Are based on a sound, logical approach to problem solving Value of CBAs: • Supplement (but not replace) professional experience, subject matter expertise, and military judgment • Ensure the efficient allocation of the Army’s limited funds by enabling leaders to make better cost-informed decisions 42 Expectations and Tips CBA Four-Day TRAINING SLIDES UNCLASSIFIED What senior leaders expect: • Support of the Army’s strategic priorities, directives, and regulations • Analytical rigor and innovative thinking • Collaboration with stakeholders to develop effective and efficient solutions • Feasible alternatives To plan for success in your CBA role: • Form a capable CBA team with clear roles and responsibilities • Understand the CBA eight-step methodology and the key deliverables • Establish a timeline to monitor progress • Leverage available support (identified in the “Resources” section of this briefing) 43 CBA Four-Day TRAINING SLIDES UNCLASSIFIED RESOURCES 44 Available Tools and Models for Cost Data Some of the websites listed here require user accounts. In most cases, anyone with a dot mil address can obtain an account. You are encouraged to scan these sites and request an account to any site that you think will be useful to you. This will save time when you need to use any sites to support a CBA or other projects. Tool/Model UNCLASSIFIED Purpose https://www.osmisweb.army.mil/forces/login.aspx Suite of models that provides quick and reasonable unit cost estimates to a wide variety of users https://www.osmisweb.army.mil/amcos/app/home.aspx Personnel costs for military, civilian, and/or contractor ASA(FM&C) Website http://asafm.army.mil/Documents/OfficeDocuments/CostEconomics/ rates/indices.xls Inflation indices Capabilities Knowledge Base http://asafm.army.mil/Documents/officedocuments/costeconomics/ guidances/ckb-ui.pdf http://asafm.army.mil/offices/CE/Ckb.aspx?OfficeCode=1400 Research, development, and acquisition costing for major weapon/material systems https://www.osmisweb.army.mil/osmisrdb/login.aspx Operating and support information for major weapon/material systems FORCES Cost Models CBA Four-Day TRAINING SLIDES URL Army Military-Civilian Cost System (AMCOS) Operating and Support Management Information System (OSMIS) Access links through the “Resources” tab in the CBA Portal at https://cpp.army.mil 45 References and Assistance CBA Four-Day TRAINING SLIDES UNCLASSIFIED • Cost-Benefit Analysis Portal – Go to the Cost & Performance Portal (CPP) at https://cpp.army.mil – If you already have a CPP account, click Enter Site. If not, click Request a New Account and follow the instructions to register your Common Access Card (CAC). – If you get the message, There is a problem with this website’s security certificate, click on Continue to this Website. – On the next screen, in the upper-left corner • For the CBA Guide, examples, and related tools, click on Cost Benefit Analysis (CBA) Portal. • To submit or track the status of CBAs, click on CBA Workflow Tool. • Dedicated mailbox provides authoritative answers to all questions: – NIPR: usarmy.pentagon.hqda-asa-fm.mbx.army-cost-benefit-analy@mail.mil – SIPR: CBA@hqda-s.army.smil.mil 46 Before Beginning a CBA CBA Four-Day TRAINING SLIDES UNCLASSIFIED • Pre-CBA Considerations: – Ensure that a CBA is needed – Select a qualified CBA team – Ensure that the relevant decision-making forum is aware of the CBA review, so that the work of the CBA and review is a “value-added” process. 47 CBA Four-Day TRAINING SLIDES UNCLASSIFIED Pre-CBA Considerations - Need for CBA • A CBA is appropriate whenever decision-makers can be aided by an objective and resource-informed analysis of problems and alternatives. • When a CBA is required: VCS/USA Memo, 30 Dec 2009—“…each unfunded requirement and new or expanded program proposal submitted to the Secretary of the Army, Chief of Staff, Army, Under Secretary of the Army or Vice Chief of Staff, Army, [must] be accompanied by a thorough cost-benefit analysis (CBA).” 48 Pre-CBA Considerations - CBA Team Identification CBA Four-Day TRAINING SLIDES UNCLASSIFIED Validate the need for a CBA CBA Team • CBA is a team effort, not an individual effort • CBA Lead Analyst: Integrates efforts of CBA team • CBA Functional Proponents and Representatives: Provide data, assist in COA development, determine cost elements, validate/provide assumptions and constraints • CBA team members should: – Attend CBA training or orientation 49 CBA Four-Day TRAINING SLIDES 50 UNCLASSIFIED