US Army Corps of Engineers Honolulu District PROJECT DEFINITION RATING INDEX (PDRI) Presented by Olson Okada, P.E. Construction Services Section, Construction Branch Ph: 438-7066 BREAKOUT SESSION No. H 2009 Corps Workshop 1 US Army Corps of Engineers Honolulu District Agenda Overview The Tool The Process The Score MILCON Implementation Questions 2 US Army Corps of Engineers Honolulu District Overview An Acronym Project Definition Rating Index An Index Score along a continuum representing the level of scope definition A Risk Management Tool Identifies and measures risks related to project scope definition 3 US Army Corps of Engineers Honolulu District What Is It? Is a risk management tool: Identify—score sheet and descriptions Measure—scoring mechanism Mitigate—action items 4 US Army Corps of Engineers Honolulu District PDRI Buildings Developed in 1999 Extensively used: 3M, Hensel Phelps, NASA, GM, Department of State, GSA, Beck Group, Smithsonian Institution, LDS, etc. 3rd Edition - PDRI Building Projects, CII Implementation Resource 155-2 http://construction-institute.org/pdri/ 5 US Army Corps of Engineers Honolulu District Tool Format The crucial elements that need to be included in a scope definition for building projects. Composition: 3 Sections 11 Categories 64 Elements 38 pages of detailed element descriptions; Rate each of the 64 elements to obtain a project score of up to 1000 points--the lower the better. 6 US Army Corps of Engineers Honolulu District How to Use As a checklist in early project development (81%) As a “gate” check before the next phase (72%) In conjunction with other frontend planning measurement methods (72%) Measure or benchmark frontend planning process performance (70%) More than once on most projects (42%) 7 US Army Corps of Engineers Honolulu District How To Use (Cont’d) Others: As an audit tool (42%) In a modified form for small or unusual projects (33%) To help capture lessons-learned (28%) With the help of an outside facilitator (19%) 8 US Army Corps of Engineers Honolulu District What Can PDRI Do For You? Helps with alignment of project participants Promotes consistency in planning Identifies project risks Can be used in developing the facilities program 9 US Army Corps of Engineers Honolulu District How Was It Developed? Earlier CII Research Research Team expertise Scope development packages from companies Brainstorming, affinity diagramming Workshop of project managers and estimators 10 US Army Corps of Engineers Honolulu District SECTION I - BASIS OF PROJECT DECISION Definition Level CATEGORY Element 0 1 2 3 4 5 Score A. MANUFACTURING OBJECTIVES CRITERIA A1. Reliability Philosophy A2. Maintenance Philosophy A3. Operating Philosophy CATEGORY A TOTAL B. BUSINESS OBJECTIVES B1. B2. B3. B4. B5. B6. B7. B8. Products Market Strategy Project Strategy Affordability/Feasibility Capacities Future Expansion Considerations Expected Project Life Cycle Social Issues CATEGORY B TOTAL C. BASIC DATA RESEARCH & DEVELOPMENT C1. Technology C2. Processes CATEGORY C TOTAL D. PROJECT SCOPE D1. D2. D3. D4. D5. D6. Project Objectives Statement Project Design Criteria Site Characteristics Available vs. Req’d Dismantling and Demolition Req’mts Lead/Discipline Scope of Work Project Schedule CATEGORY D TOTAL E. VALUE ENGINEERING E1. Process Simplification E2. Design & Material Alts. Considered/Rejected E3. Design For Constructability Analysis CATEGORY E TOTAL Definition Levels 0 = Not Applicable 1 = Complete Definition 2 = Minor Deficiencies 3 = Some Deficiencies 4 = Major Deficiencies 5 = Incomplete or Poor Definition 11 US Army Corps of Engineers Honolulu District PDRI Buildings Score Sheet Sections I. Basis of Project Decision “Right Project” II. Basis of Design “Right Product” III. Execution Approach “Right Way” Categories A. Business Strategy B. Owner Philosophy C. Project Requirements D. Site Information E. Bldg Programming F. Bldg/Design Parameters G. Equipment H. Procurement Strategy J. Deliverables K. Project Control L. Project Execution Plan Elements 8 (214 points) 4 ( 68 points) 6 (131 points) 8 (108 points) 13 (162 points) 8 (122 points) 3 (36 points) 2 2 5 5 (25 (11 (63 (60 points) points) points) points) 12 US Army Corps of Engineers Honolulu District Top 10 Pacing Elements Building Use (4.4%) Facility Requirements (3.1%) Site Selection Considerations (2.8%) Business Justification (2.7%) Project Cost Estimate (2.7%) Business Plan (2.6%) Project Design Criteria (2.4%) Evaluation of Existing Facilities (2.4%) Future Expansion/Alteration Considerations (2.2%) Architectural Design (2.2%) Top 10 = 27.5% of total PDRI score 13 US Army Corps of Engineers Honolulu District Tool Format Rating from 0 to 5 in each of 64 different project elements Zero is a non-applicable element One is complete definition of element Five is high level of uncertainty Tool has been customized for MILCON process Customized descriptions of project elements to our needs Each element is weighted, algorithm generates a composite score for the project Normalized from 0 to 1000 Recommend a broad team composition 400 - 500 is “good” at planning stage (subjective!!) 200 is “good” in design 14 US Army Corps of Engineers Honolulu District Element Scoring – Definition Level 0 1 2 3 4 5 15 US Army Corps of Engineers Honolulu District Using PDRI Tool tailored for MILCON processes, customized project element descriptions Removed profit sharing items & considerations specific to private industry Included specialized requirements - ATFP, LEED, IDG, Fire Protection, etc. Formulas unaltered to maintain consistency with industry standards Each element is independently weighted, algorithm generates a composite score for the project Adaptable for smaller projects or renovations Normalized score from 0 to 1000 Normalized PDRI Scores Risk Low Moderat e High Planning <650 650-800 800-1000 Design <500 500-649 650-1000 RTA <200 200-399 400-1000 16 US Army Corps of Engineers Honolulu District When to Conduct PDRI Potential Stages to Score a Project 0 Feasibility 2 i 2 1 1 Concept 2 Detailed Scope 3 3 Design and Construc tion 17 US Army Corps of Engineers Honolulu District Mechanics of Using PDRI Scoring Session Participants Timing Documents Needed Process Example Taking Action 18 US Army Corps of Engineers Honolulu District Scoring Participants Project sponsor(s) Project engineer or architect Key discipline leads Technical representatives User representative(s) Design/Builder or Construction Manager PDRI Facilitator 19 US Army Corps of Engineers Honolulu District Source Documents for Scoring PDRI Score Sheet PDRI Descriptions Written scope documents and studies Design sketches, drawings & specifications 20 US Army Corps of Engineers Honolulu District Process for Using PDRI Read descriptions of each element Discuss issues & review documents if needed Select definition level for each element Score each element Add element scores to obtain PDRI score Take Action 21 US Army Corps of Engineers Honolulu District An Example Definition Level CATEGORY 0 1 2 3 4 5 Score J1. Water Treatment Requirements 0 1 3 5 7 10 3 J2. Loading / Unloading / Storage Facilities Req’mts 0 1 3 5 7 10 0 J3. Transportation Requirements 0 1 5 5 Element J. INFRASTRUCTURE (Maximum Score = 25) CATEGORY J TOTAL 8 Definition Levels 0 = Not Applicable 1 = Complete Definition 2 = Minor Deficiencies 3 = Some Deficiencies 4 = Major Deficiencies 5 = Incomplete or Poor Definition 22 US Army Corps of Engineers Honolulu District Scoring Session Duration 90 to 120 minutes Recommend a broad team composition 23 US Army Corps of Engineers Honolulu District Observations from Usage Works best with neutral facilitator and team approach Focus on scoring process, not score Use on pilot projects to establish comfort level/Train users Can be used effectively early in process; at least twice per project Strive for consistency with SOPs/Standards 24 US Army Corps of Engineers Honolulu District PDRI – The Score 1000 Points 0 Points LOWER SCORE IS BETTER!! 25 US Army Corps of Engineers Honolulu District Statistical Score Comparison Performance Score < 200 Score > 200 Cost 3% over budget 9% over budget Schedule 5% behind schedule 21% behind schedule Change Orders 8% of budget 11% of budget (N=25) (N=83) •Reduce cost growth by 6% •Reduce schedule slip by 16% •Reduce change orders by 3% of budget 26 US Army Corps of Engineers Honolulu District MILCON Implementation Formal Assessments at Code 0 – Planning Charrette Code 6/7/T - Design Charrette RTA Informal PM Review & follow-up on actions items at Code 3 ENG 3086 Tier 3 designation Retarget project resources on risk buy down Previous PDRI rating used as additional data input to Tier designation Implementation Procedures PDRI assessment & rating at 75% in Charrette Upload project element scores, comments, & project data online Attach overall PDRI assessment to 1391 Tab C Follow-up on PDRI Action Item List from PM & project team 27 US Army Corps of Engineers Honolulu District PDRI Home Page 28 US Army Corps of Engineers Honolulu District Element Details 29 US Army Corps of Engineers Honolulu District Low Definition Elements 30 US Army Corps of Engineers Honolulu District Summary Reports 31 US Army Corps of Engineers Honolulu District On-Line Training 32 US Army Corps of Engineers Honolulu District Tier Definitions Tier 1 Pres-bud and prior year un-awarded projects that have no perceived problems and will be "forecasted" and "scheduled" for an award within the goals established by for the FY Tier 2 Project with known or perceived problems but are still expected to be awarded/executed this fiscal year will be "forecasted" and "scheduled" for award within FY Tier3 Projects with problems and cannot be awarded within fiscal year include: 33 US Army Corps of Engineers Honolulu District Benefits to DOD Early identification / management of project risk elements Standard approach to Lifecycle Costing Institutionalize procedures for Risk Management/Communication/Scope Definition Project Action Item List, by element, for risk mitigation Risk Management improves Customer end product Reduce scope creep Fewer change orders – decrease cost & time growth Early Customer input and buy-in PDRI enables targeted, holistic, and quantitative approach to Risk Management 34 US Army Corps of Engineers Honolulu District QUESTIONS? 35